I know it very well. In my experience the best way to coop with it, is by being open about that you have the need of loading social energy. Be sure to know how you best can get your social battery full again, so that they know, that you need thus break. In that way they will, (if they are good colleagues) not see it like you don’t like or want the people around you.