Yes it's easier to leave him home.  Let him stay with Tom while I go hang out with my two favorite ladies.  Two on one, big people to littles.  It's a lot less hectic, a lot less tiring.

But.

The look on their faces when they see each other?  When they realize that this wasn't just a normal outing, that they get to see their buddy?  Pure joy, happiness and excitement.