Party Vegetable
Noun: An individual who dislikes parties and who sits and does nothing until the person or persons that he or she arrived with are ready to leave. Party vegetables typically become morose and withdrawn when in a large social gathering of unfamiliar people.
My brother's a party animal, but I'm a party vegetable who gets depressed if we stay too long.