Ask HN: How do you decide whether to accept a LinkedIn invitation?

If the invitation comes from someone who is in some way connected to my career, I always accept. However, I'm at a loss when one comes from somebody I barely knew in high school or from a recruiter with no additional context.

Whose invites do you accept? Is there any benefit to curating one's connections or should we just be accepting all invitations?