How to get rid of annoying people that keep rejoining your xbox live party help!?

Before i get called stupid or Dumbass by some people, I meant if u already kicked someone out of the party and they keep coming back over and over and over. I want to know how without having to be really mean to them! Please help!