I think that you SHOULD get to play! I play in a couple of my challenges when I host them. It's never been a problem.
If you are worried about it, eliminate voting and use random.org. Lots of the forums are going that route. It's much easier on the hostess and seems to really encourage more participation.