Then just don't go? I personally prefer mixed gender spaces but I can understand why some people might prefer single gender spaces. It doesn't mean they necessarily have "an issue".