Extremely unfair...

Anyone explaining to you that it isn't all men is simply stating a fact. To emotionally jump to the conclusion that the person saying it is probably a perpetrator of sexual assault is madness.

Let me state the fact for you as well: It's not all men.

If it makes you uneasy to hear a simple truth like that, I don't know what to say.

You need to judge people based on the content of what they say. Not based on how they emotionally make you feel. That's a how an effective intelligent conversation about difficult matters can take place.