If only 1% of men frequently committed sexual assault, they would eventually cause a lot of harm to a lot of women.

It doesn’t take 50% of men. Or even 20% of men. Even just 1% would be enough to cause harm to the entire female population.