As a man, can confirm that this is definitely a thing.

It's tricky though. In the past, I've been with a woman who I'd initially considered "fuck-zone" material, but then she gradually grew on me the more time I spent with her and eventually became relationship material.