Yeah, it's because of low self-esteem. I've been there, back in the day. Automatically assumed I had misinterpreted any flirting signals, even ones that were blatantly obvious.

Nowadays I just assume that women are flirting, and deal with the consequences if they're not. Much better strategy.