The thing I noticed was that when my ex talked about the men he'd known his skin went all pink and sweaty, he looked emotional.  I'd never seen him like that before, he was not like that with me.

I think he distrusts men too.