There’s a lot of truth to it. Attractiveness is only one of four traits that make a guy attractive to women. It’s the least important one but it is the most visible one.
I’ve written a post about attractiveness in males, you can read it here.
Driving more happiness into your relationships boils down to your emotional maturity. If you fly off the handle if a girl were to tell you about an old boyfriend, you’re not mature and a girl will have to try really hard to want to spend time with you.