I was talking about a similar thing with a co-worker of mine recently. Let me see if I can say this succinctly...
In the earlier history of humans people paired up based on how good a provider that man (or that woman)was. A man who wanted a good wife needed to be a good hunter and protector. Conversely a woman needed to be healthy (often fat - indicating that she had enough to eat) and able to bear many children.
Now that we live in a culture of pre-prepared meals and fertility clinics these things seem less important. But think again. In this media driven society it has been proven time and time again that an "attractive" person is far more likely to get an offered job than an "unattractive" person with the exact same credentials. So, the way your get ahead in this society and become successful is by looking good (among other things, but that plays a large part).
So, thinking about the biological drive to find a good provider and protector (healthy and fertile wife) and combining both to make a successful person by todays standards, might it make sense that we would have an attraction to that very handsome individual because we know they are more likely to be successful and we will be provided for.

Just a thought I have been kicking around.