“There are some men who are consoled by the idea that there are women less attractive than their wives; and others who are haunted by the knowledge that there are more attractive.”