I know a few people who wear baseball caps and various other sorts of hats. None of these folks have any hair. I always figured there was a connection.
Seriously, wouldn't anyone and everyone be embarrassed if they had no (or very little) hair? How can that not be the reason?