I have a similar reaction to people who are unaesthetic in one way or another. I have no objection to using as my subjects, people who are relatively unattractive as long as they are interesting / character filled for some reason. But I am very often reluctant to take shots when some obese, badly dressed, tattoo covered, really repulsive looking low grade person (more often as not who, as you say is wearing some sh#tty T shirt with revolting logos) wanders into frame. And believe me, my world is full of them. I think this is one reason why perhaps 2/3 of my "people photos" are of women - not necessarily because they are women as such, but more because I find that on average, women tend to dress better and comport themselves better than many men I see in the streets (at least here in Australia). Any guy with a beer gut, in baggy shorts, an ill fitting T shirt and flip flops need not apply! 😛