The inuit is entitled to his opinions, and just because you don;t find someone physically appealing doesn't mean you are a racist, it's just a matter of personal taste and what you are used to.
My ex wife is a very level wonderful woman who bears no sort of discriminatory thoughts in her head about anyone, yet she doesn't find most black guys PHYSICALLY appealing as partners, nor men with hort hair, nor very short men, yet one of her closest friends is about 5'3, male, black and shaven headed.
The comment means absolutely nothing and you need to get out more:)