I'd disagree that white people can really be fetishized, or that it's the same if someone prefers white people. White people are viewed as the default, as the standard for femininity and masculinity. Colonialism forces whiteness as the beauty standard for all people. So it's not really fetishizing, it's being amongst the norm for the most part. Women and men of color are never viewed as visions of perfection when white people want them, just special exotic objects.