It's so weird the fact that everyone loves this but when the gender switches people thinks is the worst thing in the world.
Cognitive dissonance is gr8, yo.
...though the latter being the starting point of circa 3.8 billion H-doujins, most of which are some combination of totally disposable and degrees of creepy af, as well as much too many RL cases may also have something to do with it...