^ Last time I checked gems weren't sentient beings either. And since everyone(tm) walks around saying gender is a social construct, it seems insidious to suddenly argue with biology (or mineralogy ^^) - it's perfectly plausible that they would have developed some sort of gender structure for themselves.
Of course, they apparently didn't. But just saying. ^^