Male here.
I hate how easily black attracts fingerprints whether glossy plastic, glass, or matte. That is why I never went with the black HTC One M7 which looked great in pictures but was smudge prone in person.
Still, I will go with black Z3. And if I get the Z3C for the wife, she will get it in white. I wanted a red Asus Zenfone 5 but now find only red colored phones carried by females. I do find red more unisex. And I used to think gold iPhone 5s was great. Now I'm sick of that color combination as it seems catered mostly to females too.
Generally black or silver for now on.