According to Google:
A male (♂) organism is the physiological sex that produces sperm. Each spermatozoon can fuse with a larger female gamete, or ovum, in the process of fertilization. A male cannot reproduce sexually without access to at least one ovum from a female, but some organisms can reproduce both sexually and asexually.
So if a person cannot produce sperm are they still male?
Notice the definition doesn't say "of the physiological sex" it says "is the physiological sex."