Slugs are gender neutral.....well slugs are hermaphrodites.....Close enough. Do I really want to have my passport reflect that I am in the same biological class as a slug? NO ******* WAY.
Besides; what country would allow you in without all the security and legal information on your passport, which includes sex? The Canadian Passport would not get you into many countries, if any.