It is often heard, from women who support birth control, that they don't see where a celibate clergyman ought to be judge to the issue because they can't really understand woman's rights. Yet those same women won't denounce a celibate clergyman who agrees with them on the grounds they're men.
Similarly, they say that men shouldn't legislate about banning abortion, because they can't really understand what that might mean to women. But they don't hold the same point with male lawmakers who vote for abortion rights, even though they presumably can't understand woman's needs either. Indeed, whenever a man supports a so-called woman's right in a way which women (or, should we say, liberal women) like, he is not condemned. But why should male affirmation mean any more than male denial if men cannot possibly understand a woman's position?
Two things come up here. One is that it is arrogant to assert that men cannot understand a woman's rights merely because they're men. Women sure don't mind respecting a man's opinion if it coincides with theirs; dismissing male opinion as automatically wrongheaded if it disagrees with any given woman's is, simply, hubris.
Two, it is more likely that someone not directly involved in an issue would be more readily impartial than someone who wants a certain outcome. We have umpires and referees in sports precisely because, although they may not be the actual players, they are expected and indeed are more likely to be impartial than the players. An umpire says safe or out independent of the player, who would more likely rule his own way given the chance.
This isn't to say that all umpires are right and all players wrong each and every time. But it is to say that objective right is something anyone can grasp if they want it. Whether the rule maker or opinion giver is male or female means nothing to right and wrong about anyone or anything.