No one, and that means absolutely anyone under absolutely any conditions, has the right to do anything they please based merely on intuition, feeling, or physical or psychological makeup. They may not be able to help what they do if and when a genuinely physical ailment or other explicable impediment is involved, yet even then we do what we can to help them learn to do the right thing, because even their genuine ailments or unfortunate conditions cannot justify their actions. It can only mean, at most, they are not morally culpable for what they do.
But most of us are. As such, we can choose what we should or should not do as we get along in our lives. We make decisions, and it is up to us to be rational about them. Indeed we have a duty to act rationally so far as we can, and we must be willing to face the consequences of what we do as well. But if we are to be rational, we must admit that we have a basic, general control over what we do. Why? Because one of the things which most of us are indeed born with is the capacity for intellectual considerations. We have free will.
A properly developed intellect will tell us that we simply cannot do things just because we have a desire to do them. This includes doing the things we like to do which are not wrong in themselves. If you are inclined to play baseball, you may play it. But not because you're born with an affinity for sports and games; rather, because it is not wrong to play baseball. Even then, it can be wrong, according to circumstance, to play it. If you're supposed to be at work or doing your chores, then you can't play because more important obligations trump the desire.
If you cannot accept that, well, so be it. But you had also better not disdain conservatives supporting conservatism. Because, of course, they're just born that way.