Certainly. When you tower over another man, and are the superior physical specimen, how do you not feel superior? Maybe you don't get that satisfaction all the time, or it's only conscious some of the time, but it still applies and it still happens at least occasionally when it happens. It's not fair, it's not just, it's simply primal and instinctual. You know you are an ahole for feeling superior to the ugly short guy but those feelings come anyway. It's like feeling attracted to the pretty dumb girl versus the bookish, acne faced girl with A cups. It's simply primal and ingrained. Just look at all the competitions between the males of different species for mating rights, territory, etc. Look at all the animals with signals for physical supremacy like antlers/plumes/etc.
Now, extrapolate this to the life of tall, handsome men. A life of towering and being just physically better than other males. Of course most of them probably feel superior to other men (who are shorter/uglier than them) quite frequently.