If it makes you feel any better...
I'm 36, 5' and 0.75 inches tall. (not quite 5'1)
I started a company when I was 26 and 10 years later it's pretty grown and my salary is over $200,000 per year.
I have dated and have had relationships with very pretty, smart, just plain out good looking and wonderful woman. This still continues and in fact, my quantity of attractive woman that I attract continues to go up as I become more and more refined and intelligent about how to approach people in general.
I work out 5 days a week and I have all my clothes tailored. Height has been one of those things about myself that I would think "darn, would be nice to be taller", HOWEVER, height has not prevented me from doing anything. Okay...yes, it prevented my professional sports career, but I can live with that.
My business continues to thrive because the client is listening to what I say about our services and product line. I am confident in what I say because I believe in what I'm talking about. Hence, my height has nothing to do with whether or not I bring value to others. That's business... bringing value to others and it has nothing to do with height.
Point of all this is that your height doesn't define your worth and neither does another person. With nearly 7 Billion people on this planet, there are millions of woman and men that are more than happy to give you a shot. Just show them what you're worth. You have too much going for, including your height. Perspective is everything.
You can do it, man.