It sounds like YOU were uncomfortable with the relationship and were looking for reasons to end it. The only thing that matters in a relationship between two adults is how you feel.
My better half is a short, pale freckle faced redhead and I'm a big, bald black man and we get stared at all the time when we're together, but we could care less. She's had and still has some health challenges and as a result has put on a lot of weight. She even jokes and calls herself my chunky monkey, but I'm not going anywhere. She's who I love and I'm who she loves. We make each other happy and we accept each other for who we are. Once you get to that point and stop second guessing things, you'll be happy in your relationships.