No confidence because of big nose.?

I have little confidence because I think my nose is kind of big. But should I? When I was in 6th grade we had cl polls and I got best looking and in high school I was voted beauty brawns and brains. Many, many girls have liked me over my life, but I am just concerned because my nose is a bit big. No one ever says anything about it, but I will go to parties with my friends and they will have girls swooning over them and I get nothing. I hope that ot is because I have little confidence but at least I can change that, but my nose I cannot. So is this dread I have really dumbfounded? Should I worry about my nose?