your find, some guys just have big ball's it's normal,warm weather they will hang,if cold they will pull up,use some sort of supporting underwear as boxers will let your junk hang but still cause chaffing as they rub on your calves.I find good briefs that fit well offer some great support & some micro fiber blend ones are found in sporting goods stores or athletic apparel.
good luck no way can you down size god's gift blessed on you! be proud man and yes others will stare at you in the locker room but so what!and I have found some guys with blond or red hair will have this testicular type body with low body hair,
and sex no way will this affect your sex life totally fine.
Good luck!