Calm down. Using a male condom during sex can decrease the sensations felt. Allergic reactions to latex would most likely give you rashes and pain, not numbness. There are also latex-free male condoms, as well as female condoms. If you don't have a rash, try using a ribbed condom, or condoms that are thin. Don't worry, nothing is wrong with you. You just have to switch condoms.