First of all make sure you arent stimulating your nipples at all. Face away from the shower and dont let your boyfriend/husband mess with them for now. My ob doc gave me this advice- put cabbage leaves on your breasts-and bind them with a towel over that and then tape- tightly- you may need someone to help you and leave it on as much as possible. They should dry up with in a week.
Your doctor can give you medication to dry them up but like my doc told me they advise people to try this route first because it takes about the same amount of time for either to do the trick.
Good luck!!