This should be checked by your physician for a case of chronic mastitis.
Mastitis is a breast inflammation, usually, caused by bacteria and mainly happens in breastfeeding women.
In most of the cases is a short-lived condition, but, rarely it can progress to a chronic one.

See your physician (some more serious bacteria can reach this part of the body and the antibiotic treatment will be needed to resolve this condition).