blisters last about 5 days and just disappear?

I had a blood test 10 years ago that showed I had HSV2 antibodies. I had never had the major "initial outbreak" you read about, but had the test because a former partner told me he had herpes. For years I never had any symptoms. Over the past year, I occasionally (approx. every 3 months) get itchy and/or painful red bumps on my vagina (inner labia) or near my anus. There's almost always only one bump - usually just red and slightly raised - but never looks like the "classic" herpes blisters and never appear in clusters - they also never break open, scab or crust. They last about 5 days and just disappear on their own. Occasionally during the first couple of days I have slight nerve pain down the back of my thigh. The only change in the past year was that I began taking the BC pill, Yaz. Could this be a factor? I am on Vatrex daily to help in not spreading the virus to my partner. It doesn't seem to help prevent or clear up these "episodes". Is this herpes? If so, how do I stop OBs?