Hi, and thanks for your medical question on eHealth forum!
Yes, vaginal bumps can be due to STDs like herpes, chancroid, syphilis, molluscum contagiosum, and venereal warts. The lumps could also be lipomas.They can even be Bartholin cysts.
The other possibilities are allergy to something that came in contact with this area like soap, powder, shaving blade, undergarments etc. It can also be a vaginal fungal infection, which does not itch initially. Simple bacterial infection, atopic dermatitis and some forms of eczema too can cause these symptoms.
It is difficult to comment beyond this without examining the lesions. Discuss these possibilities with your gynecologist. Get a STD panel done. Take care!