It's probably an ingrown hair or a sebaceous cyst (a pimple).
Couple of things may help. If you sit in some warm baths, or use hot wet washcloths as a compress...that may bring it to the surface where it will come to a head.
Or given enough time, it may just go away.
Jaz