It sounds as if you are experiencing uvulitis. Uvulitis is an inflammation of the uvula, the small tongue-shaped piece of tissue that hangs from the top of the back part of the mouth.
Watchful monitoring of the airway is recommended. Along with appropriate antibiotics and steroids, patients with acute uvulitis are recommended to have a lateral radiograph of the neck performed to rule out acute epiglottitis.