I think I would first see if you can heal the jaw better than it sounds right now before having the wisdom teeth pulled, but since they're impacted, you're probably going to have to do it. To me it sounds like your jaw has not yet completely healed from when you yawned. We're talking muscles, ligaments and cartilage and that can take time. Be as gentle to your jaw as you can for another month or so.
Eating, smoking and talking will tire and irritate the injured jaw during the day and that's probably why you have more pain as the day goes on. Try talking less (use a sign that tells people your jaw is sprained.

Also, make sure not to clench. The basic rule is to keep you teeth apart at all times, tongue resting on roof of mouth and lips together or slightly apart, relaxed. Be careful what you eat - softer foods and/or liquids are a must.
Ask your doctor or dentist to give you a referral for physical therapy or find a good massage therapist (cranial-sacral, pressure point, deep tissue, etc.) If you can, find one who does intra-oral massage. This can be wonderful - painful when done but it should last only for a few minutes anyway.
I would have used ice to reduce the swelling, but moist heat is a wonderful thing too. You might add Super Vitamin B Complex to your daily diet for healing.
And lastly, watch your posture. How you hold your neck, jaw and head doing certain activities can greatly affect the ligaments and muscles of the jaw. Stretched jaw ligaments if becoming more and more of a problem. When sitting in front of a computer or desk, do NOT slump your head forward towards the monitor or pull your chin up to see.
Give yourself more time to heal. Go see another OS for a 2nd opinion or even get a 3rd (the money IS worth it). If you decide to get the teeth removed after more healing, do some exercises first to get your jaw/mouth into shape (You-Tube has a good video if you type in TMJ) and then make sure that the OS knows you just had a TMJ episode and will be particularly gentle when cutting out the teeth and not keep your mouth open too wide too long.
Let us know how you do.
God bless...
Carol