I've spent the past couple years researching this, and fixing the problem, so I'd like to offer some advice...
The solution is to follow the Paleo or Primal Diet, which is to eat a lower carb, higher fat, moderate protein diet. You'll also eliminate grains and other processed carbs when eating Paleo/Primal.
You can find many sites on the internet, and many books available to teach you the proper way to eat.
These sites and books will also explain the science behind your blood sugar & insulin problems.
Based on what you wrote, I'd make the following suggestions...
Don't eat yogurt - it is one of the most insulinogenic foods there is. It spikes your insulin, even though it is low on the glycemic index and doesn't raise your blood sugar. Milk is even worse. Google "Insulin Index" to learn more about this. It's safe to eat butter and heavy cream, but stay away from other dairy products.
Caffeine is also bad news for hypoglycemic people like us. Even tea, which has a relatively small amount of caffeine, can be a problem. It causes a cascade of stress hormones to be released, which will throw your blood sugar out of whack.
For me, fruit is also a big problem, especially if I don't eat it with lots of fat. The only fruit I eat is a small serving of berries, covered in heavy cream. The reason this is problem, is the fruit triggers an insulin release, even though it doesn't really raise your blood sugar much. The result, is that your blood sugar drops.
With every meal, you should eat mostly fat, with a little protein, and a little carb. Never eat carbs alone.
Read those websites and buy the books by Mark Sisson and Robb Wolf...the dietary changes can be difficult, but they changed my life! I no longer suffer with hypoglycemia and blood sugar issues
Finally, you need to get exercise, at least every other day. And it should preferably be weight training, as opposed to cardio. This will help deplete your glycogen stores, and make your muscles and liver more insulin sensitive, which is a huge factor in fixing your blood sugar issues. I can't stress this enough. The root cause of hypoglycemia & blood sugar problems, is insulin resistance. Exercise will help reverse this problem.