starfoxen,
I can relate, somewhat to your plight as I broke my right foot about 5 years ago (actually snapped the fifth metatarcil at the top end near my baby toe) and I had to wear a boot-cast for a month.
As with you, it restricted my movements immensely because I was limited to the amount of walking I could do and being a fit person who goes to the gym at least 5 times a week and walks as much as possible, this was a serious blow to my lifestyle and regimen. Let's face it - "it sucked bigtime".
I initially had some anxiety (perhaps not quite panic) about the fact that this was the first bone I had ever broke and it made me feel like I was not perfect anymore or that my body was somehow 'damaged goods'. But, I spent a lot of time researching this situation on the internet and found that the best thing for resolving the anxiety was to work constructively on the healing process. Let's face it - the sooner you heal, the sooner the cast comes off, the sooner you get to use your whole body again. So I looked at all the right things to do, for instance for broken bones you should have a calcium enriched diet (perhaps take calcium suppliments), keep the bodypart as immobile as possible as the body requires a motionless environment for the natural bone re-attachment process to occur.
Lastly, it is said that a healed bone is actually stonger than it was originally, although, I'm not sure of this I know that my foot has been great ever since. The cast did come off after 4 weeks.
So bottom line - 1) do some research on the net (an informed person is a better person); 2) use the knowledge you acquire to help speed up the healing; 3) realize that your positive steps will provide a more constructive use of your energy than worrying will ever do.
I hope this helps,
Wendy