I recently learned in my Abnormal Psychology course that having a vigorous workout routine can help lead to panic attacks.
Needless to say, my 1.5 hour a day 6 day a week routine got cut in half.
I think it has something to do with the way lots of exercise changes the hormones in your body.
So if you're a gym rat and have panic attacks, it's possible a change in your routine may be a factor.
However, don't think because you quit working out your panic attacks will leave you.