Hi,
i've no medical background, so I can't say for sure that they are linked. However, I have had seizures, as well as what I now know were anxiety/panic attacks. All of a sudden I would feel sort of out of it, in a panic, my heart would race and would feel frazzled. Like you, the panic I felt and other symptoms, felt similar to that of an aura before a seizure. And as you suggested, knowing that only made the anxiety worse.
I've read that migraines and epilepsy are linked, so it wouldn't come as a surprise if anxiety and epilepsy were linked. I know for me, several years ago I suffered from post partum depression and that brought on a seizure. Anxiety (and depression) are stress causing which for me is always something that contributes to a seizure developing.
As was sugggested by someone else, talk to your doctor. From what you describe it sounds a lot like what I have gone through and i'm certain that both my seizures and anxiety provoke the other.
Kathy