Wow that sounds like a really tough situation. I'm sorry that you and your daughter are both being subjected to his drug addiction, no one should ever have to deal with that.
I cannot offer much advice because I don't know the full situation here, but I do feel for you and I will be praying for you. One piece of advice that I have heard many times and would like to share with you is to never be ashamed of your anxiety. You are not alone, millions of people suffer from anxiety day in and day out just as you do, so do not think of yourself as some sort of outcast that could not find anyone else to love them. You're obviously a very caring person. If you're in a destructive relationship, and it sounds like you are, and you think that getting out would help your anxiety, you should do it. If there is anyone you can turn to that would make you feel safe, parents, friends, anyone, I would suggest doing that. It seems logical to me that if you can find a cause of your anxiety, you need to shut it off or control it, and this seems to be one way. Maybe try talking to him about it or finding some sort of counseling. If he loves you, he won't like the fact that something that he is doing is causing you so much pain, and if he doesn't care, then he is not worth it.
Good luck! I hope things get better for you soon.