Controlling boyfriend

I don't know what to do. I feel like the worst mother ever! I need some advice from strangers. I thought I met the perfect man. I introduced him to my kids and they were drawn to him instantly. It just seemed so perfect. He eventually moved in with us. My kids adore him. My twelve year old son enjoys spending time with him. He is absolutely fantastic with my kids. And then there's our relationship. Nobody can see that he tells me who I can talk to, and who I can't. He tells me what I can where and what I can't. We have vicious fights because he is convinced that I'm wearing lipstick because there's someone at work I'm trying to impress or that I've looked at another man while we're in public or that other men look at me because I've somehow given them the idea that I'm interested. He criticizes me often. The rest of the world thinks he is amazing. I'm the only one that gets to see his ugly side. He takes all of his stress and frustrations out on me. I've tried to make the relationship work but he is smothering me and no matter how often I try to talk to him and reason with him, he just seems so irrational. I've lost all contact with my friends, I barely spend time with my mother who I am extremely close to. I can't even take my girls to get our nails done together without getting a text from him every 5 minutes asking why it is taking so long. I don't know what to do but I can't live like this. It is so unhealthy and I find myself stressed out and almost to the point of panic and the possibility of setting him off. So the big question is... Will my kids be hurt beyond repair if the relationship ends? They've already been through a divorce and now this.