Hi there! If you do not want him back then don't take him back, you do have a choice, if you feel that he mght hurt you or the baby then get a restaining order against him and notify your friends and neighbors. If you do want him back then take him back but put your foot down and please don't get yourself stressed out about it as it is not good on your pregnancy and remember that we are here for you!
All of the best to you and the baby!