First off, congratulations on your new baby girl!
I can truly understand your situation. My husband and I have had similar problems. I know this is easier for me to say then for you to do but maybe you should file for a legal separation before you file for a divorce. That's what I've done just recently with my husband. I think it would allow yourself, and your husband, a needed break from one another. A time for the both of you to be separated so that you each can think about what you truly want out of your relationship and for your precious new baby.
It will also give you time to set goals for your marriage, your baby and YOURSELF. I let my husband walk all over me for three years and gave excuses for his alcoholism and abuse constantly. I allowed myself to become depressed and learned to not like myself because my husband's actions and words. Please consider at least filing for a separation. You need to find "yourself" again, find what makes you happy and ultimately, find what will make life easier for the both of you. Whether with or without him you can raise your daughter to be a wonderful adult. I think you already know this. I have to say that even though I don't know you, I have faith in you that you'll be able to make it through. I hope I was able to help you.