Was I right to expect to be treated better?

My husband accused me of going out with another man the other day when I was actually sick and sleeping. He claimed he tracked my phone and it said it was somewhere other than our house, which I know is a lie because my phone was laying right next to me on the bed. He refused to apologize when he found out the truth and so I refused to talk to him. He then called me up the next day and as soon as I answered the phone he started screaming at me about some transaction made on HIS card that I have no access to. So I screamed right back and told him that if he expects to be treated with respect then he better learn to treat me the same way and I told him I was tired of the one way philosophy he seemed to view things. He then accused me of being with some other man and choosing my friends over him and on and on and on. I have put up with a lot of his crap this past year, he cheated on me with atleast 3 different women that I know of, moved in with one of them, completely drained our money, turned his back on our 2 month old daughter, this list could go on forever! I dont believe in jumping into a divorce so I tried to make it work but it seems like every time I turn around he is talking down to me, belittling me, and being just a horrible husband. He hasnt called in 3 days (he is gone on buisness 3 weeks a month) to ask about his daughter or me and when I asked him today why, he just said because I dont want him. He is refusing to answer my calls and when I asked him if its over he wont respond...idk what to do. I'm an adult with 3 children to raise, I dont need to be playing middle school games with the man that is supposed to be my husband. Help me please!