i would give him some time to iron out his problems. i would also continue on with your life. he already told you he probably will never come back.
i've learned in my life time to never ignore what a man says. i got into a relationship with a guy who said he didnt want to be in a relationship. i didnt hold a gun to his head, but i did presue him, and the end result was disasterous.
don't allow him to come over when ever he wants, and call when ever he wants, he left, that means that's his lost. but dont sit around crossing your fingers for him to come back.
he said he wants to see a change in you, vs. 'lets work on us" i dont like those words. im sure it's something about him that you dont like.
i would move on.