I'd quit. But before I did that, Id give him a peace of my mind. If he said "I'm sorry!" he didnt really mean it. He just wants you to work at his store, or whatever. If he wants to play hard ball, then you can play it too.
If you can get all of your coworkers to veryify what he said in writing you can take it to management above him. If you can not get them to put it in writing, then you may want to quit.