My ex boss wants me to work part time for him?

my problem is that in the meantime I got another offer from someone I know and trust and with better pay. I dont want to let my ex boss down but I cant do a full time job, a part time and another part time. any suggestions how I can tell hm that I cant go for it without insulting him?