I read a long, long time ago in some book/article (can't remember) that the Outfit was actually glad to see him go. Apparently they sent him an xmas card in prison with $1 in it and it said "from your old friends." As I said, I don't remember which book/article I saw it in but it could be absolute BS.