From what I can remember I think he was extorted and went bankrupt/maybe jail cause of the outfit.

Tommy Shots: They want me running the family, don't they know I have a young wife?
Sal Vitale: (laughs) Tommy, jump in, the water's fine.