Not according to what he told Diana Sawyer. What he said roughly aligned with this:

http://articles.latimes.com/1994-06-05/news/mn-574_1_gravano-sammy-bull-family-boss/2

If you watch the interview there is a point where she basically prods him on how little he was making and he shrugs and says "It was enough for me" and talks about how he owned an office building.

I'm sure the guy made a decent amount of money; I am just saying that he was basically the second most powerful gangster in the entire country, at a time when the mob was doing a lot better than it is today.