I think he served some time, which in all amounted to about 20 months only (have read it in the New York Times article about Gambino's death I think). They all have been in jail at least for a short time on a certain points in their careers, even Lucchese served time for auto theft. Tony Accardo is the only exception I think.
Willie Marfeo to Henry Tameleo:
1) "You people want a loaf of bread and you throw the crumbs back. Well, fuck you. I ain't closing down."
2) "Get out of here, old man. Go tell Raymond to go shit in his hat. We're not giving you anything."