Bulger was on the streets from 1965 until he went on the run in 1995, of course the FBI enabled this run to an extent.

Like others have mentioned Carlo Gambino and Trafficante sr never went to prison for anything. Tony Accardo is another who never did time.