Louis "Lepke" Buchalter (Murder Inc.) comes to mind. He was convicted of first degree murder, and he went to the chair for that. A lot of people were afraid he was going to testify to avoid the dead penalty, but he took his secrets to the grave.

The guy who testified against him, Abe Reles, later strangely 'fell' from a hotel balcony...