Following the famous Mob convention in Atlantic City in 1929, Al Capone decided it would be healthy for him to take a powder for a while. He arranged to be arrested in Philadelphia for carrying a concealed weapon. He served a year in a Pa. prison while things settled down.
Bonanno claimed that he was kidnapped by his cousin, Stefano Magaddino, because he refused a Commission invitation to explain his role in a plot against Carlo Gambino and Tommy Lucchese. Others believe he faked the kidnapping so he could avoid several federal indictments against him. What you're probably thinking of: he came out of hiding by suddenly appearing before a federal judge in NYC, saying: "My name is Joseph Bonanno. I understand you want to ask me some questions." By that time, the disloyal elements in his family were in chaos.

New question: What was mobster Joe Adonis's real name?