He was respected as boss but not much before that. Most of the big shots died or went to prison during the early 70's so he was the only choice and was also backed up by Accardo and Alex.And even with all of the enormous heat he remained as boss for quite long period