Those guys used to run like massive thiefdoms where police could in many cases be openly corrupt walking in and out of known mafia establishments. Gambino and Capone could get away with having armed bodyguards many with likely criminal records and because of the environment they could get away with it. Frank Cali had two choices either ride around with armed criminals or hire professional security which probably wouldnt have worked in his line of work.