If I remember right even Vito mentioned (could be thinking someone else) that the family was way stronger than most on the street thought due to the way Vito was real quiet about his business and how he conducted it. No way Tattaglia would have handled them and I'm not even sure Barzini would have taken over that easily.