I always figured that Johnny Boy was a popular soldier (early on, when we see him and Junior collecting and enforcing their own debts and shit) under an unspecified (i think) capo, though he later becomes a capo. He's supposed to have been a favourite of the "Old Man", later imprisoned boss Ercoli DeMeo.