He was under Frankie Shots' crew. After Frankie was whacked he was supposed to get his crew as part of the deal but Old Man Profaci reneged on the deal which contributed to the war. I guess you could say he ran his own "rebel" crew during the war but as it wasn't recognized by the family as such than it isn't really official.

To put it briefly, Joe never got higher than soldier.