Usually connected means that he's doing business with some guys (even if he's not made, as an associate) or that he's connected to the LCN thru some family members.

In this case he was connected due to the fact that Old Man Baccilieri was his godfather, but other than that I doubt that he was involved in anything.