I wouldn't say Neri was an unknown either. Neri and Rocco were acting as skippers in the novel (if my old mind remembers right) but were acting secretly until Tom noticed it before their move to Nevada. Then once he got a piece of the casino he definitely had to be known to the underworld.

As for a boss who knows? He had a ton of Corleone trust, that's for sure.