Paul’s loyalists were mostly the guys who visited him almost weekly at his mansion ie Tommy Gambino, Joe Butch (although he was smart enough to buddy buddy with Gotti), Jimmy Brown. Paul mostly only invited those who were making money for him/ other than that he wouldn’t see u much.
That's one of the main reasons Gotti was able to have Castellano whacked without serious opposition inside the Gambino family. Big Paul kept himself aloof from his troops, never going to the streets to shmooze with them, only communing with a select few people he invited to his mansion.