I think things changed when the dons were heavily into drug dealing and trafficking, and it was no secret. 4 of the 5 families had high profile bosses heavily involved with drugs.

Both John Gotti and Sammy the Bull were deeply involved with drugs.

Carmine Galante was powerful enough to talk about becoming boss of bosses.

Gaspipe Casso made a fortune with drugs- he owned a fleet of trawlers and a jet airliner to move product. Roy DeMeo and Sammy Gravano were two of his biggest clients.

While the above guys made money dealing drugs in the 70's, Vito Genovese's drug history in prior decades was probably well known among LCN.

You shit-kicking, stinky, horse-manure-smelling motherfucker you! If you ever get out of line over there again, I'll smash your fucking head so hard you won't be able to get that cowboy hat on. You hear me? Fucking hick. -Nicky (Casino)