It's just they're so associated with the Mafia....
I've never seen an Italian man who wasn't affiliated with the Mafia, or didn't like to show off and act like they were connected, wear one. Nowadays or even 40, 50 years ago.

I look at my old family photos--all old school Italians---and the only guy I've ever seen wearing one was connected.

Now, I realize they were in the 30s and 40s as an upper class fashion statement (FDR wore one as did Bob Hope and others) but who are they associated with most today?