Tony Spilotro, who Joe Pesci's character was based, was an enforcer for the Chicago mob before they sent him out to Las Vegas. Frank Rosenthal ("Ace") started out as a clerk and bookie.. also out of Chicago. So when they say, "Back home years ago" I believe they are referring to Chicago.