Remember, there was an episode of the AGS where some gangsters moved into Floyd's shop to take bets on horses. And the episode where Barney yelled out "We defy the Mafia."
There was also the memorable SNL skit when Ron Howard hosted about how Mayberry beame a den of inequity after he left town. I believe in that one Aunt Bea became a Madam, etc. The idea of Andy and the mob though is an intriguing idea.