They even referenced that in the show. Paulie explains to Christopher that he was hanging on "by the skin of his balls in the seventies during the Colombo thing". Sirico knew that life. It's why he played a wiseguy so well in the show.