Here the answer

http://www.cigaraficionado.com/webfeatures/show/id/Pants-On-Fire_6080

 The movie of his life, if one ever gets written, would go like this: The film starts in black and white. Pantoliano is the narrator. He is smoking a cigar as he talks, on a terrace overlooking Beverly Hills.

"I love to talk about myself," he says, as the picture dissolves to the streets of Hoboken; the year, 1967. In the opening scene, Dominic "Monk" Pantoliano, Joe's father, leaves the family behind and heads for Florida. Joe is 14.

"My mother [Mary] was an interesting woman," Pantoliano begins the story. "My mom and dad, they were married for 20 years. My stepfather--my mother's third cousin, Florio Isabella--was doing a 15-year stretch in Atlanta Federal Penitentiary for drug trafficking. When he was released from Atlanta, he moved in with us and then my father moved to Florida." Drugs, Pantoliano says, were Florio's "family business," explaining that the man who would become his stepfather began his criminal career delivering heroin in lower Manhattan at the age of 10.

"The next thing I knew, my mom and Florio were lovers. And there were lots of fireworks." Pantoliano is speaking more slowly now, the emotion of the memories sinking in.

"There were fistfights in the streets of Hoboken between my father and my stepfather, and I was in the middle of it," he continues. "It was a mess. Ultimately, everybody made up and my father moved in with a woman in Jersey City. My mom died in 1982. My stepfather died in my father's arms, because they continued to be friends long after my mom was gone, and then my father died three months later, after my stepfather died."


 http://hudsonreporter.com/view/full_story/2406656/article-Famous-Hobokenites--Joe-Pantoliano-Scene-stealer--Joey-Pants--made-it-in-Hollywood--but-started-out-in-mile-square-city


 Pantoliano had two father figures in his life. There was Pantoliano's father, Dominic "Monk" Pantoliano, a factory worker with a fondness for gambling at the track. According to Pantoliano's autobiography, his father would later become a hearse chauffeur for the local funeral parlor.

Then there was his stepfather, Florio Isabella, a wise guy with connections to the Genovese family. In total, Isabella, who was also Pantoliano's distant cousin, spent 21 years in prison for drug trafficking.

According to Pantoliano, his stepfather began his criminal career delivering heroin in lower Manhattan at the age of 10.

Pantoliano was 14 when Isabella got out of prison, and the teen's mother kicked Monk out of the house.

Pantoliano recalls in great detail the fistfights between his father and stepfather, many of which caught him in the middle. But the relationship between Monk and Isabella was much more complicated than just street fights. While the two battled for the affection of Mary, the pair were also close friends. According to Pantoliano, his stepfather died in his father's arms.

His mom was also a bookie.