Tony talks about John Gotti and Gravano early on in the series. So they do exist but they are never included in the series.

Why is this? It makes no sense.

In the imaginary world of the Sopranos, did the Gambino family become defunct before the series started in 1999? Or did they just go by a different name in the series?