Vincent and Pesci grew up around them or near them so they knew them. I don't think Pacino and Deniro really hung out with them. Both of them are more arty, bohemian types. Caan is from the Bronx so maybe he knew them growing up, not sure.