He isn't considered a goof, however he is associated with goofs (the calabrese family). He was never a real gangster to begin with, he was born into It. He's useless to the Outfit at this point.
A "goof" implies someone is a dolt of no consequence. When you have someone do your dirty work for 30 years, they flip and send everyone to prison for the rest of their lives, the dismissiveness rings hollow.
It's like the CEO of a car company calling the engineers he himself hired who have ruined the company "goofs."
Uh, no, you're the goof for hiring them.
