He's just not cut out for it. He's a spoiled rich kid suburbanite.
If he had been raised in Elizabeth or Newark proper it might be different.

Tony was likely too affluent and he is a part of the self-involved generation. Also he's not that bright and overly emotional, which likely adds to the problem.

Sons are spoiled, daughters gotta earn it haha