He's just not cut out for it. He's a spoiled rich kid suburbanite. If he had been raised in Elizabeth or Newark proper it might be different.
Tony was likely too affluent and he is a part of the self-involved generation. Also he's not that bright and overly emotional, which likely adds to the problem.