I would think so. It would also appear that he was somewhat well known to at least some of the public as a John Gotti-esque type. Like he had been on tv enough where civilians recognized him. The male shrink he went to see who told him he couldn't treat him because "I watch tv. I know who you are." Elliot knew who Tony was when Melfi was treating him too. (apparently he didn't recognize him in the parking garage though for some reason)