That's the urban legend. But the same urban legend also went one step further and claimed that he never left Manhattan, which is ridiculous. Because he used to spend plenty of time at his house in Old Tappan.

But it's all true enough in spirit, if not actual fact. Because Sullivan Street was his whole world.