Actually, the exterior shots for Woltz's estate were filmed at the old Guggenheim estate on Middleneck Road in Long Island. It's said that it was also F. Scott Fitgerald's inspiration for Jay Gatsby's estate (The Great Gatsby).