Yes, it's rumored that they lost all of Siegel's money at the hotels where they bedded down for the night.

Siegel reopened the Flamingo that spring and it began to make money. But by then he'd sold thousands of points in the hotel. He made too many enemies to live.