Also, Fredo had some difficulty getting the suitcase back from that 'hotel employee'. It could be that the Cubans had already intended to switch the suitcases, or make it accidentally disappear if Fredo would've handed it over.
"It was between the brothers Kay -- I had nothing to do with it."