In the movie, Mike picks up his coat on the way out. Can't really see the hat, but it could easily be under the coat. He doesn't put it on when he gets to the street.

I think Puzo picked up some hat lore and put it in Clemenza's mouth, and then just forgot that it really wouldn't work if Mike was sitting down to dinner with an experienced gangster.