If Michael knew, well before the "oily hair/silk suit" session, that Geary was a regular in Fredo's brothel, he'd have tucked that factoid away for further action. So, when Geary insulted him and made his greedy demand, Michael didn't need to hesitate--he already had his action plan laid out.