Woltz, the novel states that Michael must have been scared, but yet he was calm enough to ignore Clemenza's instructions to come out blasting because he reasoned that that was not appropriate to the situation.

I think that if the gun wasn't there, Michael would have continued his conversation with Sollozzo, feigned agreement, and then the Corleones would have tried to arrange another meeting or just gone after Sollozzo otherwise.