I'll join those saying Signor Roberto's scene is the funniest, but I'll add two more:

Young Clemenza and Vito walking down the street with the stolen rug always cracks me up.

Mike telling Johnny Fontaine (in Part III) that he's going into the kitchen to listen to some Tony Bennett records.