I think it went beyond mere disappointment. I think Vito was angry at Sonny for his involvement with her. He makes his displeasure apparent, and when he's angry at Sonny for the slip-up during the Sollozzo meeting, he even reprimands him in front of others. I'm sure that Vito wouldn't have normally done that to his heir apparent unless he was already pretty angry at Sonny.