I think he would have, but constantly try to get Sollozzo afterward. Like he would constantly be operating behind the scenes to try and get revenge while pretending to have forgiven. Which would have caused more issues with the Five Families if he succeeded.