My theory that his last straw was when he saw the newspaper off screen when Vito was killed. Remember, Vito's kids saw the article about their father's murder. I think he did too, he felt very guilty about it and decided to break off