Tom knew and I’m sure it haunted him. I think Tom decided to stick around if out of loyalty to Vito and Sonny. Tom basically said the Corleone Family is a shell of what it inceceas since Mike took over and became so cold hearted