Tom was only book smart. He didn't have the instinct to protect the family. Michael lost faith in Tom for those reasons and only consulted him when it comes to clean up work.