When Mike told Tom that he was in charge, he said that he would be in charge of Fredo and his men..,

"I'm gonna leave here tonight. I give you complete power, TOM -- over FREDO and his men, ROCCO, NERI, everyone"

My theory is that Fredo used his men to botched everything up.........,