I reckon he did know. Said it before and I'll say it again. The "lets go" bit to Al reminded me of Tessio in the first one, he knew he'd been caught and he left quietly. I like to view it as Fredo's one noble act