Fredo wasn't a genius but its not not like he was totally retarded as people make it seem. I mean he is in the mafia so he knows how it works plus he knows neri is Mike's top hitman. I think when he said "Shit" he knew it was over. also the way he said"Ok Al lets go" it was almost like he knew so he just wanted to get it over with