But, as Oli said, how could he know? He got in the boat with Anthony, and Neri certainly wouldn't have shot him with Anthony present.
He could have suspected it when Anthony was rushed of the boat and he was left with only Neri. But then again, Fredo wasn't that smart...