In the novel is is said that Fredo was in such a shock he was in no way capable of being part of those discussions. So that's probably the reason he isn't present in the movie either.

"It was between the brothers Kay -- I had nothing to do with it."