Maybe they were just going on whatever information they could actually confirm?

Then again, Fredo as an underboss is definitely an assumption. If they had any real knowledge of the Corleone family top levels, they probably would have left Fredo off almost entirely.

If they were trying to go back to the old NY regime, I'm sure each of those men had men working for them as well.