I don't think he knows with certainty, I just think he knows that Barzini works through discontented people close to his targets while appearing innocent himself. I think Barzini is supposed to be overconfident because he assumes Vito is past his prime and Michael is not an experienced leader.

"All of these men were good listeners; patient men."