Yes, he knew it was Barzini who approached Carlo. That was not why he asked Carlo the question. His real reasoning was he wanted Carlo to admit setting Sonny up in front of witnesses (i.e. Hagen and others in the room). After all he was ging to kill COnnie's husband, and he had to have clear proof and a witnessed confession of guilt to avoid any possible rift in the family.