I think Carfano's loyalty was with Frank Costello, and he was bitter about his downfall. I can imagine he hated Vito Genovese.