As soon as Neri smacked Klingman in the head, you can see them look away, as if to say " we didn't see anything " and when Klingman and Neri start walking they take a couple of steps back and don't want to even appear to get involved. That sends a message that they knew who Neri was and the only one who didn't have a clue was Klingman.