I think, technically it's a little like Woltz' horse: For Woltz it was just unthinkable that somebody could act so arrogantly and brutally. Also, now he knew there was "no place where he could hang his hat" without some Corleone gangster around. They could kill him and if they would, they would do it with o mercy at all.