Sonny also describes him as looking "like he got plugged worse than the old man" and Michael is said to have remembered him as being the toughest (physically) of the boys when they were kids. So, obviously, it affected him greatly.