Joe is indeed the leader of the group that was in the house where rick was hiding. One of them saw Rick before he passes out from being choked by one of them when they were fighting over the bed. They want revenge as they know Rick killed one of their own, the guy who was in the bathroom and he didn't attack the brain of that guy. Joe was saying how the guy turned into a walker.