Exactly. As I've said in the past, he's just a petty thief at heart. Two episodes that always come to mind with Paulie :

The one where they were looking for AJ'a teacher's car, when Paulie loses his mind in the coffee shop screaming " We invented this stuff" and then robbing the coffee pot from the store. The other is when he takes his mom and her friend out to eat, and then makes his mom's friend pay her own way and when she goes to take the rolls home, he gives her this mean look and says : Those are ma's rolls!"

He f**king kills me!