It's kind of a gray area as addresses aren't legally protected; you can look up voter information and find someone's address. Google Maps is public domain and not private. It really gets down to whether or not you think it's morally, as opposed to legally, acceptable.

I personally don't have a problem with it but I can understand those that do.