He has to deal with his workers that is how he related to them. When he is not around them he doesn't.