I figured out part of my problem, I wasn't going after the shopkeepers well enough. Once I'd get them to the "payout" point I accepted and didn't go for any weak spot bonuses or anything. I brought one guy from 640 to 1450 by pressuring him more. Thats why I'm only at 32