yea thats what i thought at first...but think about the way he says
The only thing that gives orders is balls.
if he meant frank had no balls i dont think he woulda stated it like that