I believe the "They're all looking to rob me blind 24 hours a day" line was Ace to Phillip Green. Anywho the answer to Irishman's is Ace narrating about that kid at the party who was a bit too bold in his admiration of Ginger.

Q: "We can't even go into the room to watch our own money! Can you believe this cowboy bullshit?!"