I thought it was from season five but couldn't place who said it. On that note was it Rusty Milio, Frankie Valli's Character, to Little Carmine?

"Life is tough, but it's tougher when you're stupid"

- John Wayne