By non-music fan he means people who don't really care about music. People who listen to music for the wrong reasons.
Not everyone wants to be popular either, and even so, it's irrelevant. Led Zeppelin was popular, B.B. King was popular, Jimi Hendrix was popular. They were also great.
I gotta go, I'll be back later.