"Just say no."
Personally, I see nothing wrong with it. Not everyone who graduates H.S. is going to end up a rocket scientist. Speaking as an "old man," let's face it, some young members of society could flat
use being in the military...if, for no other reason, to learn to grow up and abandon (hopefully) their, shall we say, tendency to get into mischief. Maybe they'd learn what words like responsibilty, loyalty, and honor mean, too. And, as a bonus, when they get out of the military, they'll have some college funds available if they want to pursue further education. No, it won't work on everbody, but neither will getting a job, going on to college, or anything else, for that matter. Some folks are just destined for medocrity (no, not really, but it's their choice).
And, if it just ain't your thing, as I said, just say no. It's real easy and only one syllable.
As far as the "right" not to have military spokesmen come speak at a school, what's the big deal? College recruiters visit as well, and college isn't everyone's thing, either. Not to mention countless other professionals from all walks of life who drop by in the hopes of whetting some youngster's appetite for their particular pie. If you're not interested, just enjoy the time off from mundane mathematics, kick back, and catch some Zzzz's. No harm, no foul.
For the record, I myself was going to join the Marines. Then, 2 weeks before the big day, I lost my leg. I am, however, the son of a WWII vet, and proud of it.