I totally agree.
For nearly 30 years I rode in San Francisco and the Bay area, with occasional long trips. My worst experiences were not tangles with cars or aggressive dogs or chafing, but encounters with other bicyclists. That observation holds true whether I was riding a bicycle or motorcycle, driving, or (especially) walking about the city. One of the most annoying aspects of being a bicyclist among other bicyclists was the arrogant, sneering, and often aggressive snobbery I witnessed and endured. Snobbery about nearly every aspect of the ride, including what bike one was riding, technique and speed, and what apparel one wore. Many riders felt a sort of peer pressure to buy the latest $10k superbike and get all-duded-up like Lance Armstrong in order to ride through Golden Gate Park on Sunday, lest they feel shamed by other bicyclists. They couldn't just throw a leg over the bike and ride 10 blocks to Sightglass for coffee without donning the complete uniform. The flip-side was hipsters on fixies terrorizing pedestrians (including yours truly) in the Mission. As a whole, NorCal was a great place to be a bicyclist, but the scene was often spoiled by a cadre of yellow-jersey wannabes and self-righteous, preening showdogs. And I will admit to being part of the problem, mostly for taking great pleasure in gratuitously dropping many of the more obnoxious of those yellow-jersey wannabes with their Tour de France kit while riding my 1986 steel touring bike--with mudgards--while clad in a white shirt, jogging pants, and a pair of Vans on flat pedals. If the shame in shaming applies equally to the counter-shamer, well, it was a guilty pleasure of mine and I will own it. But like you, my ideal ride was casually pedaling from A to B, and often, just pedaling from nowhere to nowhere through some of the most beautiful places on Earth.
Noting that many of your most memorable riding experiences were had on a Schwinn Traveler, and in light of your statement that "I'm happy with something I can pedal and that gets me there," it's clear that you get it. So pedal on, happily, shamelessly.