First, unfriendliness, both from businesses and their employees and other pilots. Wait you say pilots are friendly. Try this: leave the leather jacket/AOPA hat at home and drive to an airport you've never been to- engage in pleasant conversation without letting on that you are a pilot. Second, the utility is nowhere near what is promised. Renting just about destroys what little utility there is. Third, While lots of people can afford it, once you know how to fly it isn't that interesting to drone around after scheduling, waiting, getting through a gate, etc. Affordability is the wrong measure, perceived value is better. Same as paying ten bucks for a good burger. Burger was fine, but overpaying takes away from the enjoyment. While it may cost the restaurant ten bucks to make a profit on a burger, doesn't matter the perception of value takes away from the experience. Better customer service would probably overcome some of this, but I've yet to see good, consistent customer service in Aviation.