As someone has already mentioned, "cheap" is relative, but for the pure fun of slow and low -- as well as economical -- flying, I think gyroplanes are hard to beat. Some of them, though, will cruise at 90 knots or better.
As an example, below is a description of a nice one I found at...