Assuming you don't mean ultralights, something with only one or two seats, a small engine, no gyros and no electrical system would fit the bill for "cheapest". Low operational cost, too, and if it meets Light Sport limitations, it would be cheaper for the pilot to qualify to operate it.
That...