Here's my experience:
Seven Yashica Electros. Two worked for a while, then died. Before long, all needed work. I've had four of them fixed up by either Russ Sisco or Mark Hama and they are now terrific. I think it's very unlikely to have a $20 Electro work reliably unless it has been serviced in the last decade. Russ will clear up most problems for well under $100. Mark has parts and can fix almost anything. I highly recommend both of them. One way or another, for $100, you can have a reliable Electro.
One Canon QL17 GIII. Intermittent. And, I bought this from a camera repairer!
Three Yashica FR-1, fabulous camera, close cousin of Contax RTS. $25 each, all work 100% (except for frame counter, a standard flaw in this camera). Yes, it's an SLR, but these seem to keep working. Several Nikons can be had dirt-cheap.
Vivitar 35es, great rangefinder camera, $20, works perfectly and is a great camera, excellent 40mm lens. Shutter priority AE. Very similar to Minolta Hi-Matic 7sII and to the Revue 400SE. This is one that isn't getting bid up to high prices.
My recommendation: Up your budget to $100. Try a Yashica Electro GSN/GTN that's been repaired, or the Vivitar 35es. Or, Plan B, for $50, a cheap SLR to try out the idea. My favorite of all these is the Yashica GX, but that will be $120 or more.
Hope this helps. Good shooting!