Your journey is similar to mine:
Wow, this Leica. It's magical! There's nothing it can't do! This is a $3k+ ASPH lens! It's got creamy bookeh!
Unfortunately, coming from a DSLR background, stylistically there are simply things I couldn't effectively do with my film (and digital!) Leicas. A rangefinder is a different beast: minimum focus distance, rangefinder focusing method, and of course a lot smaller. It allowed me to travel with lighter equipment, but did not replace my ability to take shots like I did with my DSLR.
I liked film. I liked it's character. I liked that rangefinders got me back into film. Thus, a natural progression was to get a film SLR body that allowed me to take advantage of my large Nikon lens collection from my DSLR bodies.
I started with a Nikon FM2. Same size as an M body. Totally manual focus. Battery for meter, but all shutter speeds mechanical and not reliant on a battery. This was a great body and I was able to return to my comfort zone (standing closely to my subjects; macro photography, etc) but found I was becoming frustrated with split prism focusing. I didn't find it as easy to focus as with a rangefinder.
Then I picked up an auto-focus SLR body. $40. Equal in functionality to a Nikon D700. Amazing. I now have all the ability that my DSLR cameras had, but with the quality and character of 35mm film. I was and am very happy.
Rangefinder? Day trip. Vacation to another country. Walk-around daily camera.
SLR/DSLR? Modeling. Macro work. Creamy bokeh from closer distance than allowed with a rangefinder.
PS. If you want to be astonished by the quality from a "cheap" camera body, check out an Olympus Stylus Epic point-and-shoot. Much larger "sensor" than a modern digital point and shoot. Full-frame!!