Buying used is probably the best choice. IN fact, for a beginner, it IS the best choice because you can find a greater variety used than new, and you will not pay more than the true value of the camera (you will be able to sell whatever you buy for what you paid if need be).
If you buy new, you're paying a premium for newness that is without warrant in most cases. That premium is like what you pay on a new car - it means very little and costs alot. Buy a clean used camera, and you'll be able to buy a nice set, not worry about things because you'll be able to get every last cent back if things don't work out, and if you buy from KEH, you'll even have some form of warranty.
Forget Ebay completely. Buy from KEH or something used from one of the sponsors if that is possible. And for a first camera, don't do the Leica thing, buy something middle of hte road like the Voigtlander R3A and get used to rangefinders and develop a more keen sense of what you really desire BEFORE putting $4000 down on a Leica kit.
Also consider if you want 35mm or medium format. And forget AF cameras or little P&S cameras, they are not going to give you the experience you need or want from rangefinder photography.