That really depends on who you ask - I find olympus digital cameras extremely quirky. The menu system on the om-d is frightfully disorganized and overly complex. The x-pro1 has manual dials/controls and a simple menu, and a single AF spot. Not sure how that's classified as quirky, but each to their own.
A lot of us started out with m4/3 in mirrorless cameras 2-3 years ago, and got sick of waiting for olympus and panasonic (mainly olympus) to bring out an advanced camera with the built-in finder, and fast primes. However many years on, there is STILL no decent fast 35mm equivalent AF lens for m4/3. Panasonic filled in the lineup a little bit recently, but the panasonic supply chain is dismal for their lumix gear outside of japan.
Sonys NEX lens lineup is still nonexistent.
Fuji on the other hand, had a fairly comprehensive lens lineup out of the box with the x-system (28mm f2, x100 35mm f2, 50mm f1.4, 90mm f2.4 equivalents), and next year you can add a 21mm f2.8, 35mm f1.4, 85mm f1.4, 2x fast IS zooms, and several zeiss AF lenses to that list.
Fuji hit the ground running with pretty much everything we were asking for, whilst olympus fumbled around with non-sensical superzooms and dumbed down compacts released one after the other for years.
That's why a lot of us feel strongly about the Fuji's.