UNscientific study (x100 vs. 35 summicron vs. 35/f2 biogon)

grahamule

grahamule
Local time
10:27 PM
Joined
Jan 19, 2010
Messages
36
Okay, I'm going to start this by saying it is completely anecdotal and not to be taken as gospel, though I am sure it might be controversial anyway. And sorry it got to be so long, but I wanted to describe the situation.

Several weeks ago, I was shopping and in the process of considering making a major shift in my gear (specifically, I was looking at the x100 vs. m9). I wanted to see if the (new) preferences that I was developing were completely in my head or not. Lots and lots of people say that people see the signature of a lens or camera because they are looking for it and that they want to see it because they know it should be there.

Anyway, I found some work by a photographer online that I mostly like, and he had a few dozen examples posted taken with the x100, m9+35 summicron, and m9+zeiss 35/f2 (among others of course, but I was going for some kind of consistency). The pictures were of varying subject matter and settings, both b&w and color, etc., although there were no "side-by-side" shots any particular scene with the different gear. But being from the same person, they all had a similar overall style.

So I collected these few dozen photographs and mixed them all up among each other. I sat my wife down with me and *only* asked her to look at the photos, and tell me for each one if she liked it or not or how much. Whatever she wanted to say. I asked her to pick out her favorites, her next favorites, least favorites, etc. I also told her to try not to judge the pictures by the subject or content, but really just the aesthetics of the photo itself, though I admitted to her and here that this can be hard to do. I tried to keep my instructions as vague as possible, trying not to bias her answers. When she gave me opinions on any photo, negative or positive, I would ask *only* "why", with no leading questions or adjectives. A few days later, I repeated the exact same procedure with a friend. Neither my wife nor my friend has any photography experience or interest really. And they don't really spend time looking through photo books or magazines. Also, I had not yet discussed what I was shopping for before this, so they shouldn't have had an idea of what they were looking at.

I didn't keep an exact count, but a running tally in my head corresponding to a ratio, and the results were as follows:
Wife: preferred the m9 to x100 about 3 to 1, and of the m9 photos the summicron to zeiss about 2 to 1. When asked why, some of the exact words she used were (among others): pop, vivid, sharp, 3D, contrast, etc., and less interesting things like pretty, neat, etc. She seemed to like the subject separation in the photos, and pointed this out in both cameras, but made the comment more often with the m9.
Friend: preferred the m9 to x100 about 2 to 1, and of the m9 photos the summicron to zeiss about 2 to 1, although he consistently liked the zeiss b&w photos better than the summicron b&w. He used words like: sharp, colors, pop, and seemed to not like the shallow DOF examples as much, though commented on a couple that he did like.

Again, I was very careful not to provide these adjectives to them before hand, because I wanted to see what they would see and how they would describe it on their own. I was kind of shocked when they both said "pop" and the wife said "3D". I kind of expected "sharpness" and "colors" (in either a positive or negative way).

Part of me wanted them to not tell a difference or prefer the x100 so I could talk myself out of the m9 cost. But I preferred the m9 so part of me wanted them to prefer it as well to confirm me. And by the way, I am now with an m9 + zeiss because right now I slightly prefer the zeiss look, and wanted to get some more experience with the system before making the decisions about spending the bucks on the leica glass (issues like asph vs. pre-asph, etc. 🙂 )
 
You are happy. You have justified your purchase in your own mind.

Nothing else matters.

True enough! Maybe I should have said that my mind was pretty much made up before I did this, but I suppose my post didn't really indicate it. When it really comes down to it I take photos for me first. I was just curious if it was in my head, and was/am perfectly willing to accept that it is!
 
I have a Ricoh GXR with aps-c modules as well as the new M-mount module. I love the output from the GXR. But when I compare them with my M9 files, I still realize that the M9 files are a cut above the GXR. The difference is 'fabulous' as opposed to 'great'. There is much more subtle colour gradation and 3D 'feel' to the M9 images, even compared with those taken with the M-module and the same lenses.

There are a lot of great X100 photos out there now, but none of them make me go 'holy freakin heck' like a good M9 photo does.
 
Very interesting. Is it possible for us to see the pictures that you showed your wife? I'd like to see if I can see a difference.

But this is digital remember, it's all in the post processing. He could've spent hours with the M9+Cron files and a lot less with the biogon perhaps who knows.
 
Actually I would say this is a scientific experiment, even though it is an informal one. It could have been made formal by recording an exact count of the subjects' responses; by using more subjects; and by doing a statistical analysis to determine if the results were statistically significant. Even so, you did a lot right: you had control of the experimental variables; established standardized conditions; you kept track (informally) of the subjects' responses; and reported your experimental bias along with your results. And your experiment can be replicated or falsified in future work.

Good job!
 
Frankly, I think it's a great experiment.
Not the pixel peeping / distortion measurements etc we all compare in order to extrapolate how the lens will do in the field, but you took the "general rendition" thing to the experiment ground. good idea.
I agree with Moriturii: I would love to see the pictures (not that there is any X100 or M9 in my future). Just to see if we can see the difference.
You could set a much larger scale experiment of yours...
 
Well, first of all, I said that I would not disclose the particular source of the photos. However, one can easily set up their own such experiment by just doing a google search. If you want to set it up yourself, find a website with such a comparison and have someone else gather/scramble the photos for you. Sorry I can't be more help here. Remember too that my subjects did not have any idea of brand, type, relative quality or cost of the equipment that produced the photos. If you were to choose to do this for yourself, you would be starting with this bias. (just something to keep in mind) My wife definitely rolled her eyes when I told her she had ranked the photos fairly consistently in order of cost of the cameras.

Which reminds me of something I forgot in the first post. (Now it is really going to start to sound like I am making all of this up!) After telling her what I had had her do, we then looked at some noctilux 0.95 pictures (again, didn't tell her what they were, I just said "oh yeah, let's do one more and just tell me where you would place them among the ones you already looked at."). She liked the noctilux pics better than all of the others. I told her I wouldn't mind her getting me that lens, and that if she did I would use it just for her. :angel: Although truthfully, even though I like the look of that lens as well, I'm not sure if I will ever think it is worth it. Maybe someday, but not soon.

Secondly, thanks for the kind words about the possible validity of this exercise. I just wanted to add the disclaimers because in my experience it is threads like these that turn into massive arguments and flame wars. People seem to be very opinionated about whether or not the "leica look" or "zeiss look" or anything similar is legitimate or fabricated. I'm only adding my anecdotal experience here. Also despite being a scientist by day, I do not do much in the experimental realm. I am one of those kooky theorists 🙂
 
But this is digital remember, it's all in the post processing. He could've spent hours with the M9+Cron files and a lot less with the biogon perhaps who knows.

This is certainly true! However, he claims to use a fairly consistent and simple workflow. But it is something to keep in mind.
 
Back
Top Bottom