I use three of the four lenses you use (16/23/56). When I was looking for a focal length longer than the 56 to use on my X-Pro1 primarily for portraits and stage work, I considered the following lenses:
90mm f/2 Fujinon
135mm f/2 Rokinon
135mm f/2 Nikon with adapter
135mm f/2 Zeiss with adapter
50-140mm f/2.8 Fujinon
1. The 90mm was great for portraits but not long enough for my stage work.
2. The Rokinon was the least expensive but I did not like the way the manual focus ring rotated in a direction opposite to my other lenses.
3. For portraits and stage work, the image quality of the Nikon was very good but the Zeiss image quality was a little bit better.
4. The Nikon was not a big as the Zeiss.
5. The Fujinon zoom was not as fast as the other lenses but the variable focal length was very useful for stage work.
6. The Fujinon zoom was bigger than the other lenses.
7. The 90mm and the Fujinon zoom were fully automatic (focus and exposure).
8. The three 135mm lenses were all manual focus.
9. Under studio portrait conditions, the Fujinon zoom replaces my 56mm Fujinon, 85mm Nikon, 105mm Nikon, and 135mm Nikon lenses so I do not need to change lenses.
10. When shooting under low-light conditions, if I did not need the extra stops of light gathering, the Fujinon zoom could replace the 56mm.
I have not yet reached a final decision. I am still testing the Nikon, the Zeiss, and the Fujinon zoom. Last weekend, I photographed a concert and used in descending order: the Fujinon zoom, the 56mm when the lighting was too low for the zoom, and the 23mm. I did not take the Nikon. I never used the Zeiss, even though I had it with me.
135mm f/2 Manual Focus Lenses by
Narsuitus, on Flickr