The APS-C Fuji's are complicated too use. They are not like DSLRs and they are not like optical RFs. There are two finder modes and three focus modes. There is a macro mode. I find switching between the EVF and OVF is required to get the best overall focus performance. Different situations require different techniques. There are menu settings that significantly impact how the AF performs. I can imagine numerous sets of parameter selections that would make focusing extremely frustrating. I also know there are choices that make focusing efficient and accurate. I think user impressions reflect these complications because during the first weeks of my X100 ownership I was frustrated too. But then I found out how to make the AF meet my needs.
The Fuji APS-C X cameras' AF hardware and firmware is a weakness. Many other APS-C and m4/3 systems are stronger. None of these have optical finders compatible with AF. So, in the end you are faced with another compromise. It's hard to sort all of this out. And it's hard for a new user to evaluate the X series AF on the spot. The AF works for me, it does not work for others.