Join the club. My 'relationship' with Fuji cameras is similar to yours. Love and hate.
I decided to go with Fuji three years ago (an act of Covid madness, perhaps!) and initially bought into the XT line. An XT1 I disliked as it stubbornly refused to do what I wanted it to, mostly give me reasonable colors in the mid-tones which were all over the place. A loaned XT1 produced the same results. So out it went, traded for an XT2 which I then found had sharpness issues. Ditto. Sold.
Reluctantly, I came to the conclusion (entirely for myself, I'll add) that while I like the Fujinon lenses, for the most part the Fuji cameras do not suit me. Unfortunately, I learned this at considerable cost, but then most useful lessons in life have a price anyway.
By then I had acquired five Fujinons, including TWO (yes, two) 18-55s which I loved. Ditto an 18/2.0, a lens most users think is meh! but for me it works. A borrowed 27/2.8 did nothing for me. Ditto the 35/2.0, both are lovely lenses but almost never used. So they got marched out to my camera dealer on consignment (and sold quickly, I have to say).
By sheer luck I picked up an XE2 from a friend. This small beast does everything I want it to do, tho' I will admit the learning curve with it took time. Colors were hit and miss but finally I worked out a system that suits me. Online you can find several good Fuji web sites with much useful information, particularly so if you are into film simulations (which I'm not).
Recently I had an opportunity to buy an XE2 and an XE3 and passed on both, mostly as these cameras while (I'm sure) are good, they are not made in Japan. This is a particular fetish of mine. QC in Japan has always been superb. In other Asian countries, well. Notably, the XE4 is made in Indonesia, and users have reported massive quality control problems with them.
There is no end of crap posted on the web about Fuji cameras. Too much reading often leads to overthinking, confusion, analysis paralysis. One thing I've learned from all my Fuji experiences is, megapixels are like much of so-called adulthood - overrated.
If you like the XE range, I strongly recommend that you stay with it. An XE3 can do (almost) everything a larger (and certainly more expensive) XT model will.
My suggestion is to take your XE3 and two of your favorite lenses to Europe with you. Enjoy your trip and look at places and things with your own eyes, not through a Fuji viewfinder. Enjoy some good food, drink too much champagne, rekindle the romance. Half a century is a good run with the same partner, you are a lucky man indeed!
My choices in travel lenses would be the '14/2.8 (or the '18/2.0 if '14 is too wide for you) and the 18-55 kit lens. Lens hoods, UVs, a spare card, maybe a portable tripod. That's it.
Purely my thoughts. The ultimate goal is to enjoy the trip, after all.