I believe that film grain, especially (well, mostly, actually) in b&w is pleasing precisely because of this abstraction. The "closer to reality" noiseless image is often, though not always, less interesting to me. It can be successful, but the image needs to be made differently, IMO, especially in terms of digital capture.
Yes, we have gotten used to grain in film photography, but I believe a major reason is that is pleasing to most people in many images, even if they are not conscious of it. IOW, it's not just habituation. At least in my opinion.
The thing is, we really have nothing to measure it against. Grain was not part of the equation until enlargement started, which happened approximately in the 1920's. Grain became a fact of life; anything printed 8x10 from 35mm had grain. We made it a virtue. That's habituation.
We never had the option to easily capture and present grain less images. Yes, we could shoot LF and contact print, but that faded into a niche, and was far removed from the bulk of photography whether snapshot or 'serious'.
Whether we like it or not is a different matter. Some do, some don't. I've certainly played around with grain in Royal-X pan in 120 size and 2475 Recording Film in 35mm, developed at 50°C or in Dektol and then printed on Brovira #6. Sometimes it worked, sometimes it didn't. It was another option. However, I think that even now, let alone in 25 years, delight in grain will become a very very minor side road in photography, even though it is quite easy to introduce 'grain-like' noise into digital images. One may argue that what is created is not true grain, and be quite right, but true grain is not one pattern of grain, but a large variety so that argument starts falling away.
I personally like certain types of grain for certain images, but that is the aesthetic I've grown up with and dealt with unless contact printing from 8x10 (which I've done as well). It's just that I think the noise that it produces is something we've become acclimated to, and that we might well have not gone there mainstream if we hadn't been forced to.
Just as I believe that if colour painting had been as easy at the start of humanities efforts and colour photography had been available and as cheap and easy as B&W we might never have developed the various forms of B&W drawing or B&W photography as much as we have.
The abstraction that is B&W was forced on us in the beginning, and we made a virtue of necessity.