Overall, I think we are better for not having mercury batteries. If there were an organized and proper disposal method, such as “send us your old mercury battery in the little container we provide, and we’ll send you a new battery”, then I could support that. Won’t happen though - the market is too small.
I had a beautiful, long, precise mercury thermometer from chemistry class, where I assisted the professor. I don’t know how I got that thermometer, but I didn’t steal it. Anyway, i foolishly kept it on the top shelf of a cupboard at home and one day my cat jumped up there and knocked the thermometer down, breaking it. I’ve not seen such a nice thermometer since.