The way I understand it is this:
Both silver and alkaline cells are made in the same form factor, and lithium is also made in a "double-up" size. Silver comes first and holds the most charge; if you run your batteries flat by taking pictures, it is the best choice. Lithium has the longest storage life so if you take pictures occasionally, then it would be the most economical (with a caveat). Alkaline is somewhere in between in performance.
The problem with lithium is that it has poor performace in many cameras, or appears to run it down at an alarming rate. I would tend to stay clear of them, unless it is said by the camera manufacturer to be compatible.
I have been using alkaline in both 44 (aka 76, 13, etc) and the "four-up" 28 (aka 544) form factors, and have found no difference in exposure accuracy and other battery-powered functions. In fact, I make my own "four-up" batteries by stacking four of those button cells together which is a great money saver. I guess the main thing is "suck it and see", but of course YMMV.