How many is many on a focal length basis? Did you buy all of them you tested and then sell the ones that didn't make the grade? I am trying to determine how people go about this as a practical matter.
I pay more attention to the lenses (focal length,etc) I use the most.
First, you have do decide that within a set of lenses, all 28mm f2.8 AIS for example, that some will be better than others.. for whatever reason. If you don't believe there is a difference, then you're wasting your time.
Then, given that there is a difference; how important is this to you? If it's of little importance, then again, it's wasting time. If it ranges in importance from, fairly to real important, time and money might be spent accordingly.
I'll spend time testing my most used focal length prime lenses and zooms (at their most used focal lengths). Little used focal lengths don't get as much attention.
I think, many think this is complete bs, and have no interest in testing the tools they use. I have no problem with any of that. Many on here would prefer a lens that looks like new to one that is rough in appearance, but is a stellar performer. I understand that too. It comes down to how important your images are to you.
I come from a place where, some who employed me felt that working with a small, camera was a disadvantage .. And, maybe they would get more for the buck, if i used a larger format.
Today, with digital hardware, the format is less critical. But, a lenses' ability to resolve a sensor is a serious thing. I just think that, some lenses do it better than others, and i look for them. It's time well spent for me. This was the case with film and i don't think things have changed.
If it's a used lens, i buy them and sell them. I went through 8-10 looking for a 50mm enlarging lens.