Just don't carry those lenses in your underpants if you wanna have kids 😉
No, but seriously folks... 😀
There are far more intensely radioactive minerals, such as pyrochlore, that occur naturally, than you will find in a "hot" lens. Fortunately they are uncommon.
Unfortunately, as others have pointed out, the very word "radiation" has been made into a sort of modern day boogey-man, irrespective of context (as in the gamma-sterilization of food and medical supplies).
Thoriated glass is not "nuclear waste", btw. Thorium 232 (the most common isotope in nature) has a half-life of 1.4 billion years (about the age of the universe) and is virtually inert as a consequence. If manufacturers really needed thoriated glass and were willing to spend the $$$ to separate Th232 from the other isotopes it would be completely safe, as the optical/chemical properties are not dependent on the radioactivity. The main risk to the user from having oculars/eyeglasses with radioactive glass is cataracts.
One other thing - the Am241 used in smoke detectors is an alpha, not neutron, emitter (secondarily, a low-energy gamma emitter) and the little sheet-metal cage around the source is more than adequate to stop any alpha particles. Neutron emitters are exceedingly rare.