No you are wrong. Put an IR pass filter on and you will see the image at minus (about) four stops. Without adjusting the focus it will be out of focus. And yes, your remark about green light is more or less correct. For non-apochromatically corrected lenses only green (and red when partially corrected, as are nearly all) will be in full focus; there will be colour fringes on the outlines of your subject, called chromatic aberration. On an IR sensitive camera IR light causes chromatic aberration too, only worse than with visible light. As most film and sensors are not sensitive to IR light this is of no importance there. With a highly IR sensitive camera like the the M8 is this phenomen comes into the picture (sorry for the pun..) At minus four stops, of course, the effect is not so pronounced that it will immediately be of great influence on small prints, especially with the shorter focal lengths. As chromatic aberration is less magnified with short lenses, it is far more important with longer focal lengths. And other causes of unsharpness, like motion blur or misfocussing may well "drown" it. So it will be up to the photographer to decide whether he/she is bothered.
One lens that is not affected is the 90 mm Apo-Asph, which is corrected deep into IR. But that is an exception.
Btw, it was quite usual to use a blue or green filter when copying critical documents onto high-resolving slow film in the past for this very reason.