On my Auto S2 camera case, the previous owner must have had a similar problem, and ripped out the fabric from the "nose" of the camera case. However it was never replaced, and now the "naked" backing of the nose leaves fine white dust on top of the lens barrel of the Auto S2. Not good at all!
I think eventually I'll go the felt route suggested by smasher.