Nah, don't use a knife, since it's likely that you damage the finish.
Instead you use two toothpicks. Since the Leica or Leitz inscription is embossed you can use the toothpicks to twist back and forth the dot. At first nothing seems to happen, but after some time the glue used to keep it in place will surrender.
That way you will not damage the camera nor the dot.