The question seems a bit of a set up, if they had not been seen as acting rudely, the post would not have been made, so it is a question of manners rather than photography?
While shooting in Paris at a street market, some guy thought I got him in the edge of my shot, (shooting with a Fuji 645 folder) and proceeded to give me a lecture in broken English as to the laws in France. I was taken aback a bit, but had no way to know if I got him in my shot.
I read the laws were recently changed, or revised in court, in France.
If I shoot in one place for awhile, and am using obiously expensive gear, I can either shoot and scram (HCB's words), or quietly wait until I am seen and see if the subject raises any objections, which makes the following shots generally less than candid.
I am clearly divided on this issue, but in most of Europe that I have visited, people are more tolerant, so I shoot less here unless it is telephoto.
Unless there is some driving reason, (I used to shoot for print media), I really do not feel comfortable in getting in people's faces.
I had an apartment in Prague several summers, and the local kids and families got to know me a bit, and I got some shots I had not planned of some of the kids who almost "forced" me to shoot them.
Let me know if there is a simple answer, it is not merely a question of rights.