I'm not sure where people get these ideas...when I'm confronted with misinformed people I let them know that I do have the right to do what I'm doing and then continue doing just that...when & if threatened with involving the local authorities...I offer to call them myself...
I have walked through Union Station (Los Angeles) so many times with a camera or two and have shot unimpeded...the one thing that will get the dogs out is if you happen to have a tripod set up...they don't like that or if you're shooting commercially without a permit.
People who say things like "you can do that" may be quoting people they've overheard without actually finding out what is allowed...
ig·no·rant
ˈignərənt/
adjective
1. lacking knowledge or awareness in general; uneducated or unsophisticated.
"he was told constantly that he was ignorant and stupid"
synonyms: uneducated, unknowledgeable, untaught, unschooled, untutored, untrained, illiterate, unlettered, unlearned, unread, uninformed, unenlightened, benighted;