If I ask you to turn on your head lights at day time, am I ignoring your personal freedom?
You can ask anybody anything and it won't interfere with their freedom I think.
You are free to not even listen to the question...
I might judge you based on your decision and chose to ignore you in future. This again would not violate your personal freedom I think