> What if they have illegal evidence that you’re dangerous and can’t arrest you because it wouldn’t hold up?

Then that is a civil rights violation right there. Police shouldn't have illegally gathered evidence. Police should not be making decisions based on illegally gathered evidence. Police should not be making an endrun around the courts to apply punishments (such as forbidding travel) based on illegally gathered evidence.