The oppositie is also true. "Caring" about ICE and wanting to flood the US with illegal immigrants is also a political position, a privileged one at that. It's a luxury belief: https://en.wikipedia.org/wiki/Luxury_belief
Not being an American is a privileged position regarding an issue that negatively affects Americans. It's no different than if I, an American, fail to care about, say, Hungary's slide into autocracy. I am privileged to be able to not care about it.
By that definition, "privileged" looses all meaning, as there is an infinite number of injustices in the universe, and no one is affected by all of them.
Which is itself a political position, a privileged one at that