Which is why the default is often move to trash these days, or includes an undo option for a bit instead of a confirmation dialog.

But some actions are pretty hard to undo (eg installing malware), so the issue in general stands.