Go to "History" in your sidebar: https://www.youtube.com/feed/history

You can individually remove videos by clicking on Delete (at least on desktop).

You can also pause your watch history (eg. for some guest browsing) or clear it entirely (if you want to start from scratch).