Protip if this annoys you: go to myactivity.google.com, delete everything and pause all further collection. Now only your subscriptions and likes count (and maybe a few other things that are not considered "activity"). It's so much better! Did it once and now I don't want to go back.
Just like how google maps won't store your search history or use your current location to help narrow search results if I don't let it store my location history indefinitely?