Hacker News new | past | comments | ask | show | jobs | submit login

I wonder how difficult it would be to make a website that, instead of serving 404's, a model does a semantic search using the nonexistent URL to come up with a URL that actually does exist and most closely matches the "intent" of the invalid one.



Not too hard, if the site already has some kind of a search engine, it can feed the URL to the search engine.

The safe thing to do is return a 404 with a few suggested links.

The problem is that "guessing" the intent of the URL will have unintended consequences. A URL will no longer be guaranteed to point to what you think it points to. This fundamentally breaks the assumption of what a URL is.

How could this happen?

1: Site creates article foo.com/chocolate_bars 2: Someone accidentally links to foo.com/cocoa_bars, which serves foo.com/chocolate_bars 3: Site creates article foo.com/coco_bars 4: Now foo.com/cocoa_bars serves foo.com/coco_bars


Yes, this sounds like a nightmare. Also pity poor archive.org if they try to archive a web site set up like this - every URL will resolve to a valid page.


My thought was to serve a 307 (or some other redirect HTTP code, clearly I am not a web developer) instead of a 404, not to serve the found content “as” the url that didn’t exist.

But agreed this would not be good general practice. It was mostly a thought experiment.


> The safe thing to do is return a 404 with a few suggested links.

The 404 communicates to search engines, archive.org, ect, that the link is broken.

The human-readable text on the 404 page can contain a link to the correct page. It could even contain a few paragraphs too.

Should get close enough to your original idea without too many unintended consequences.


How about just using an LLM to generate a page that matches what the URL appears to try to link to?

(not being serious here)


That's called Websim my friend and it's a heck of a lot of fun

https://websim.ai

This is what it generated for one of the non-existent articles

https://websim.ai/c/P32MdBI15Ytxwwlth




Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: