Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

If you were doing a lot of scraping, you could just solve this on a GPU in 1/10 or less of the time it takes a human's phone to do it. Generally you need a decent computer to render a webpage while scraping it these days, so I don't see what this is solving.


scrapers usually don't render a webpage, else their scraping wouldn't be efficient at all.


Is that still true? There are so many SPAs out there now that if I were to create a web spider today, I would plan to just render a lot of the pages in a browser rather than fight the status quo. Efficiency wouldn't be my top concern.


That’s bullshit




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: