Hacker News new | past | comments | ask | show | jobs | submit login

I've got a script for parsing my web logs which removes all the lines which match persistent indexers/bots/scrapers and any obvious automatons. Logs generally shrink to 40-50% of their volume, so I'd at least double CF's estimate.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: