Hacker News new | past | comments | ask | show | jobs | submit login

I don't think there's any real evidence that any of the major companies are going out of their way to cheat the benchmarks. Problem is that, unless you put a lot of effort into avoiding contamination, you will inevitably end up with details about the benchmark in the training set.





Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: