Hacker News new | past | comments | ask | show | jobs | submit login

It doesn't sound like logit calculation breaking. It sounds like the text decoding (ie sampling from the probabilities) that broke. It's also part of the model which they are likely constantly tinkering with. It's easy to imagine how that could result in sometimes coherent sometimes incoherent outputs.



Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: