“We don’t understand why neural networks work” is a myth. It’s not a miracle, it... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		mock-possum on Feb 22, 2024 \| parent \| context \| favorite \| on: Unexpected responses from ChatGPT: Incident Report “We don’t understand why neural networks work” is a myth. It’s not a miracle, it’s just code, and you can step through it to debug it the same way you would any other program.

zdimension on Feb 22, 2024 [–]

You can step-debug a Python program using Windbg but it won't tell you a lot about what's happening since every line is hundreds of CPython API calls.

Sure, you can "step through" a neural network but all you'll ever see are arrays of meaningless floats moving around.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact