they run one batch at a time, only when executed, with functionally no memory.

If, for some reason, you gave it a context about being shut down it would 'forget' after you asked it to produce a rude limerick about aardvarks three times.

“Functionally no memory” is a funny way of saying 1 million tokens of memory

That's A) not actually a lot B) not generally kept between sessions

B is not universally true, premium versions of chat agents keep data between sessions. A is only true in the case where B is true, which it is not.

https://community.openai.com/t/chatgpt-can-now-reference-all...

Nonsense seems like a strong word for "not generally possible in like 75% of the cases that people use chat AI today"