Probably just reflects that they are playing catch-up with OpenAI, and it would not look good if they announced their latest, greatest (to be available soon) was worse that what OpenAI have been shipping for a while, so I assume that being able to claim superiority (by even the smallest amount) over GPT-4 was the gating factor for the this announcement.
I doubt LLMs are close to plateauing in terms of performance unless there's already an awful lot more to GPT-4's training than is understood. It seems like even simple stuff like planning ahead (e.g. to fix "hallucinations", aka bullshitting) is still to come.
I doubt LLMs are close to plateauing in terms of performance unless there's already an awful lot more to GPT-4's training than is understood. It seems like even simple stuff like planning ahead (e.g. to fix "hallucinations", aka bullshitting) is still to come.