There's a reason why the Vision Pro has separate chip that handles the real-time passthrough from cameras (and bunch of other sensor-fusion stuff, AIUI).

Wouldn't it still thermal throttle as the whole device gets hot, separate chip or not ?

I understand the threshold for heating up should be lower than with integrated chips, but we're talking about fan speeds, about when that threshold is still reached and cooling is needed.

In the old days, the device settings would allow the user to tune the trade-off to their own preferences. But current user design orthodoxy is that "settings are bad" to an extreme (I actually agree with the weaker formulation "too many settings are bad"... for some value of "many")