If we weren't digging carbon out of the ground then a lot of human activities would indeed not be a problem.

I'm sure we can make things uninhabitable without doing that, but, largely when talking about climate change: it's the mere fact that we're unleashing significant amounts of stored energy into a closed loop ecosystem that cannot handle it.

I think we're saying the same thing here.