Certainly you can make things more complex than they need to be (for your given use case). That is self-evident for most engineers.

Doesn't that hold that the inverse must be true? In some cases, you must be able to remove complexity from the equation, without introducing it somewhere else.

I agree with the spirit of the post, but I think it's eliding some of the complexity involved in identifying essential complexity.