The Visegrad 4 (Poland, Czechia, Slovakia, Hungary)are generally taken to be "Central European". The strict East/West division is largely a product of the Cold War and the Iron Curtain.
No, the distinction into West/Central/East Europe was also relevant in the centuries prior. You're right with, that East Europe starts with Belarus, Russia and Ukraine.