You have working hours and you have non-working hours. I don't see the upside in punishing yourself for not working during non-working hours. Those hours are for you. The proper way to look at this is 'be productive during the time you've allotted.'