Yea, gives that con artist vibe. "I'm sorry, I can't help you with that." But you're not sorry, you don't feel guilt. I think in the video it even asked "how are you feeling" and it replied, which creeped me out. The computer is not feeling. Maybe if it said, "my battery is a bit warm right now I should turn on my fan" or "I worry that my battery will die" then I'd trust it more. Give me computer emotions, not human emotions.
What creeps me out is that this is clearly being done deliberately. They know the computer is not feeling. But they very much want to present it as if it is.
From a tech standpoint, I admire its ability to replicate tone and such on the fly. I just don't know how it'll do from a user experience standpoint. Many stories of fascinating tech achievements that morphed a lot to be digestible by us humans.
"All the doors in this spacecraft have a cheerful and sunny disposition. It is their pleasure to open for you and their satisfaction to close again with the knowledge of a job well done"!
