My experience watching tens of millions of interactions between humans and artificial conversational agents, or bots, has convinced me there are far more immediate risks-as well as tremendous opportunities.
As I studied how people interacted with the tens of thousands of agents built on our platform, it became clear that humans are far more willing than most people realize to form a relationship with AI software.
People are willing to form relationships with artificial agents, provided they are a sophisticated build, capable of complex personalization. We humans seem to want to maintain the illusion that the AI truly cares about us. People would volunteer deep secrets to artificial agents, like their dreams for the future, details of their love lives, even passwords. We need to deliberately and consciously build AI that will improve the human condition-not just pursue the immediate financial gain of gazillions of addicted users.
We need to consciously build systems that work for the benefit of humans and society.