He pointed instead to today’s concerns: Specifically, surveillance AI, which involves “fairly dumb computers” whose real potency is that they “monitor us in all places and all times.” That will shift the balance of society away from civil liberties toward centralization, he warned:
You can think of the crackdown in China or Hong Kong, where you have facial recognition software. This is not futuristic, super, super smart AI, but it is sort of a next generation technology.
He summed up: “Almost all the paths that lead to AGI, as it is currently conceived, go through giant organizations with giant databases, looking at people, modeling people, doing machine learning on people to build the AGI. You need this sort of surveillance to get to the AGI. And of course the surveillance a AI has a sort of a creepy totalitarian undercurrent.”