It's pretty astonishing. We've never seen an industry both developing something and publicly admitting how very dangerous that thing is. This is a product of how the industry has peculiarly developed and, in particular, the race condition that these companies find themselves in.
A couple of weeks ago in Davos, we heard from two of the heads of AI companies that they would like to slow down. They feel worried about what they're doing, but they feel they can't because they're in a race. If they hit the brakes, everyone else is going to keep their foot on the accelerator, and they'll lose out. All of these companies feel they have to build this thing because somebody is going to do it, and they feel that if somebody is going to do it, it might as well be them.
This is a crazy situation for us to be in, just like the classic arms race that ended up with 70,000 nuclear warheads that nobody felt like was such overkill. That's where we ended up because there was an arms race. We're in a similar situation here where it takes an outside actor—and it really has to be the government—to call a quit to the race. They're not going to be able to do it by themselves, even if they want to.
