With regard to the similarities and differences, I think nuclear weapons pose a particular risk, which is when they explode. The analog to that is if we build superintelligence and lose control of it.
AI is posing significant risks right now and is doing significant harm right now because it is so under-regulated and undergoes essentially no safety testing. As Max mentioned, there's strong evidence that there are large effects on suicidal ideation and media addiction in our young people. That is harm that is being done right now. We clearly see the beginnings of effects on labour with replacing humans with AI systems. That is the design; that is the goal to do at a large scale.
I think we are going to see that the risk of AI is it's replacing humans in roles that they should not be replaced in by a machine—as therapists, as companions, as romantic companions, as workers, etc. That scales all the way up to replacing humans as decision-makers and even replacing humanity altogether in the longer term.
I think the stakes are big, but it can be more diffuse.