I think some of the foundations of this are also useful for the stuff that I'm worried about with loss of control, but there's a certain school of thought that we should just let these people cook. The technology will cause a bunch of enormous benefits, and we don't want to limit them.
I find it hard to imagine that we're going to end up in a stable world if we succeed at creating these systems that are increasingly capable and that have dual-use capabilities with national security implications. We want AI developers to be able to make models that can help with novel drug discovery. Do we want those models that might also help someone create an unprecedentedly powerful bioweapon? Do we want those models to be open-source?
We should probably have some framework under which we know who is capable of training a genius in a data centre and what we can do with those very powerful technologies. If we just proliferate them openly in perpetuity, it could create a world that's unstable and that we won't be able to control. That's not to say there aren't a bunch of benefits to open sourcing some of these models; we should open source all the ones we can that don't impose those risks.