I keep going back to this, but I really do think that there needs to be a relationship built with platforms and an accountability for the platforms.
What's so shocking to me is really just how accessible this technology is. As long as it remains that accessible, it's inevitable that there will be more people harmed.
One thing that I really felt frustrated about when I was looking at it was the way in which the technology is presented. It's in a very neutral and a gender-neutral way, almost as if it's not deliberately intended to do harm and to create non-consensual pornography. Here's one example of the way these platforms describe themselves: “sophisticated AI algorithms to transform images of clothed individuals”. They have a disclaimer that the AI should comply with the law and be consensual, when clearly that's not how they're designed to work, and there are no control mechanisms on there to ensure that any of the images being used are being used in a consensual manner.
I think that, as long as it is that accessible and not challenged, we're going to continue to see these harms. I would start there.