Wow. I'm just taking it all in here. I'm taking a moment to reflect on Jaden and Molly. I'm so sorry for what has happened to them.
If we think back 15 or so years to some of the problems we had with early social media, they revolved around what we now call cyber-bullying, or online predators who were asking young teenagers for different kinds of gross material.
What we know from Arturo Béjar, who was the whistle-blower on Instagram and who recently testified in front of Congress in the U.S., is that Instagram knew, according to his own internal research. He was working at Instagram and he looked at how often children were shown different kinds of material. It was mostly that they were being advanced on sexually and they didn't like how open the platform was in allowing people to get to them.
He really wanted to change Facebook. When he realized that the upper echelons of Facebook and Instagram were not going to change the product because it was going to effect the bottom line, he had to accept some responsibility as a quality control engineer for not addressing the problems.
I think right now what we're looking at in terms of content related to suicide and self-harm is that, while the platforms do try to tamp it down, it is a major issue. Once you start to look at self-harm content and learn the keywords and the tricks of the trade, you can get into that world and the algorithm will continue to send you more of that content.
In the case of Jaden, when it comes to a website that is encouraging self-harm and suicide, we've seen this before with a website in the U.S. called Kiwi Farms, where people would not just encourage it but harass trans people into isolation. Once they felt very isolated, some people did commit suicide.
I think there are moral and ethical responsibilities for platforms to build and design better. There's also a customer service opportunity to ensure that parents know that the place their children are going online is safe and there are some adults in the room. Unfortunately, though, we have this perception that somehow moderation on platforms is censorship. It's not true. Moderation is what keeps spam out of your inbox and these bad actors from proliferating online.