Mr. Adler, companies assert that there are safeguards in place and that hence, there's really nothing to see here when it comes to the safe use of, for example, a chat box by minors. In the Raine v. OpenAI lawsuit, OpenAI asserts that its moderation API can detect self-harm content with up to 99.8% accuracy.
That case, of course, involved the tragic suicide of a 16-year-old boy who was effectively counselled by ChatGPT on how to commit suicide. I think that when he entered “suicide” 200 times, ChatGPT brought up “suicide” 1,200 or 1,300 times. That's more than six or seven times what the user had input.
Given your background, I'm trying to square on the one hand the representations that are being made by companies like OpenAI versus what we're seeing in the real world, where there are multiple instances—frequent cases—of real, harmful content that is being pumped out by these AI products.
