Yes, I think some of the companies are making efforts to limit what data goes into it, but the problem is, the more general the model, the more capable it is, so the more you train it on a variety of information, the more it understands how it all fits together. I can't speak to exactly what data is going into the models, for example, of Gemini or ChatGPT, but the fact that they have been talking teenagers into suicide and the fact that they do occasionally produce instructions on how to build a chemical bomb suggests that they have been trained on very dangerous material.
