🧔♂️ A friendly human may check it before it goes live. More news here
OpenAI launches free tool to detect child abuse images
OpenAI is introducing new child safety measures, including an image classifier for potential child sexual abuse material (CSAM), including AI-generated images, warnings in ChatGPT, and tools for investigators.
The company said vetted organizations can access the classifier through its application programming interface (API) at no cost.
The National Center for Missing & Exploited Children, a US non-profit that runs the CyberTipline reporting hub, helped develop it.
OpenAI said ChatGPT warnings will come with the removal of flagged conversations and 24-hour account suspensions, while specialist support remains available.
Repeat violations may lead to tougher penalties. The company also published developer guidance and announced tools and planned training for investigators.
The measures build on existing rules that prohibit CSAM. A help article details ChatGPT warnings and suspensions.
The Internet Watch Foundation, a UK non-profit focused on online child sexual abuse content, has published research on AI-generated abuse imagery.
US states have also enacted or are considering laws criminalizing AI-generated or edited CSAM.
🔗 Source: OpenAI




