Roblox Launches Open Source AI System to Protect Children

• Sentinel identified 1,200 instances of child exploitation in 2025
• The system analyzes over 6 billion reports daily
• Roblox plans to make Sentinel available for other platforms

This is reported by ABC News, CNET.

The company Roblox, a popular online gaming platform, has announced the launch of an open-source version of the AI system, which aims to detect unsafe language in chats. The system, known as Sentinel, is designed to help identify signs of potential unsafe interactions among children.

This step comes in the wake of criticism and lawsuits that accuse the company of inadequate protection for children from potential threats. For example, a recent lawsuit in Iowa claims that a 13-year-old girl became a victim of adult predators on the platform, which led to her abduction and trafficking by humans.

Roblox states that the Sentinel system has allowed it to submit 1,200 reports of possible child exploitation to the National Center for Missing & Exploited Children in the first half of 2025. The system analyzes over six billion reports daily, fixing data for further learning.

According to Roblox representatives, the system learns based on past incidents, which enables it to recognize unsafe patterns of interaction. The platform already has limitations on user personal information, and developers hope that Sentinel will be able to identify potential threats earlier.

With the new system, Roblox continues to work on additional initiatives to enhance safety, including content moderation powered by AI in 25 languages.

Tags: Technology/AI