Roblox makes three of its AI safety tools open source
Roblox has open-sourced three artificial intelligence safety tools through ROOST (Robust Open Online Safety Tools Model Community), an independent nonprofit dedicated to developing shared online safety infrastructure. Roblox co-founded ROOST in 2025 alongside Google, OpenAI, and Discord, reflecting industry commitment to collaborative safety initiatives.
The three open-sourced tools include the PII Classifier, which identifies attempts to share or request personally identifiable information, including misspellings and obfuscated variations; Roblox Sentinel; and the company’s latest voice safety classifier. All three models are currently deployed on the Roblox platform, demonstrating their real-world effectiveness in moderating user-generated content and protecting players.
By open-sourcing these production-grade tools, Roblox enables other platforms and developers to leverage the models in their own moderation systems, potentially raising industry-wide safety standards. This contribution reflects a growing trend of major technology companies collaborating on safety infrastructure rather than developing proprietary solutions independently.
The move highlights the growing importance of AI-driven moderation in platforms hosting large amounts of user-generated content. As gaming platforms continue to support millions of daily interactions, automated safety systems have become essential for protecting vulnerable players and maintaining healthy communities. Roblox’s decision to contribute to ROOST’s shared resources signals confidence in its safety systems while advancing the industry’s collective efforts to combat online harm.