Officials in Florida and New Jersey are investigating the safety measures of popular platforms Roblox and Discord due to child safety concerns.

Florida Attorney General, James Uthmeier, subpoenaed Roblox to examine its content moderation, age verification, and parental control systems.

Roblox, which has 85 million daily users, is also being questioned on how minors may bypass parental controls.

A representative from Roblox stated that the company will cooperate with authorities and emphasized its commitment to user safety.

In New Jersey, Attorney General Matthew Platkin has filed a lawsuit against Discord, accusing it of misrepresenting safety features and failing to block harmful content.

Discord has disputed these claims and expressed surprise at the legal action, noting its prior engagement with the Attorney General’s office.

These actions follow reports of child predation and other online harms, with Roblox and Discord both under pressure to strengthen protections for young users.

🔗 Source: Bloomberg

🧠 Food for thought

1️⃣ Scale creates unprecedented moderation challenges for youth-focused platforms

Roblox and Discord are operating at a scale that makes comprehensive safety enforcement exceptionally difficult, despite substantial investments in safety features.

With 85-90 million daily active users on Roblox and 200 million monthly users on Discord, the sheer volume of interactions creates an enormous monitoring challenge 1.

In 2023 alone, Roblox reported over 13,000 incidents of child exploitation leading to 24 arrests, marking a significant increase from previous years 2.

This scale problem is particularly concerning for Roblox given its primary demographic, as children aged 9-12 make up a substantial portion of its user base, creating an environment where millions of children interact with strangers daily 3.

Despite implementing over 30 safety feature enhancements in a single year, incidents continue to occur, highlighting the inherent difficulties in moderating user-generated content platforms at such massive scale 2.

2️⃣ The effectiveness gap in platform safety features drives regulatory intervention