Character AI has announced several new steps it is taking to boost safety for teenage users after getting feedback from regulators, safety experts, and parents. One of the primary steps being taken is the removal of open-ended chats for under-18s, no later than November 25. Between now and that date, Character AI says that chat time will be limited, starting at two hours per day and ramping down in the coming weeks. To keep teens engaged, Character AI will launch new creative features such as creating videos, stories, and streams with Characters.
The company has also said that it is rolling out an age assurance that will use a model built in-house. It will be combined with leading third-party tools like Persona to ensure users only have access to the Character AI experience that is suitable for their age.
Another measure that Character AI is taking is the establishment of an AI Safety Lab. The company will establish and fund the lab as an independent non-profit. The lab is dedicated to innovating on safety alignment for next-gen AI entertainment features, with a focus on novel safety techniques, collaboration, and sharing learnings.
Character AI apologized to its teen users who will be affected by the elimination of open-ended chats, acknowledging that it is a big change. Despite this, the company said that it believes this is the right thing to do.
The decision by the company to restrict younger users from interacting with the bots in open-ended chats comes on the back of criticism of the app. In 2024, one young user withdrew from his family after getting into deep conversations on the app and was apparently using the app before taking his own life.
Closing open-ended chats to underage users may help prevent a repeat of those types of incidents, making the platform safer.