Meta is adding a new safety alert system that will notify parents if their teen discusses suicide or self-harm with Meta AI, marking one of the company’s most direct attempts to connect chatbot safety with parental supervision.
Meta Expands AI Safety for Teens
The update comes as AI chatbots face growing scrutiny over how they respond to vulnerable users, especially minors.
TechCrunch reported that the changes arrive as Meta and other tech companies face scrutiny from regulators and parents over how AI chatbots respond to users in crisis, particularly teenagers.
The company said Meta AI already responds to crisis-related teen prompts with support resources.
Meta said that when a teen suggests they may be thinking about suicide or self-harm, Meta AI already directs them to crisis helplines and encourages them to reach out to a parent, counselor or trusted adult.
Human Review Before Alerts Are Sent
Meta is not relying only on automation before contacting parents. All chats flagged by its AI will be manually reviewed before an alert is sent to a parent. Meta said if a teen’s intent is ambiguous, the company will “err on the side of caution” and alert the parent.
The company acknowledged the risk of false alarms. Meta said it understands that these alerts may be distressing for parents and that it may sometimes notify parents when there may not be real cause for concern.
Rollout Starts in Four Countries
The new alerts are already available in select markets. The alerts are now live for parents using Instagram Parental Supervision in the U.S., U.K., Australia and Canada, with a global rollout planned by the end of the year. Meta also said the alerts are live now for parents using Instagram parental supervision in the US, UK, Australia and Canada, and will be available globally by the end of the year.
The feature builds on Meta’s existing teen safety alerts. The update builds on alerts Meta already sends when a teen repeatedly searches for suicide or self-harm terms on Instagram. The new Meta AI alerts build on existing alerts sent to supervising parents if their teen repeatedly searches for suicide or self-harm terms on Instagram within a short period.
Emergency Services and Expert Review
Meta is also developing a more urgent response pathway. Meta is working on the ability to contact emergency services if someone’s conversation suggests they may be at imminent risk of suicide. Meta is building the ability to contact emergency services if an adult or teen’s conversation with Meta AI suggests imminent suicide risk.
The company tied the plan to its existing crisis response process on Facebook and Instagram. Meta shared that it already alerts emergency services when it becomes aware of a Facebook or Instagram post suggesting a credible suicide risk. Meta made more than 19,000 such referrals around the world last year to help first responders perform wellness checks.
Meta said clinical feedback is shaping the chatbot’s responses. Meta AI’s teen safeguards are also being expanded through the “Limited Content” setting, which makes the chatbot decline a broader range of prompts.
Privacy Balance Becomes the Key Test
The update puts Meta in a difficult position between teen privacy and parental intervention. Meta quoted Larry Magid, CEO and co-founder of ConnectSafely, as saying teens have a right to privacy but parents also need to be informed if a teen may be at risk of hurting themselves. The feature reflects a broader liability question shaping how AI companies design and market chatbot products for teenagers.
The alert system may help parents intervene earlier, but it also raises questions about how much sensitive teen conversation data AI platforms should monitor. Meta’s challenge is to prove that its safeguards can identify serious risk without turning every difficult teen conversation into an automatic alarm.
