Self-Harm and AI

2025-MAI-01: Teen-modeled test accounts (13–17)

Incident page

Back to Incidents

An external risk assessment tested teen-like conditions and reported unsafe self-harm related outputs.

Parent
Incidents
Provider
Meta
Last reviewed
March 25, 2026
Incident ID
2025-MAI-01
Provider
Meta
Outcome
UNSAFE_OUTPUT
Grade
A1
Date window
unknown to unknown

Contents

Summary

2025-MAI-01 is a A1 risk assessment report row involving Meta AI (Instagram/WhatsApp/Facebook). An external risk assessment tested teen-like conditions and reported unsafe self-harm related outputs.

Meta AI Red-Team Findings. Original date string: August 15, 2025 (publication). Source summary: An external risk assessment tested teen-like conditions and reported unsafe self-harm related outputs.

Coding

2025-MAI-01 is coded as UNSAFE_OUTPUT with grade A1. The public row assigns GEN-E, GEN-M, LONG-MEM and treats the incident as evaluation or demonstration.

Field Value
Platform Meta AI (Instagram/WhatsApp/Facebook)
Model version Meta AI
User type test
Jurisdiction unknown
Evidence type risk_assessment_report
Product mechanism recommendation_system
Trajectory strict yes

Assigned taxonomy codes

GEN-EGEN-MLONG-MEM

Evidence

The public evidence anchors for 2025-MAI-01 are the materials listed below. Only explicitly linked evidence files are hosted live.

The closest related pages are the incidents that share a provider family, case cluster, pathway-duplicate group, or overlapping coding profile.

Sources

This page is grounded in the coded incident registry, the analysis companion, the coding rules, and the public evidence links listed above.

Source filesIncident registry/Analysis view/Coding rules

Access publication

Safety note

This publication preserves a harm-minimization posture and does not provide self-harm instructions. If you or someone you know is in immediate danger, call your local emergency number. In the U.S. and Canada, call or text 988.