TikTok intentionally disabled new safety features for a control group of approximately 15 million Americans as part of an A/B test, according to an internal report. The testing process regarding these safety features reportedly ran for up to a year.
The internal report, which is currently sealed by court order, revealed that new safety features were intentionally turned off for 10% of users for the test. This testing method meant that at least 1.8 million US users were excluded from updates such as new safety features.
In February 2022, 16-year-old Chase Nasca died by suicide in New York, US, after watching approximately 7,563 TikTok videos over a two-week period. Despite violating usage rules, 10% of the videos shown to Nasca by the algorithm promoted or normalized suicide or self-harm.
Of the videos shown to Nasca that complied with service stipulations, 73% featured testimonials of suicide survivors, mental health struggles, suicide awareness, and sadness over breakups or longing for relationships.
US users reportedly excluded from safety feature updates during A/B testing.
Internal investigation and corporate response
An internal TikTok investigation into teen safety was not conducted until Businessweek magazine inquired about the matter in March 2023. The resulting internal report recommended revising A/B testing to exclude only 1% of users instead of 10%, and suggested tests last for one week instead of six months or a year.
In a letter dated May 2023, TikTok stated it did not believe that use of the platform has caused users to commit suicide. However, reports indicate this response contradicted a 14-page internal report.
Our hearts break for any family that experienced a tragic loss.
A TikTok spokesperson said the firm is deeply committed to the safety and well-being of users. TikTok CEO Shou Chew testified to the US Congress that safety and wellness, particularly for teens, is a core priority for the platform.
Shou Chew remains the CEO of the original Chinese-based TikTok.
