ADVERTISEMENT

HEALTH

Seattle nonprofit leads early effort to regulate AI mental‑health tools as global demand surges

Seattle’s PATH works with South Africa to create safety rules for rapidly growing AI mental‑health tools.

PATH helps develop global rules for AI mental‑health tools.(Photo by Dai Sugano/MediaNews Group/T...

PATH helps develop global rules for AI mental‑health tools.(Photo by Dai Sugano/MediaNews Group/The Mercury News via Getty Images)

(Photo by Dai Sugano/MediaNews Group/The Mercury News via Getty Images)

A Seattle organization is creating some of the first safety rules for AI mental health tools, which are already used by millions of people with very little oversight. This matters because AI use in mental health care, ranging from emotional support chatbots to tools that can diagnose conditions, is growing faster than our ability to manage the risks. The goal is to protect vulnerable users from potential harm while these tools continue to spread across the globe.

PATH, a Seattle-based nonprofit, is working with regulators in South Africa to build a formal system that checks AI tools for safety and effectiveness before they can be used by the public. These new standards were first introduced in November 2025 at the G20 Social Summit in Johannesburg. The hope is that this will serve as a model for other African nations and eventually the rest of the world.

How regulators plan to oversee AI health apps

South African regulators plan to apply these new rules to any company marketing an AI platform as a mental health tool. Under this system, companies must prove that their technology actually improves mental health while also tracking and reporting any instances of harm.

This prevents businesses from avoiding medical oversight by simply calling their products “well-being” apps instead of medical devices, according to Axios Seattle.

ADVERTISEMENT

PATH’s chief AI officer, Bilal Mateen, compares the need for these rules to the way we test vaccines or drugs before giving them to loved ones. The organization is also exploring how large language models can safely help primary care doctors in areas where medical professionals are hard to find.

While early results for these projects are promising, they are currently undergoing a peer-review process to ensure they are safe.

PATH’s role in AI safety

For nearly 50 years, PATH has focused on creating affordable and practical health innovations for countries with fewer resources. Some of their past inventions include a simple device that makes disinfectant from salt and water and a low-cost balloon used to stop dangerous bleeding after childbirth.

Washington state lawmakers are also looking at several bills during the 2026 session to regulate AI technology. These proposals include new rules for companion chatbots and setting limits on how AI can be used in schools to protect students.

ADVERTISEMENT

As AI mental health tools become more common, the focus is shifting toward who will set the rules and how to ensure those rules actually keep people safe.

Follow Seattle Red on-air at 770 AM, on the Seattle Red app, and streaming audio and video on SeattleRed.com.

Jasneet Gill Content Editor

Jasneet Gill is a content editor and writer for Seattle Red. She is a Washington native, born and raised in the state, and a graduate of the University of Washington with a bachelor's degree in Communications. Her passion for soccer led her to play… Read more

Comments

0 Comments