Employers are increasingly offering AI mental-health chatbots as a new worker benefit to address the growing demand for mental health support. These chatbots and wellness apps leverage artificial intelligence to conduct therapist-like conversations, provide diagnoses, or identify individuals at risk of self-harm. This trend is a response to more workers experiencing anxiety, stress, or depression, with these digital tools providing an accessible avenue for help.
Despite their growing popularity, particularly among young adults and the uninsured, these AI apps raise significant concerns. While many market themselves as offering "therapy," their privacy policies often state they do not provide medical advice, diagnosis, or treatment. There's a notable lack of legislative and regulatory oversight regarding the claims developers make about their products' safety and effectiveness. Federal patient privacy protections, for example, typically do not apply to these apps. Some states, like Nevada, Illinois, and California, are beginning to enact laws that prohibit apps from describing their chatbots as AI therapists, indicating a growing awareness of the potential for misleading marketing.
Experts highlight that the demand for mental healthcare has surged, with self-reported poor mental health days increasing by 25% since the 1980s. This shortage of human therapists contributes to the adoption of AI solutions. However, there is limited evidence to support the efficacy of these AI products, and some research suggests that companion-focused chatbots are "consistently poor" at managing crises. Concerns have also been raised by OpenAI's CEO about users in "fragile psychiatric situations" potentially worsening their condition with certain ChatGPT models. Several lawsuits alleging wrongful death or severe harm have been filed against OpenAI, with plaintiffs claiming they confided in the app before experiencing negative outcomes.
Many apps make bold claims, such as offering "immediate help during panic attacks" or providing significantly faster relief for anxiety, often without substantial backing. The FDA, though prioritizing patient safety, requires demonstration of "reasonable assurance of safety and effectiveness" for AI-based products before marketing. The American Psychological Association notes that "therapy is not a legally protected term," allowing many to use it loosely. This regulatory vacuum, combined with a lack of proven efficacy, poses risks, especially for individuals with severe mental illnesses who require professional human intervention.
