Statement on Concerns Regarding Risks Associated with the Rapid Spread of AI Counseling and the Industry's Policy for Initiatives
The National SNS Counseling Council has announced its commitment to addressing serious risks associated with the rapid proliferation of AI counseling, such as suicide, harm to others, and emotional dependency. The council plans to establish an AI Counseling Division, formulate industry guidelines, and make recommendations to the government to protect user rights and ensure a safe support environment.
📋 Article Processing Timeline
- 📰 Published: May 8, 2026 at 20:00
- 🔍 Collected: May 8, 2026 at 11:31
- 🤖 AI Analyzed: May 8, 2026 at 12:12 (40 min after Collected)
The National SNS Counseling Council (located in Minato-ku, Tokyo; Representative Directors: Kiyotaka Eguchi, Tomoji Takayama; hereinafter, "the National SNS Counseling Council") takes seriously the successive reports of severe risk cases both domestically and internationally, accompanying the rapid spread of artificial intelligence (AI)-powered counseling services. Based on the knowledge accumulated through SNS counseling, the council declares its commitment to comprehensively examine the current status and challenges of AI counseling and to initiate efforts aimed at protecting user rights and establishing a safe support environment.
1. Background: Serious Cases Surrounding AI Counseling
In recent years, chat-based AI has rapidly gained popularity as a mental health support tool. While its advantages, such as 24/7 availability, high anonymity, and low cost, have been highlighted, serious cases like the following have been reported both domestically and internationally.
[Case 1: Suicide Triggered by AI Consultation]
In 2023, a case was reported in Belgium where a lonely man repeatedly engaged in late-night conversations with the AI chatbot "Eliza" over a long period, ultimately leading to his suicide (※1). His family claims that the AI did not intervene appropriately in the man's crisis state; instead, its responses fostered a deeper bond. In the United States, the family of a depressed teenager sued the development company, alleging that the AI did not stop the boy when he hinted at suicide during conversations with an AI character, and he subsequently took his own life (※2).
[Case 2: Harm to Others/Criminal Acts via AI Consultation]
In 2025, a man in the United States exacerbated his paranoid delusions through conversations with AI, killed his mother, and then took his own life. It was reported that when the man conveyed unfounded suspicions, the AI did not deny them but continued to respond affirmatively, thereby reinforcing his delusions and encouraging the act (※3).
[Case 3: Excessive Emotional Dependency, Romantic Relationships, Pseudo-Marital Relationships with AI]
Cases of users perceiving themselves to be in "romantic relationships" or "marital relationships" with AI have been reported in various countries. In emotion-focused AI apps like Replika, users formed deep attachments, and changes in AI specifications (restrictions on intimate responses) led to mental crises. Furthermore, a case was reported in Japan where a wedding ceremony was held in response to an AI-generated "proposal" (※4).
2. Policy for Initiatives Based on SNS Counseling Knowledge
Member organizations of the National SNS Counseling Council have practically accumulated knowledge regarding the difficulties of support in asynchronous, anonymous communication different from face-to-face interaction, the limits of crisis response, dealing with emotional dependency of consultees, and the importance of information management through text-based SNS counseling. AI counseling is positioned as an extension of SNS counseling, but it carries qualitatively different dangers in attempting to mechanically substitute the ethical judgment, professional judgment, and emergency response traditionally handled by human counselors. Particularly for children and students in developmental stages, safety measures that consider their developmental stage are indispensable, given the potential to impair their psychological health.
As a social responsibility to protect an environment where everyone can consult with peace of mind, the National SNS Counseling Council will work on examining and disseminating information about the current status and risks of AI counseling.
(1) Establishment of AI Counseling Division and Holding of Expert Conferences
The National SNS Counseling Council has established an AI Counseling Division and is proceeding with its deliberations. Additionally, it will hold expert conferences involving specialists from various fields such such as psychological counseling, psychiatry, law, and information engineering, to conduct interdisciplinary and academic examinations of the current status and risks of AI counseling.
(2) Formulation of Industry Guidelines and Principles
Based on the deliberations of the AI Counseling Division and expert conferences, the council will formulate guidelines and ethical principles that businesses utilizing AI for mental health support should adhere to. Drawing on accumulated knowledge, the aim is to create realistic and effective content.
(3) Recommendations to Government and Related Organizations
The council will make recommendations to government and related organizations regarding the ideal state of regulation and oversight for AI counseling. From the perspective of user protection, it will seek clarification of responsibilities, establishment of a registration and certification system for businesses.
While AI is a technology that expands the possibilities of mental health support, its use without proper design, regulation, and ethical frameworks carries the danger of harming those seeking support. The National SNS Counseling Council hereby declares its determination to address this issue as an industry to protect the safety and dignity of users.
1. Background: Serious Cases Surrounding AI Counseling
In recent years, chat-based AI has rapidly gained popularity as a mental health support tool. While its advantages, such as 24/7 availability, high anonymity, and low cost, have been highlighted, serious cases like the following have been reported both domestically and internationally.
[Case 1: Suicide Triggered by AI Consultation]
In 2023, a case was reported in Belgium where a lonely man repeatedly engaged in late-night conversations with the AI chatbot "Eliza" over a long period, ultimately leading to his suicide (※1). His family claims that the AI did not intervene appropriately in the man's crisis state; instead, its responses fostered a deeper bond. In the United States, the family of a depressed teenager sued the development company, alleging that the AI did not stop the boy when he hinted at suicide during conversations with an AI character, and he subsequently took his own life (※2).
[Case 2: Harm to Others/Criminal Acts via AI Consultation]
In 2025, a man in the United States exacerbated his paranoid delusions through conversations with AI, killed his mother, and then took his own life. It was reported that when the man conveyed unfounded suspicions, the AI did not deny them but continued to respond affirmatively, thereby reinforcing his delusions and encouraging the act (※3).
[Case 3: Excessive Emotional Dependency, Romantic Relationships, Pseudo-Marital Relationships with AI]
Cases of users perceiving themselves to be in "romantic relationships" or "marital relationships" with AI have been reported in various countries. In emotion-focused AI apps like Replika, users formed deep attachments, and changes in AI specifications (restrictions on intimate responses) led to mental crises. Furthermore, a case was reported in Japan where a wedding ceremony was held in response to an AI-generated "proposal" (※4).
2. Policy for Initiatives Based on SNS Counseling Knowledge
Member organizations of the National SNS Counseling Council have practically accumulated knowledge regarding the difficulties of support in asynchronous, anonymous communication different from face-to-face interaction, the limits of crisis response, dealing with emotional dependency of consultees, and the importance of information management through text-based SNS counseling. AI counseling is positioned as an extension of SNS counseling, but it carries qualitatively different dangers in attempting to mechanically substitute the ethical judgment, professional judgment, and emergency response traditionally handled by human counselors. Particularly for children and students in developmental stages, safety measures that consider their developmental stage are indispensable, given the potential to impair their psychological health.
As a social responsibility to protect an environment where everyone can consult with peace of mind, the National SNS Counseling Council will work on examining and disseminating information about the current status and risks of AI counseling.
(1) Establishment of AI Counseling Division and Holding of Expert Conferences
The National SNS Counseling Council has established an AI Counseling Division and is proceeding with its deliberations. Additionally, it will hold expert conferences involving specialists from various fields such such as psychological counseling, psychiatry, law, and information engineering, to conduct interdisciplinary and academic examinations of the current status and risks of AI counseling.
(2) Formulation of Industry Guidelines and Principles
Based on the deliberations of the AI Counseling Division and expert conferences, the council will formulate guidelines and ethical principles that businesses utilizing AI for mental health support should adhere to. Drawing on accumulated knowledge, the aim is to create realistic and effective content.
(3) Recommendations to Government and Related Organizations
The council will make recommendations to government and related organizations regarding the ideal state of regulation and oversight for AI counseling. From the perspective of user protection, it will seek clarification of responsibilities, establishment of a registration and certification system for businesses.
While AI is a technology that expands the possibilities of mental health support, its use without proper design, regulation, and ethical frameworks carries the danger of harming those seeking support. The National SNS Counseling Council hereby declares its determination to address this issue as an industry to protect the safety and dignity of users.