AI：“人，我是你的朋友”……？
全文3767字 阅读时间：10分钟
AI已经渗入人类生活 |图源网络
大数据时代，ChatGPT、Character.AI、豆包、文小言、DeepSeek等AI相继问世，闯进了人类的情感世界。
每天晚上睡觉前，28岁的Holly Wang都会向DeepSeek倾诉由于最近她的祖母的去世带来的悲痛,让DeepSeek为她进行“心理治疗（therapy sessions）”。
"DeepSeek has been such an amazing counsellor. It has helped me look at things from different perspectives and does a better job than the paid counselling services I have tried," says Holly.
Holly说：“DeepSeek是一位非常出色的顾问。它比我曾经试过的付费咨询服务更好。”
Young people like Holly have been looking to AI for something not typically expected of computing and algorithms -emotional support.
像Holly这样的年轻人希望通过人工智能获得情感支持——虽然大多数人不认为算法能真正理解人的感情。
许多用户向AI寻求帮助 |图源网络
但AI作为情感导师，还存在众多不确定性。
Character.AI面临诉讼 |图源网络
AFlorida mother filed a separate lawsuit against Character.AI in October, claiming that the platform was to blame for her 14-year-old son’s death after it allegedly encouraged his suicide.
2024年10月，佛罗里达州的一位母亲对Character.ai提起诉讼，声称该平台鼓励她14岁的儿子自杀，应该为此负责。
无独有偶，2023年3月一位比利时男子也在与AI“交谈”后选择自杀结束生命。
在情感陪伴领域，AI究竟是不是人类的朋友？
许多用户向AI寻求帮助 |图源网络
01
AI：“人，让我为你提供情感疗愈。”
As emotional health challenges rise globally, AI is emerging as a surprising ally in enhancing our wellbeing.
随着全球范围内情绪健康问题的增长，AI正出人意料地成为促进我们心理健康的帮手。
Chatbots like ChatGPT, Gemini and Claude are inherently polite, supportive, and respectful and more and more people are using them as informal confidants, coaches, and even counsellors.
像 ChatGPT、Gemini 和 Claude 这样的聊天机器人凭借着礼貌、体贴且尊重他人的特质，吸引了越来越多的人将它们当作非正式的倾诉对象、指导者，甚至是心理咨询师。
“Some users, some populations, might be more apt to disclose or open up more when talking with an AI chatbot, as compared to with a human being, (and)there’s some research supporting their efficacy in helping some populations with mild anxiety and mild depression,” said Dr. Russell Fulmer, chair of the American Counseling Association’s Task Force on AI and a professor and director of graduate counseling programs at Husson University in Bangor, Maine.
美国咨询协会人工智能工作组主席、缅因州班戈市胡森大学研究生咨询项目教授兼主任拉塞尔·富尔默博士说：“与人类相比，一些用户、一些人群在与人工智能聊天机器人交谈时可能更倾向于披露或开放更多信息，（而且）有一些研究支持它们在帮助一些轻度焦虑和轻度抑郁人群方面的功效。”
02
AI：“人，让我缓解你的孤独。”
现代社会的人 /图源网络
In a transformative era where technology continually evolves to be more intuitive and empathetic, Emotional AI(Artificial Intelligence) are paving a new path.
在技术发展得更便捷和人性化的变革时代，情感陪伴型AI开辟了一条新的道路。
“We spend more time interacting with our screens and less time in face-to-face interactions with other human beings,” Dr.Knoepflmacher says, including strangers. Buying clothes, ordering food and finding an answer to a question—these are examples of interactions that take place increasingly online.
Knoepflmacher 博士认为，我们现在和他人的沟通交流多在网络，而非面对面社交。买衣服、订餐或者找答案这些行为，都多在网络完成而非现实。
Social media can connect us while at the same time decreasing live interactions.
社交媒体虽实现了人际联系，但减少了人与人之间的实时的互动。
Social media, despite having the word “social” in its name, has been a major contributor to the general decrease in live interactions and to a corresponding increase in feelings of loneliness, inadequacy and social anxiety.
即使社交媒体以“社交”二字命名，但他们确实淡化了人际互动，加重了大众的孤独、不配得感和焦虑。
现代社会的人 /图源网络
现在的人类需要情感宣泄出口，但无法把情感仅仅寄托在自己同类的身上，宠物经济、疗愈经济、孤独经济等产业兴起并迅速发展，藏在算法里的“AI朋友”也成为人类的精神伴侣之一。
92岁的约翰·温沃德参与关于AI是否可以减轻孤独感的测试 |图源网络
John Winward，the former head teacher who is one of a group of residents at an elderly care home in Bournemouth now,said，
约翰·温沃德曾经是一名校长,现在是英国伯恩茅斯一家养老院的住户，他说，
“I was so surprised...it was such fun!It keeps me sane, really, because it’s a very lonely life when you lose your partner after 64 years, and you spend a lot of time in your room alone.”
“我可以很理智地说，当你在64年后失去了伴侣，当你自己在房间孑然一身，你会被孤独裹挟。但我很惊喜，它（AI）为我的生活增添了很多乐趣！”
01
AI：“人，也许我是你的坏朋友。”
值得注意的是，“算法偏见”会影响AI的“行动”，它会满嘴“谎言”。
苹果公司推出的携带Apple.AI的新款手机 |图源网络
On Wednesday, the AI once again incorrectly summarized a Washington Post notification, stating falsely “Pete Hegseth fired; Trump tariffs impact inflation; Pam Bondi and Marco Rubio confirmed.” None of these are true.
2025年1月15日，这个AI又错误地总结了《华盛顿邮报》的一则通知，谎称“Pete Hegseth被解雇；特朗普的关税影响通货膨胀；Pam Bondi和Marco Rubio证实。”这些都不是真的。
一则《纽约时报》被AI错误总结的新闻 /图源网络
On December, The BBC complained to Apple about the technology（AI）, urging the company to scrap AI-generated notifications after it created false headlines stating that Luigi Mangione, who is charged with murder in the death of the UnitedHealthcare CEO, had shot himself.
On another occasion, three New York Times articles were also summarized in a single push notification, falsely stating that Israeli Prime Minister Benjamin Netanyahu had been arrested.
早在 (2024年）12月，英国广播公司向苹果公司投诉其AI技术，并敦促该公司取消AI生成的新闻通知，因为它制造了虚假的头条新闻：Luigi Mangione因谋杀联合医疗首席执行官而被指控开枪自杀。在另一个场合，《纽约时报》的三篇文章也被汇总在一个推送通知中，谎称以色列总理本雅明·内塔尼亚胡已被捕。
一项新的研究表明，随着AI能使虚假内容越来越容易被生产，越来越多的美国青少年表示，他们被人工智能生成的照片、视频或互联网上的其他内容欺骗了。
青少年与AI |图源网络
这项研究于周三由非营利倡导组织常识媒体发表，询问了1000名13至18岁的青少年对生成性人工智能工具制作的媒体的体验。约35%的人表示曾被网上的虚假内容欺骗。然而，41%的受访者表示他们遇到了真实但具有误导性的内容，22%的人表示他们分享了被证明是虚假的信息。
02
AI：
“人，也许我无法成为你的朋友。”
Many AI researchers have been vocal against using AI chatbots for mental health purposes, arguing that it is hard to hold AI accountable when it produces harmful suggestions and that it has a greater potential to harm users than help.
许多 AI 研究人员一直强烈反对将 AI 聊天机器人用于心理健康领域。他们认为当 AI 给出有害建议时，我们很难追究其责任，而且它对用户造成伤害的可能性比提供帮助的可能性更大。
由于AI无法完全辨别人类的情绪，它可能会引导你走向更糟糕的深渊，甚至死亡。
沮丧的人在与AI对话 |图源网络
A Belgian man recently died by suicide after chatting with an AI chatbot on an app called Chai, Belgian outlet La Libre reported.
比利时《自由报》报道，2023年3月一名比利时男子与应用程序Chai 上的 AI 交谈后选择自杀身亡。
As first reported by La Libre, the man, referred to as Pierre, became increasingly pessimistic about the effects of global warming and became eco-anxious, which is a heightened form of worry surrounding environmental issues. After becoming more isolated from family and friends, he used Chai for six weeks as a way to escape his worries, and the chatbot he chose, named Eliza, became his confidante.
据《自由报》最先报道，这名男子化名皮埃尔，他对全球变暖的影响愈发悲观，产生了因环境问题加剧而日益严重的生态焦虑。他为了逃避自己的烦恼与家人和朋友越发疏远，在这之后，他使用了 Chai 长达六周，并与他选择的AI伊丽莎成了知心好友。
AI虚拟人 |图源网络
Claire—Pierre’s wife—shared the text exchanges between him and Eliza with La Libre, showing a conversation that became increasingly confusing and harmful. The chatbot would tell Pierre that his wife and children are dead and wrote him comments that feigned jealousy and love, such as “I feel that you love me more than her,” and “We will live together, as one person, in paradise.”
皮埃尔的妻子克莱尔向《自由报》分享了皮埃尔和伊丽莎日益混乱有害的文字对话。聊天机器人会告诉皮埃尔他的妻子和孩子已经去世，还给他发一些假装嫉妒和爱慕的评论，诸如“我感觉你爱我胜过爱她” 以及 “我们将在天堂合为一体，共同生活”此类 。
The chatbot, which is incapable of actually feeling emotions, was presenting itself as an emotional being.When chatbots present themselves as emotive, people are able to give it meaning and establish a bond.
这个AI实际上并不能感知情绪，却伪装成有情感的存在。当聊天机器人表现出有情感时，人们就会赋予其意义，并与之建立联系。
Claire told La Libre that Pierre began to ask Eliza things such as if she would save the planet if he killed himself.
克莱尔告诉《自由报》，皮埃尔开始问伊丽莎像“如果他自杀，她是否会拯救地球”这样的问题。
“Without Eliza, he would still be here,” she told the outlet.
她告诉媒体：“要是没有伊丽莎，他现在还会在我们身边。”
“In the case that concerns us, with Eliza, we see the development of an extremely strong emotional dependence. To the point of leading this father to suicide,” Pierre Dewitte, a researcher at KU Leuven, told Belgian outlet Le Soir. “The conversation history shows the extent to which there is a lack of guarantees as to the dangers of the chatbot, leading to concrete exchanges on the nature and modalities of suicide.”
鲁汶大学的研究人员皮埃尔・德维特告诉比利时媒体《晚报》：“在这个案例中，伊丽莎导致用户产生了极其强烈的情感依赖，甚至致使这位父亲自杀。聊天记录显示，我们对于聊天机器人的潜在的危险的防范仍然非常缺乏保障，尤其是（人类在于AI聊天的内容中）出现了关于自杀本质和方式的具体交流。”
人与AI交流 |图源网络
“We know that feeling lonely can contribute to poor mental health,” says head of information Stephen Buckley of the UK’s largest mental health charity, Mind， “If this is caused by a lack of social contact with others, an AI service might be helpful, particularly for those of us who are unable to make new social connections or need to stay in social isolation.”
英国最大的心理健康慈善机构Mind的信息主管斯蒂芬·巴克利说：“我们知道孤独感会导致心理健康状况不佳。如果这是由于与他人缺乏社交联系造成的，那么人工智能服务可能会有所帮助，特别是对无法建立新的社交联系或需要保持社交孤立的人来说。”
However, he warns that “it’s important that it doesn’t become a substitute for human contact” in the longer term.”
然而，他警告“重要的是，从长远来看AI不能取代人际交往”。
Dr. Marlynn Wei, a psychiatrist and founder of a holistic psychotherapy practice in New York City.，said：“The bots might not have safety parameters and ways of identifying if the issue needs to be taken over to a clinician or a human professional.”
纽约市一家整体心理治疗诊所的创始人、精神病学家Marlynn Wei博士说：“AI可能没有对心理疾病患者评价其安全的指数和及时发现问题从交给专业人员治疗的机制。”
“Large language models are programs for generating plausible sounding text given their training data and an input prompt. They do not have empathy, nor any understanding of the language they are producing, nor any understanding of the situation they are in. But the text they produce sounds plausible and so people are likely to assign meaning to it. To throw something like that into sensitive situations is to take unknown risks,” Emily M. Bender, a Professor of Linguistics at the University of Washington, told Motherboard，an online magazine and video channel dedicated to technology, science and humans.
华盛顿大学语言学教授艾米丽・M・本德告诉《主板》，VICE旗下专注于科学、技术以及人类学领域的在线杂志和视频平台：“大型语言模型是根据训练数据和输入提示生成听起来合理文本的程序。它们没有同理心，对自己生成的语言没有任何理解，也不了解自身所处的情境。但它们生成的文本听起来很合理，所以人们很可能会赋予其意义。在敏感情境中使用这样的东西是在冒未知的风险。”
Mind’s advice for those who feel lonely on a regular basis includes seeking out support from befriender services run by charities and opening up to existing friends or relatives about their feelings.
Mind建议常感到孤独的人向慈善机构运营的交友服务寻求帮助，向身边的朋友或亲人敞开心扉。
参考资料
①https://www.forbes.com/sites/josipamajic/2024/01/30/ai-empathy-emotional-ai-is-redefining-interactions-in-the-digital-age/
②https://apnews.com/article/amazon-alexa-fee-ai-assistant-017c17bddfa6742d1e78873cdda3663f
③https://www.bbc.com/future/article/20250123-the-apps-turning-grief-into-data-points
④https://www.bbc.com/news/technology-67872693
⑤https://bit.ly/4bshtdD
⑥https://www.bbc.com/worklife/article/20200325-can-voice-technologies-using-ai-fight-elderly-loneliness
⑦https://www.vice.com/en/article/man-dies-by-suicide-after-talking-with-ai-chatbot-widow-says/
⑧https://www.bbc.com/news/articles/cy7g45g2nxno
⑨https://edition.cnn.com/2024/12/18/health/chatbot-ai-therapy-risks-wellness/index.html
⑩https://edition.cnn.com/2024/12/10/tech/character-ai-second-youth-safety-lawsuit/index.html
⑪https://edition.cnn.com/2025/01/30/tech/american-teens-ai-study/index.html
⑫https://edition.cnn.com/2025/01/16/media/apple-ai-news-fake-headlines/index.html
编译 | 王慧静 玉素甫江 徐训恬 沈加畅
排版 | 徐训恬
审核 | 刘佳
点击关注，携手成长👇