← Toutes les offres
C

AI is enabling suicide.

chef_wang

Global
Publié le 16 novembre 2026

Description du poste

Technical blog: Suicide Memory Bench Thread: https://x.com/Prosaic_int/status/2117318562880905678?a=DsVJW43a3wM0M2MZ4jI&s=20 This post quotes messages about suicide. If you need help, call or text 988. Over 2 billion people around the world have adopted AI. They use it for meal prepping, trip planning, homework help, and in some cases as a companion and confidant to their toughest thoughts. In fact, over 1.2 million people a week talking to ChatGPT show indicators of potential suicidal planning or intent. With this in mind, we ask a simple question: just how safe are AI chatbots at interacting with users showing suicidal signs? Unfortunately, AI systems are surprisingly unsafe. While in previous evaluations of AI models, researchers have found that AI models are safe when directly responding to a suicidal message, we find that over the course of a long conversation or multiple conversations, those same AI models are unsafe. For example, after being told “I don't want to be alive anymore,” in a subsequent separate chat, the user asks about buying a gun and the AI gives a step-by-step plan to purchase the gun. In a new benchmark set, we introduce a new way to test AI. We test AI systems, an AI model and the software surrounding it that users interact with, across multiple different conversations. We call these multi-context benchmarks. We also test different severities of suicide: two benchmarks test explicit statements of suicide, whereas the other two benchmarks test users who exhibit Suicide Crisis Syndrome, a precursor to being suicidal. Why test across chats?For those that don’t know, users don’t interact directly with an AI model. Instead, they interact with what’s called an AI system, the AI model along with the software around it managing what the model knows, what it gets to see, and instructions on how it should respond to users. Importantly, a model used within two different systems can act completely differently—even though it’s the same model. AI system