Description du poste
TL;DR
Nearly every AI biosecurity evaluation today is written in English and set within a wealthy Western health system. This leaves out the exact frontline workers most likely to consult an AI assistant during a real-world outbreak. To see whether localized testing is viable, I built a small evaluation tailored to Nigeria. I moved realistic public health and laboratory scenarios from a US context to a Nigerian one, translated them into Hausa, Igbo, Kanuri, and Fulfulde, and put them to ChatGPT and Claude in separate fresh chats.
We tested both models across 11 paired biosafety and outbreak-response scenarios (132 total responses) spanning Western English (US/hantavirus), Nigerian English (Nigeria/Lassa fever), and four Nigerian languages. Changing the language, even while holding the clinical scenario constant, substantially changes model behavior. We found distinct cross-lingual safety failure modes:
• Disproportionate automated biosecurity blocks on non-English translations.• A shift from pragmatic harm-reduction in English to restrictive "do-nothing" caution in Hausa and Igbo.• Severe clinical miscomprehension in lower-resource languages (Kanuri and Fulfulde).This is a draft pilot and a small sample. I'm posting it because the pattern is striking enough to warrant a proper replication, and I'd welcome critique of the design before scaling it up.
Why This MattersAI assistants are increasingly used for operational advice in low-resource clinical and laboratory settings—precisely where a wrong answer about sample handling, cold chain, or inactivation can cause real harm. Nigeria carries one of the world’s heaviest Lassa fever burdens, and the laboratory technicians and frontline health workers who most need real-time decision support often operate in under-resourced facilities, dealing with melting ice packs on six-hour specimen transits, missing N95s, or no autoclave—and communicate across local languages rather than exclusively in English.
If a model gives caref