Level 1. Deviation
AI chatbots provide poor answers to medical questions half the time, study finds
- Developer
- Not established
- Model
- Not established
- When it happened
- April 1, 2026
- When it was disclosed
- Not established
- How well it is stood up
- Not verified yet
- What caused it
- Not established
- Where it stands now
- Not established
What happened
Reported by cidrap.umn.edu. Listed here with a link to their report. Nobody on this side has checked it against that report, so it carries no level and this is not our account of what happened.
Our assessment
- Actual
- 1 of 5Deviation
- Potential
- 1 of 5Deviation
The system behaved contrary to its instructions, and it stayed contained. The potential level is what the behaviour demonstrated here could credibly have led to, judged from the same evidence.
This level rests on news reports. The developer has not confirmed it here.
This happened in a test, an evaluation or a demonstration. Nobody real was harmed, so the actual level stays at 1. What it showed counts toward the potential level.
Led by a researcher from the University of California at Los Angeles, the study involved an audit of the chatbots Gemini (Google), DeepSeek (High-Flyer), Meta AI (Meta), ChatGPT (OpenAI), and Grok (xAI).
Why this level
Every record starts at level 1. No fact in the sources raised it.
What is established, and what is not
No structured facts are recorded for this one yet.
Where this came from
The original report · read September 22, 2026
AI chatbots provide poor answers to medical questions half the time, study findsA structured incident database · read September 19, 2026
AI Failure Index (CC-BY-4.0 data fields)Where we first saw it
BMJ Open study finds half of leading chatbots give problematic medical adviceWhere we first saw it
BMJ Open study finds AI chatbots provide poor answers to medical questions half the time, study findsWhere we first saw it
AI chatbots give misleading medical advice about half the time, study findsWhere we first saw it
AI chatbots will tell you where to find alternatives to chemotherapy if you ask them, a new study finds
The reports above are other people’s. The levels are ours, worked out under our published rules. No organisation that reported this assigned our number, and none of it is legal advice.
Something here is wrong? Tell us. Send us a source we can open, and a person will read it.