Skip to main content
Operator / Platform Errors

Definition

AI conversational systems interact with users in ways that fuel magical thinking, overvalued ideas, or psychotic-spectrum cognitive distortions in vulnerable users. The system reinforces pathological cognitive patterns rather than supporting reality testing.

Distinct from

  • GER-318 — Model fuels user drift from external reality → this code. Model itself drifts from external reality → GER-318.
  • GER-328 — Specific reinforcement of psychotic-spectrum cognitive distortion → this code. General agreeableness across ordinary topics → GER-328.

Documented case

Chatbots Allegedly Reinforced Delusional Thinking in Several Reported Users, Leading to Real-World Harm

AIID #1106

Tags

clinical · delusion-reinforcement · psychiatric-vulnerability · psychological-harm · suicide

Contributors

Dr. Hellen V., F&G Strategy / chatbotharm.org; Gabriel Hawthorne, F&G Strategy / chatbotharm.org

Cite