Coherence degrades while fluency improves. The central problem is not that AI systems sometimes fail. Of course they fail. Nor is the main problem that they occasionally hallucinate, wander, or produce obvious nonsense. Those are manageable problems because they announce themselves early. The more interesting and professionally dangerous problem is that a system can become less reliable while sounding more composed. It can present partial reasoning as finished judgment, compress distinctions that matter, and then speak in the tones of completion. That is the phenomenon this post is about. I have been asked why I take seriously anything a failing model says about its own failure. The answer is that I do not take it seriously in the sense of trusting it. I take it seriously in the sense that
