logo

Death of the Dark Room: How Generative AI Broke Enterprise It's Political Cover

Posted by chris-d |2 hours ago |2 comments

Terr_ 2 hours ago

> Generative AI goes further. It changes evaluative capacity. A director who cannot read an architecture diagram can still form a direct judgement about a summary, a search result, a recommendation, a draft, or a chatbot answer.

It may technically be a "direct" judgement... except it's judging a very indirect artifact, one that likely has absolutely no review or validation by any human with any domain-knowledge or involvement.

We should be careful to distinguish between the capabilities it actually gives people versus the capabilities they assume they've obtained.

> The board does not need a technically valid comparison to demand an explanation. It only needs a comparison that feels legible.

Right, whether the "summary" is correct or not, it's presence will affect what happens. I'm reminded of the British television comedy "Yes Minister", where certain manipulative bureaucratic characters are very aware of how such things can shape outcomes.

chris-d 2 hours ago

For thirty years, a failed ERP could be buried inside an architecture diagram. A failed AI chatbot gets screenshotted and forwarded to the board before lunch. That's the shift this piece is about.

But the part I find more interesting is the second fear – not that AI fails visibly, but that it succeeds visibly. A system that genuinely compresses legal review time or automates reporting doesn't just create efficiency. It makes existing roles and empires contestable. And that's when the corporate immune system kicks in: it won't be compatible, it can't be done here, it will take years, it's probably illegal, who takes responsibility.

The result is what I call the controlled mediocrity trap – organisations deploying AI that's good enough to avoid embarrassment but not so effective that it threatens anyone. 74% of CIOs in Dataiku's 2026 survey regretted at least one major AI platform decision. I think a lot of that regret is political, not technical.

I suspect this is more common than people admit...