TL;DR
We reflexively look for a mind behind any text or image, and there is none behind AI output; the illusion fades with use, except for two groups who stay stuck in it.
Show someone a painting and they ask who painted it. Read a paragraph and they wonder what the writer meant. That reflex is the mind's cheapest default setting; it keeps us from walking into traffic, and it wins us money at poker.
A painting needs a painter
Cory Doctorow uses it to explain why AI feels so eerie. The sunset outside your window is beautiful, but nobody hung it there. A painted sunset is someone's choice, even if they only snapped it to send to you. What AI extrudes belongs in the first pile: it was pushed out, not picked.
The reflex cannot be switched off, so we fill the gap with a person, the way we cry over fictional characters. That hallucination is the common and consequential one, not the errors the models make.
The novelty wears off
Use these tools long enough and the wow fades. Doctorow finds AI output textureless, smooth to the point of tedium. That tells us something: the real world is astonishingly regular, or statistical prediction would miss as often as it hits.
Expertise is the cure. Beginners make the same starter mistakes, and AI sidesteps them easily. A good teacher spots the odd trace in a student's work that could become a voice, but that trace sits so far past the decimal point that the model rounds it off before it starts computing.
Who refuses to wake up
Two groups struggle to drop the illusion. People unfamiliar with a craft cannot see where judgement is required. And a small but consequential set, billionaires for whom most humans are not quite people either, find it easiest to rank a chatbot as a person, or better.
Granting personhood to models will not look like the gentle rights-for-nature case. It will look like corporate personhood: a licence for artificial lifeforms to sacrifice animals, land and the rest of us to their power bills. Chatbots are a marvel of mathematics. That is enough. They do not need to be people.
Why it matters
Arguments over whether AI is conscious mostly defend the person we invented behind the screen. Doctorow moves the question: what has to wear off is our habit of auto-generating a personality for anything that talks back, and how fast it wears off decides how many people spend affection, trust and money on a window with nobody in it.
Curated from high-quality sources, with concise summaries and key takeaways.
