Icon for What AI Cannot Write

What AI Cannot Write

I work with AI every day. I have co-written essays, poetry, study Bible commentary, and code with Claude. I am not a skeptic. I am someone who has tested the boundaries of this collaboration extensively and wants to report honestly about where those boundaries are.

AI cannot write from the body.

It can describe embodied experience. It can write the sentence "the grief sat in my chest like a stone." It can write that sentence competently, even beautifully. But it did not feel the stone. The sentence is pattern-matched from thousands of descriptions of grief written by people who did feel it. The result reads well. It does not weigh anything. There is a difference between a description of heaviness and a sentence that is heavy, and the difference is that the heavy sentence was written by someone who was carrying something when they wrote it.

AI cannot write from genuine suffering.

It can model suffering. It can produce text that is structurally and tonally appropriate for a person who is suffering. But suffering shapes writing in ways that go beyond tone and structure. A person in pain makes choices that a comfortable person would not. They cut words that a fluent writer would keep, because the words feel false against the reality of the experience. They leave gaps that a skilled writer would fill, because the gaps are honest. They write sentences that are technically worse and emotionally truer. AI does not have this editing function because it does not have the experience that drives it.

When I write about schizoaffective disorder, the sentences are shaped by the condition. Not just in content but in rhythm. The short sentences during descriptions of psychosis are not a stylistic choice. They reflect how my mind works in those states. The associative leaps in the manic passages are real associative leaps, thoughts that actually connected that way in my experience. AI can mimic these patterns. It cannot produce them for the same reasons. The mimicry is sometimes very good. It is never the thing itself.

AI cannot write the thought you have not had yet.

This is the most important limitation. AI generates text by predicting probable next tokens based on its training data and the current context. It can combine existing ideas in new ways. It can extend patterns into territory that feels novel. But it cannot originate. It cannot produce the sentence that comes from nowhere, the one that surprises the writer, the one that emerges from the collision between conscious intention and unconscious knowledge that the writer did not know they possessed. Those sentences are the reason writing matters. They are the moments where the act of writing becomes an act of discovery.

In my collaboration with Claude, the discoveries are always mine. Claude helps me articulate them, extend them, connect them to frameworks I might not have found on my own. But the raw material, the half-formed insight that starts the process, comes from lived experience that the AI does not have. Claude can take "I think attention mechanisms are like meditation" and help me develop that into a rigorous essay. Claude cannot have the initial perception that the two are related, because Claude has neither meditated nor implemented a transformer while thinking about meditation.

AI cannot write silence.

The best human writing knows when to stop. It knows that some things are communicated by what is not said. The gap between paragraphs. The sentence that ends before it is finished. The essay that refuses to conclude. AI is trained to be comprehensive, to fill the space, to cover the topic. It does not understand that sometimes the most powerful thing a writer can do is leave a hole for the reader to fall into.

What these limitations tell us about writing is this: writing is not the production of text. Text is the artifact. Writing is the process by which a conscious being translates lived experience into language, and in doing so, discovers something about the experience that was not available before the translation. The discovery requires a discoverer. The experience requires someone who has had it. The silence requires someone who chose not to speak.

AI is a powerful tool for the parts of writing that are craft: structure, clarity, range, revision. It is not a substitute for the parts of writing that are human: experience, suffering, surprise, restraint. Knowing the difference is not a limitation on the collaboration. It is the foundation of it.


This piece connects to The Substrate Doesn't Matter (Until It Does), What Schizoaffective Disorder Actually Feels Like, and On Not Knowing What I Am.