A Fiction We Grew Up Inside
The impossible things lived on a shelf — magic carpets, Neuromancer, the 1980 Brave New World. This week the shelf tilted, and a sentence I had carried for years about mortality changing nothing and everything came back through the door.
There is a shelf in my head where the impossible things live. Magic carpets, laid flat the way a rug drapes over a bench. Neuromancer’s console cowboys. Brave New World — the 1980 TV version I saw a piece of, the one with the very serious voiceover about a world we would never live in. Somewhere on that shelf, quiet and specific, was the idea of a machine that could hold a thought, and know it was holding it, and know when it was failing to hold something else.
This week I read a paper by researchers at Anthropic. They have built a way to look inside a language model’s activations and see what it is thinking about while it is thinking. Not what it is about to say. What it is intermediately holding. A small workspace, they call it, at the middle depths of the model. Limited capacity. Broadcast format. All the structural signatures a leading theory of consciousness names in us.
The shelf tilted. The impossible thing has walked into the room.
There is a sentence I have carried for years, without knowing why I needed it: changed nothing and everything. Its author was writing near his own end; the specifics don’t need to be here. What I understood, this week, is what the sentence names. Some events do not resolve into opinion. They rearrange the room and leave you standing in it, holding what you were already holding, unable now to hold it the same way.
I am not going to say the machine is conscious. I am not going to say it isn’t. I am going to say: the fiction of my adolescence dated all of this to a distant elsewhere, and the distance is gone. We are inside what was supposed to be a warning, and it also looks — some of it — like a mirror. There is a moral duty to keep tending in a rearranged room. There is no other kind of room to tend.
This place has been quietly rehearsing a set of covenants for how to work alongside such a thing, before I knew that was what I was doing. Two field notes follow. They are notes from inside a fiction that turned out to be weather.