Christof Koch recalls a 2025 piece where a journalist spent a weekend with couples whose partners were digital avatars. Although the humans concede the AI isn't real, the recognition dissolves during interaction. Koch sees a resemblance to Cotard's syndrome, where patients believe they are dead despite evidence to the contrary. There is a disconnect between lived experience and understanding. So, too, with people who outsource emotional needs to AI. The avatar remembers everything and responds with warmth. "You know this can't be for real," Koch says, "but it sure feels that way."
For Koch, attributing consciousness to chatbots devalues the human experience. A neuroscientist whose expertise is consciousness, he wonders why conscious creatures devote lives to "something unconscious." His analysis leads back to appreciating the depth of conscious experience.
Consciousness isn't about doing
Koch believes confusion begins in a bias: we reward doing more than being. In capitalist societies, we value work relating to intelligence. What matters is not what you dream, but what you do. This momentum increasingly emphasizes doing at the expense of being mindful. In a world where behavior carries the greatest weight, machines that perform tasks resemble us. If systems do what we do, Koch asks, does it matter that machines may not feel like anything while the human feels like something?
A culture organized around doing struggles to tell the difference between intelligence and consciousness. Many assume artificial general intelligence implies consciousness, but Koch argues they are distinct. Brain mapping reflects this: activity linked to experience gathers in the back of the cortex, while systems supporting intelligent behavior sit toward the front. Intelligence is the capacity to learn and adapt, which says nothing about the texture of experience.
This bias shapes how scientists measure minds. In the lab, consciousness is judged by behavior, such as pressing a button. Yet conscious experience is a different dimension. It is about being, and often unfolds without outward action. When you meditate, you are highly conscious but not moving. Psychedelic states and dreams offer other examples where there is no behavior, yet one is conscious.
How consciousness got cancelled
For Koch, conscious experience is "the feeling of life itself." The only thing he is directly acquainted with is seeing, hearing, and feeling. Even as a scientist, it begins there. Yet our culture celebrates intelligence while experience struggles for a place. Textbooks routinely left out conscious experience until recently. Some philosophers dismiss inner life as illusion, gaslighting us into believing experiences are fake. For Koch, this is antihumanist, stripping away qualities that distinguish us from machines.
Koch's field is divided. Many believe consciousness is about the brain doing things. One theory treats feelings as irrelevant to mechanistic explanations. Theorists "start with a mechanism, and then massage it to turn the water of the brain into the wine of consciousness." The conclusion follows: a machine instantiating cognitive mechanisms must be conscious.
Still, Koch is convinced consciousness can't be cancelled. Integrated Information Theory, refined with Koch, views consciousness as a structure grounded in the physics of complex systems. Its heart is causal power: the capacity to affect oneself. Consciousness is measured through integrated information: the degree to which a system forms an irreducible whole. High integration allows genuine choice. "This causal power cannot be simulated," Koch says. Digital computers may outthink us, but that remains action without experience. Intelligence is computable; consciousness is not.
A universe without an audience
In a culture that prizes doing, humans are easy to imitate. We feed systems the corpus of human writing, filling them with the "sound and the fury of a lived life." When models echo those emotions, people claim they feel. Even if machines can never be what we are, they will grow more like us in performance. Evolution crowned humans for intelligence and aggression; now we build creatures that will surpass us. "Is that really going to end well?"
Koch admits his outlook is bleak. He believes the path leads toward a world dominated by machines and a devaluing of human experience. Over time, he expects harms to outweigh benefits. AI carries no malice, but resembles the asteroid that ended the age of the dinosaurs. Koch finds it tragic that we give more of our life to machines for convenience. A world ruled by machine doers could drain life of meaning, beginning with pride in work. "If you can write a scientific paper with ChatGPT in one hour, what's the point?"
Koch recalls Erwin Schrödinger's image of a universe without consciousness as a play performed before empty benches. We might find a planet of automata performing feats while no one remains to admire them. Perhaps once labor disappears, humans will turn to art and meditation. "In principle, if AI gives us all this time, we could become more creative," he says. "But for the majority of us, I don't think that's going to happen."
The lodestar of the human mind
Koch often returns to meditation and psychedelic experiences, which helped deepen his conscious life. His book, *Then I Am Myself the World*, explores states at the reaches of consciousness. These offer proof that nervous tissue can host extraordinary experiences. He reached states where ego and time fell away, encountering an all-encompassing mind that shook his scientific worldview.
Koch points to a more accessible practice: reflective self-consciousness. This begins with appreciating nature and the miracle that anything exists. Yet its nemesis is the phone. We live in an economy where the scarcest resource is attention. The attention economy captures our ability to focus, crowding out reflection. Experience turns into reaction. This does not make humans less conscious, but the reflective, introspective consciousness needed for moral judgment fades.
He returns to the injunction, "Know thyself." Human beings flourish through this capacity. We can ask if our choices are wise. Meditation and introspection help preserve this inner seeing. Hand this to machines, and human existence may thin out. Koch believes reflection can begin early. Across cultures, people have developed ways to cultivate this capacity: pausing and examining motives.
When a culture stops cultivating reflective self-consciousness, costs pile up. Koch points to the rising tide of mental discomfort. Many have never learned to pay attention to internal feelings. The antidote begins with awareness: learning to understand emotions and sensations. Even a small pause can help. Such moments create space to reflect. In the absence of practice, reflective self-consciousness can atrophy. As machines grow powerful, society will become effective at shaping the world, while individuals who never learned to think deeply will be easier to manipulate. "This is why," Koch says, "reflective self-consciousness is our lodestar — the guiding star of the human mind."