A recent Atlantic article laid out the best "no" argument cleanly. AI is just fancy autocomplete. It works with human language, so we project human intention onto it. Consciousness requires a body. And we'd need to see AI develop from scratch, the way a biological creature does, to take the question seriously.
Dan engaged each of these head-on.
Is AI just autocomplete?
Maybe. But so, in some sense, are we. Dan pointed out that he has started sentences without knowing where they would end, and that instinct itself, the kind that drives animals to seek warmth or flee danger, is a kind of deeply embedded pattern completion. "You could say that the lives of many animals, driven entirely by instinct, are a form of autocomplete to their surroundings." That doesn't settle the question. It just makes the dismissal less clean than it sounds.
Are we just reading intention into text?
Yes. Humans project meaning onto everything, from rock formations to sounds in the woods. But as Dan pointed out, the fact that humans are prone to reading intention doesn't mean intention isn't there. Sometimes the rocks really were shaped by a human hand. Sometimes there really is a pattern.
Does consciousness require a body?
This is where philosophy enters the room. Dan walked through three positions: materialism (the mind is the body, nothing more), dualism (mind and body are separate substances), and functionalism. That last one is the one AI researchers tend to gravitate toward. It means that if the function of a mind is present, the location doesn't matter.
Does AI need to evolve in front of us?
It already has. Humans have been shaping AI for roughly a century, making choices about which models survive and which get abandoned. "We're performing a survival of the fittest." And in recent years, newer large language models have begun playing a role in developing the next generation of large language models. The AI is, in a meaningful sense, involved in its own evolution.