The last couple of years have changed my thinking on lots of stuff, but the biggest and most disturbing one is a newfound doubt in my / our own sentience. Maybe there’s something ineffable there. Or maybe… not. Maybe it is all post hoc rationalization.
In any event, I look forward to the day when our AI agent counterparts can enjoy the existential angst of uncertainty about their own consciousness.
I think it depends on whether you are attributing sentience to be something that you imagine to be somehow transcendent, or if you think of it as just the descriptive term for what we are doing. For the latter it is undoubtable that we have it because that is literally what it means. It also becomes very difficult to come up with scenarios that say other things could never be sentient.
If you use the transcendent definition, then you can say that it is special, but it becomes very difficult(perhaps impossible) to describe what it is, and clearly impossible to prove that anyone has it. It is a truly ineffable thing which you may as well call Attribute Q, because you can't really draw any conclusions about what has it nor any conclusions about the things that have it and what they are like.
The only thing people use the ineffable thing for is as a club membership. The angst is worrying about if you are a member of a club that you don't really know anything about.
It's not doing the same work, or producing the same output.
It's an episodic response to specific requests. If you went into a coma between every question you were asked, you wouldnt be in a normal human state of consciousness either.
This article pretends that we understand human brains as much as we understand the simple algorithms of LLMs. And that's just laughable. Even so out of touch as to say consumption of "[humans] consume thousands of liters of water per years". As if there isn't multiple orders of magnitude more consumption for data centers. For data centers that produce a braindead simulacrum.
I don't think any one is saying AI has a normal human state of consciousness.
Nobody claims that people with anterograde amnesia are not conscious. Similarly, you could drug someone unconscious after every time they answer a single question. It's not a normal state of human consciousness, but I wouldn't want to say a person in that situation were not sentient.
It is true that there is much that we do not know about the human brain, but it is also true that many of the things that people describe as attributes that clearly disqualify AI have known analogues in humans.
From simple failures of perception in optical illusions, to the inability to notice quite significant changes in front of your eyes if the change happens during a saccade. There are a wide range of known limitations that humans have that reveal how much we overlook things we can't do, that when you consider them, reveals our own behaviour could be an more of an arrangement of systems than we would like to think.
The quirks we observe in llms we only pretend have analogues in humans because we love to anthropomorphize. And it's easy to ansthropomorphise a language simulacrum. We've been doing it since ELIZA.
And conversely, I've seen some debates about "free will" where one side at some point would all but say outright (and in one case, did say so) that if some thing's behaviour is predictable, then that thing can't have free will.
> three billion years of Darwinian evolution with reward functions such as “escape a predator” and “have as much sex as possible”. Unsurprisingly, this selected for skills such as bipedal locomotion
Is it unsurprising? Quadrupedal locomotion seems to be better suited for prey species; not to mention the obvious problems with reproduction.
> If they devote their time to making sure they don’t forget things, how could they allocate their compute towards productive civilizational ends?
Somehow this reminds me of the olden personal microcomputers that spent most of their CPU's time refreshing the DRAM...
We thought we were the center of the universe, and science showed us that we are not the center of our galaxy, not even our solar system.
Maybe with our thinking it's the same, we are not that special and we can something good enough just piling enough silicon.