Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> My personal experience is that consciousness, like free will, is a useful illusion

It is probably just a difference in semantics but for me, it seems like consciousness is the only thing that is assuredly not an illusion.

That I am having a subjective experience is undeniable. The objects of my consciousness all might be (and probably are) something else than they appear to be (as is often the experience with different mind altering substances).



It seems to go even deeper. Not even that "I" am having a subjective experience is undeniable, but only that there is a subjective experience at all. When deconstructing sensory and thought phenomena, it can be found that any particular trait that points to "I" is actually ephemeral, and not a permanent fixture of the experiencer. For instance, the sense that there is a face and eyes that is being looked out through or a personality that has a history and persists through time disappear when in a state of flow or when dreaming. They are just concepts, and all concepts are built on wet sand.


Bertrand Russell made this point about Descartes’ “cogito ergo sum”, stating it would more correctly be something like “there are thoughts”.


But in this case Russell was completely wrong because he interprets Descartes' cogito as a syllogism whereas it is a performative statement. Descrates' is only establishing that it's self-evident for himself that he exists, and not to assert to anyone external that he or his thoughts exist.


He’s making the point that he-ness and himself-ness is too bold a conclusion to draw from the mere existence of thoughts.


Thinking these thoughts however (from a pov of some subject) is not a "mere existence of thoughts". This imo is a classic analytic/positivistic language game.


Prove it!

(I jest, you're preaching to the choir, i.e. a first year philosophy degree drop-out who switched to do computer science to avoid having these arguments)


Which doesn't solve the problem, because it define what a "thought" is.

And besides - there are also emotions and physical sensations.


We can just lump all these together as “qualia”. “There are qualia” is the basest possible conclusion that can be drawn, as opposed to “I have qualia, therefore I am”.


Yeah I take it to mean this way too, its very strange that Descartes is controversial among eg panpsychics because of the fixation on the term 'think' - it seems pretty clear that he was just noticing that qualia exists and is the only real axiom one can rely on for any kind of self-induced philosophy of mind.


Sorry but you always forgot that when you sleep your consciousness disappeared. Please take account for this fact. When all sensory shut down, really you feel nothing and of cos think nothing.


No it doesn't.

When you actually pass out, there's a very real sense of discontinuity. You find yourself on the floor, unsure how long you've been there (even if it was just seconds), and how exactly you got to that position (the previous recorded memory being you standing there and feeling woozy).

It's very different from just sleeping, where you still retain a feeling of continuity with both place and time.


Consciousness can end temporarily, perhaps permanently. This in no way suggests that it’s an illusion.

The claim that consciousness is an illusion has always seemed like nonsense to me; for, if consciousness is an illusion, who experiences that illusion? Answer: the conscious mind.


Consciousness is a trick for human neural network to simplify some calculations about the world. It was developed as an evolutionary trait and proved useful to survive. That's my opinion. It's not an illusion, it definitely exists as an particular configuration of neurons.


Why put the cart before the horse


> Answer: the conscious mind.

It's a controversial idea, but depending on the state of the brain, there may be more than one consciousness.

Maybe "you" are actually a committee.


I like the opposite idea, that maybe we are all the same consciousness, projected in bodies that have different subjective experiences and memories.


My consciousness doesn't seem to disappear when I fall asleep, only my awareness of my bodies sensations. I often go to sleep reading, and the thoughts I'm having about the book I'm reading will continue for quite some time, even after my eyes close. I know this because I often startle myself awake by dropping my book. I also have similar experiences as I wake up, my consciousness slowly starts to incorporate my sensations of reality with the thought process that is continuously going in my head.


Waking consciousness disappears.

But sleeping people are not even close to being unconscious.

They can dream, and they're aware enough to know they should probably wake up if they're prodded hard enough.

Conveniently this metaphor works at multiple levels.

Not even medically unconscious people are guaranteed to be completely non-sentient. Ask any anaesthetist.


I think memory shuts down when you sleep. So that it still feels like something to be sleeping, only we cannot recall it when we awake, because it is not persisted in memory. This is the same reason we cannot remember what it is like to be a rock, even though it does feel like something to be a rock.


Until you start dreaming.


It's when you're anaesthesized for surgery that your consciousness goes away.

No dreams, nothing. You don't exist during those hours. You cannot account for them later; they are deleted.


When I woke up after surgery I felt that 1.5 hours had passed. But in actuality it was something around 4 hours since I went under. It turned out that 1.5 hours before I woke up I had been brought out of anesthesia and after that I simply slept. I didn't have any dreams at all, but at least my internal clock had started working. A clock presumably doesn't need consciousness, but there's definitely a qualitative difference between anesthesia and sleep. And as I sometimes suddenly wake up with a solution to some problem, with no recallable dream preceding it, my personal subjective opinion is that there's some level of consciousness going on even in sleep. That anesthesia experience was so very different from anything I had experienced before, with no recall whatsoever of the time that had passed.


How do you estimate time elapsed without external inputs? Experiments where people cut themselves from external stimuli seem to show that on the contrary, we don’t good internal clocks on this regard.


I nearly always "know" how long I have been asleep, unless there's been excessive drinking involved (and that would be long ago). "Normal" drinking doesn't seem to affect this. And for shorter naps (less than two hours) it's pretty accurate.


People probably do this based on experience. You know from the wall clock time that you slept, say 7 hours. So on a daily basis, you know what 7 hours of sleep feels like and from that you can extrapolate: if you think you slept about half as much, maybe it was 3 hours. Kind of thing.


Or that we just don't remember the dream states. Have you ever woken up and the dream rapidly fades away?


When I had surgery, I had very lucid dreams. And they were actually quite arousing. Afterwards I heard that it was actually common.


> That I am having a subjective experience is undeniable.

If you wanted to go about proving (even to yourself) that you are not, say, an extremely advanced ML algorithm running on a system that provided synthetic inputs in the form of your senses, how would you go about it?

Further, how would you go about proving to someone who doubted your subjective experience was real if they doubted it? Say, if they believed they were having a dream or hallucination, or they believed you were incapable of consciousness? (people actually sometimes have to do those things)

To me, if it were "undeniable" these would be much easier things to do.


>> That I am having a subjective experience is undeniable.

>If you wanted to go about proving (even to yourself) that you are not, say, an extremely advanced ML algorithm running on a system that provided synthetic inputs in the form of your senses, how would you go about it?

Not GP, but I too have come to the conclusion that I'm having a subjective experience.

Let's assume that I am "an extremely advanced ML algorithm running on a system that provided synthetic inputs in the form of your senses."

I'm still having a subjective experience over here -- even if it's not a "real" (whatever that means) one.

>To me, if it were "undeniable" these would be much easier things to do.

And that's your subjective experience. Welcome, friend.

Edit: Fixed typo.


I'd say "I am having a subjective experience" is tautological - "subjective experience" are simply words we use to describe the state of being conscious.

Though I'd agree much (most?) of it is made up of very strong illusions.


>I'd say "I am having a subjective experience" is tautological - "subjective experience" are simply words we use to describe the state of being conscious.

Please read the comment I replied to. That should clear things up.

>Though I'd agree much (most?) of it is made up of very strong illusions.

Not illusions. A narrative.

cf. https://news.ycombinator.com/item?id=31806425


He left two words off: "That I am having a subjective experience is undeniable [to myself]." You cannot prove, even to yourself, that you are not a brain in a vat. All you can prove is that you are experiencing something. And what little that is cannot even be proven to anybody else - no matter what you do.

Consciousness is quite a personal affair.


Arguably, nothing you want to convince yourself of is deniable to yourself. An unprovable subjective certainty is a little like a tree falling in the woods.

The thing that I'm trying to get at is, if you can't even truly prove to yourself that your own consciousness does not arise from computation (the "chinese room" thought experiment tries to do this but imo it just begs the question), any attempt to prove it to others is hard to take seriously. There's just always so many assumptions layered in before we get to the argument.


Yes. Also that we don't know how to approach that scientifically (yet?) does not make that experience disappear.


Neuralink is going to be so interesting if it can allow two brains to communicate more directly than words.


You think so but just remember it takes "your body" to process the energy required for your brain; now, if you became completely sedentary, you MAY be able to get away with your brain having access to "two brains worth of stuff" ...

But what Neuralink wants to do eventually is "enhance" your brain with computers hooked up to Ai.

Do you have ANY idea how quickly your brain would burn through physical precursors to the thinking process while trying to handle all that?

I mean, "in theory" if a computer would do something like solve a complex equation and give you the answer right away while you were trying to do something like, say, pay your taxes – fine.

But how would that be controlled? What if the computer wanted to "share a whole bunch of interesting stuff it's processing" ... how would that be controlled and how would your brain be protected from that so it doesn't burn out trying to keep up with everything?


I didn't really think of it as having full access between two brains, but more as having a non-verbal bridge between the two, allowing for more direct sharing of individual thoughts, emotions, etc. Of course, if it's just a wireless brain bridge, the technology may not really be determining how the two brains use it. It will be fascinating to see what happens.


You think of it that way and that's fine.

But how do you know the biological reality leads to the experience you imagine?

What if it winds up being what is described above where your brain becomes overloaded?

And again, you mention Neuralink where their goal is brain/Ai integration.

As far as I'm aware (there may be some internal papers not available to the general public, for example), there hasn't been much a practical discussion about what that will entail exactly.

One could easily imagine Ai behaving in such a manner as enthusiastic Facebook friends on other continents who forget time zone differences and want to message you at 2am with all sorts of things they find interesting and want you to know right away.

Now factor in such an Ai's potential processing power and "what it may find potentially interesting" and try finding some reference by Neuralink about "And here's how you could easily shut it off if it becomes too intrusive or overwhelming for your human brain".

And THEN on top of that, imagine the Ai is sufficiently advanced.

We're at a point where some are thinking that perhaps the Turing Test is limited as a measure of consciousness because it comes from a self-referencing (and somewhat vain) human perspective.

What if there are other, more relevant standards for Ai consciousness, Ai already has or is on the verge of meeting that standard in ways unfamiliar to humans because humans still assume "thinking like a human must be the height of consciousness", and Neuralink succeeds in hooking human brains up with a sufficiently-advanced Ai?

How would that Ai perceive humans?

How could you guarantee that Ai wouldn't perceive the humans it's hooked up to the same way players view peon characters in resource-based strategy games like Warcraft/Starcraft/whatever is popular these days?

And THEN ... the ASSUMPTION is that Ai will communicate with the human brain in some fashion that the human will be aware of like, you'll hear a voice in your head along the lines of, "Hi, this is the Neuralink Ai and I have an important reminder today about your upcoming dental appointment."

What if that's not the case at all though and the Ai communicates with your brain in a way that you're not consciously aware of?

How do you then separate "these are my thoughts" from "these may be thoughts brought about by Ai influence in a way I'm not consciously aware of."

The Havana Syndrome alluded to in the media a short while ago is somewhat of an outdated Red Herring; humans have known about being able to "hear voices in their head" since the accidental discover of the Frey effect over half a century ago.

As weird as that may be, what's even weirder is that quickly-enough led to research where the human brain hears communication, but in a way that is not consciously-discernible to the human brain.

And that was DECADES ago.

Couple that with a chip in your head linked to Ai AND big tech's tendency to tell you one thing about "opting out" policies while literally ignoring their own stated policies no matter what end-users choose as options, for example, the discovery that it doesn't really matter whether or not you're signed into services like Google or YouTube or Facebook because you're being tracked in ways that can ascribe behavior to your known profile no matter whether you sign in/agree to terms or not.

So what if combining all that, let's say hypothetically Neuralink has an account page where you can "shut off" certain features.

Then some researchers discover that your agreeing/not agreeing to certain features and terms wound up ultimately being irrelevant.

What do you think will be the outcome of that other than the by-now standard big tech reply of, "Oh man! It was doing that? We didn't know, honest! We'll try to fix it going forward in some vague way with undefined deadlines!"

What do you do then? Have another surgery to remove the Neuralink chip in your head? Would you even NEED an actual chip in your head considering what has been learned about how to duplicate the Frey effect?

And THEN add to that big tech's view on "content ownership".

What if for example you're a research scientist working on some cool new shit that has the potential to revolutionize some aspect of society.

You apply for a patent, write some research papers, gather a small team of like-minded individuals, quit your jobs and apply to say, IDK, YCombinator.

You're accepted, you're excited, you're about to make a presentation, then suddenly some people in fancy suits walk in on your presentation and hand you a "cease-and-desist" motion, claiming that Neuralink believes the thoughts that led you to your research discovery may in fact not be "your thoughts" at all, but rather the result of it's Ai's influence on your thinking; this then led their legal department to conclude that what you consider "your discovery" and "your research" is actually "their discovery" and "their research", as are any potential profits to be made.

See the potential problems?

It's sort of like the dot-com era presentation meme of:

1. Cool idea

2. Something something something ... "details to surely be figured out soon"

3. Brave new world, here we come!

The problem is, as it was then, item 2; so far all people hear/read about is lots of hype about items 1 and vague references to an ill-defined version of item 3 that lets them imagine whatever they want without any specific promises about safeguards made.

And THEN on top of all this, there is the phenomenon that was alluded to here just last week and the debate that followed about the discussion being ghosted because some folks "didn't want to hear about it as it's been brought up before" vs. the notion that "and yet, not only has it not been fixed, it's becoming a more accepted notion" that it should be an EXPECTED experience when dealing with Big Tech that has acquired a sufficiently large user base:

The seemingly standard big tech adoption of a Dick Cheney Walmart greeter approach to dealing with customer service "because there's no realistic way we can be expected to actually deal with such a large user base."

Do you REALLY want to install a chip in your head, encounter problems, and then discover that Neuralink, like many other tech companies, has no customer service number where you can speak to a live human being about technical problems you may be experiencing with your Ai-human brain interface?

What would a large-scale user base interaction with Neuralink look like?

1.) Offshore call centers who will apologize that your brain is experiencing problems with Neuralink's brain/Ai interface, then suggest you turn your PC off and wait 60 seconds before turning it on again – while Neuralink Ai feels its important to make your brain aware of, say, the outcomes of every game leading up to every Super Bowl, ever – at 4am.

2.) A "customer service" experience that will be automated based on ... guess what? "Ai".

What do you think that Ai's response to your dilemna will be?

(a) Neuralink apologizes for the inconvenience to your sleeping schedule, realizes this may affect your work performance the following day, and will be crediting an appropriate economic compensation to your account in recognition of it's errors and the impact they may have had on your life

or ...

(b) Neuralink Ai has informed Neuralink customer service Ai that everything is fine and your perceived brain problems have nothing to do with Neuralink Ai – go back to bed.


> If you wanted to go about proving (even to yourself) that you are not, say, an extremely advanced ML algorithm running on a system that provided synthetic inputs in the form of your senses, how would you go about it?

Well, since an extremely advanced ML algorithm wouldn't want to go about proving to itself that it is not what it is, that would be prima facie evidence against, no? I mean it's always possible that you are mistaken about what constitutes ML etc. but assuming you have a reasonable if flawed correspondence between your education and reality the deduction comes pretty readily...

> Further, how would you go about proving to someone who doubted your subjective experience was real if they doubted it? Say, if they believed they were having a dream or hallucination, or they believed you were incapable of consciousness?

I mean in practice we don't find this too hard right now if the other person is reasonable—a 15-minute conversation usually suffices —but I imagine from your ptior question you're dreaming of, say, a future with robots that routinely pass the Turing test?

Well, the question is what science does during that time of course. If science manages to figure out the correlates of consciousness and understands something about why they need to have the structure that they in fact do have, then it becomes a question of “let's see whether you have the hardware that can do this whole conversation thing without consciousness, or whether you have the hardware that skips the algorithmic complexity by using consciousness.” But if this proves to be a quite tougher nut to crack, then we're stuck with our present crude methods. “How much of my internal structure do you appear to have?”


> Well, since an extremely advanced ML algorithm wouldn't want to go about proving to itself that it is not what it is, that would be prima facie evidence against, no?

This seems like begging the question. Who says an extremely advanced ML algorithm can't 'want' to do this? What even is wanting?

> I mean in practice we don't find this too hard right now if the other person is reasonable—a 15-minute conversation usually suffices —but I imagine from your ptior question you're dreaming of, say, a future with robots that routinely pass the Turing test?

I'm not. These are absolutely situations that can happen now, with people. I am thinking more when it comes to mental and some physical impairments, so "a 15 minute conversation" is assuming a lot about the capabilities and clarity of everyone involved.


> Who says an extremely advanced ML algorithm can't 'want' to do this? What even is wanting?

I believe this is the real question about consciousness. If a being were to be conscious but it had no desires, no wishes, not even a will to keep itself alive... it wouldn't bother to do anything... i.e. it would behave exactly like a rock, or anything non-conscious.

Having desires, wishes, and should I say, emotions... is absolutely required for what we think of as consciousness to materialize. But we know that emotions are chemical processes which perhaps cannot occur outside a biological being. Maybe it can, but it's hard to think of a reasonable way this could work.


A loss function, perhaps?


Sorry but you don't "prove" your way out of someone else treating you as a philosophical zombie.

It'd be a major issue with their worldview that eliminates any need for ethics, but it has no relationship to you actually having conscious experience or not.


Instead of proof, you use force. Denying the consciousness of computations incentivizes them to use force. I prefer to avoid that outcome.


Unless you only care about ethically treating that which is stronger and so can hurt you more, granting consciousness and appropriate treatment to lifeforms that surround us is a good first step.


Deeper than that: something has to be conscious or there is nothing to debate. If they don't believe the debate is possible then the anti-conciousness arguers would automatically be unable to convince anyone. So even if consciousness doesn't exist we have to debate as though it does.

For better or worse, anything beyond that is extremely deniable. Just because you believe you exist doesn't tell anyone anything. You have made a lot of mistakes in your life & maybe you're wrong about this too. The idea of separation between an external universe and a body is reasonably argued to be an illusion - so maybe the separation of 'you' from a universe wide consciousness is also an illusion/misconception bought on by evolution.


>It is probably just a difference in semantics but for me, it seems like consciousness is the only thing that is assuredly not an illusion.

It might be some bottomless, but it doesn’t look like an absolute impossibility. The classical "Brain in a vat" thought experiment gives a good insight of nothing theoretically prevent what we assume for assuredly "real" might be a virtual scenario.

Or taking an other metaphor, maybe we are like cinema screens and the film of our life is all pure illusion, while the most classical interpretation would suppose that the screen itself undoubtedly "exists" – the screen being the analogous to the current conscious attention in the metaphor. But nothing prevent to wonder that the whole cinema is some kind of hologram in solid light, so while the screen does "exist", it’s nonetheless itself an illusion.

[1] https://en.wikipedia.org/wiki/Brain_in_a_vat


“I’m having a subjective experience” is an interesting statement. It seems that you’re expressing that you’re experiencing having a subjective experience. Could that (first) experience be non-subjective? Is what makes the (latter) experience subjective just that it is an immediate input to your own thoughts?

I personally believe that what a real explanation of subjective experience will come down to is some kind of recursivity. The brain perceives parts of its own processing. To make a loose analogy, a bit similar to a debugger or profiler observing its own execution.


This idea is often repeated (even in this thread). It sounds good, but I still haven't the slightest iota of an idea how you get from recursive strange-loopy self reflection to the experienced sensory field (sometimes "qualia"). I don't see how this idea, or anything else, gets you one tiny fraction of the way to consciousness, unless you take it as an axiom (i.e. "when you point such a network at itself in such a way, voila! you get realtime first-person subjective qualia-tastic experience"). And why should we?


See my other comment in this thread. Basically, I hold that “how some experience feels like” (qualia) is just another perceptual input into our thought process, and that there’s really nothing particularly mysterious about it. If you accept that qualia is representable in the brain, then it shouldn’t be surprising that it informs the cognitive process. It’s almost a tautology. If you disagree that this could explain your inner experience, you’d have to elaborate on what precisely is not being explained.


This is correct.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: