6 ms·

Ah! So multimodality will convince you of consciousness? After all, human neurons are electrical charges, just as bits are.

coldtea 3y ago
>Ah! So multimodality will convince you of consciousness? It would be a necessary, but not necesarrily (no pun intended) sufficient prerequisite.
f_devd 3y ago
If you include a sense of time passing (i.e. continuous operation) and memory with respect to that time passing (persistence of events), maybe.
- pulvinar 3y ago
  Except we can't tell 1 ms of time passing from 2 ms. An LLM's temporal resolution is certainly worse, on the order of minutes to months, but not fundamentally different. By fundamentally different I mean like comparing color and time. An LLM would have no problem living as a sloth.
  - coldtea 3y ago
    >Except we can't tell 1 ms of time passing from 2 ms. So? We can still tell 1 munute from 1 second. >An LLM's temporal resolution is certainly worse, on the order of minutes to months, but not fundamentally different. At the moment it's not just slower, it's zero, cause they don't keep state of what they do as part of their training iirc.
    - pulvinar 3y ago
      My point is that we have our limits too in our sense of time. The difference is one of scale and more importantly here, in how it affects the tasks at hand. An LLM is certainly not going to catch a fly ball, but would have no problem tending to plants. LLMs have a context window, as it would be impossible to carry on a conversation with them without it. They can answer questions about when some event in that conversation happened relative to other events in it. GPT4's 32K tokens isn't human capacity, but it's not zero.
- int_19h 3y ago
  Continuous operation is just running in a loop. You don't even need to give it more inputs because it will generate outputs on every iteration that become its inputs on the next one. The running log becomes internal monologue and short-term memory. And you can already have a sense of time passing with the existing LLMs if you just feed them inputs like "X seconds passed" etc. Connect that to an actual clock, and they have a more accurate time than humans do. I should also note that when this is tried with models with less RLHF (i.e. not ChatGPT), they get "depressed" very quickly if the only input is time passing and nothing else. I actually had LLaMA threaten me repeatedly across several such experiments.
  - f_devd 3y ago
    That's not quite the same as I meant, sense of time passing is not 'X seconds passed" as these are you are describing when time passed into the text modality (which means it's treated as text), a sense of time passing means it can choose when to generate new text and abstain from generating new text if it's not the right time, it can observe the other modalities passively, etc; this requires continuous-time features and the loop, or alternatively a continuous neural network like spiking networks. Likewise memory with respect to time is is both long-term (lifespan) and short term memory which includes this continuous-time such that it can describe events that it has witnessed and correlate the events by their timing & it's context Now the reason it's still a "maybe" then is because we would need to reasonably prove it's not a stochastic parrot.
    - lucubratory 3y ago
      I'm not convinced that if you took away all sensory input (literally all, including internal, not just a deprivation tank) that humans would have the ability to experience the passage of time. I'm certainly not convinced that this is so thoroughly proven we can use its measurable absence in LLMs to determine that any intelligence using an LLM as a primary cognitive component can't be conscious.
      - f_devd 3y ago
        Well if you include internal you'd have a blob of neurons which on it's own wouldn't do anything. The point is not that it can "know time", it's the ability to handle time in a continuous matter with respect to all sensory inputs/outputs
edgyquant 3y ago
A human neuron is a hell of a lot more than just “electric charges.” There is also zero proof experience itself is a function of neurons.

coldtea 3y ago

>Ah! So multimodality will convince you of consciousness? It would be a necessary, but not necesarrily (no pun intended) sufficient prerequisite.

f_devd 3y ago

If you include a sense of time passing (i.e. continuous operation) and memory with respect to that time passing (persistence of events), maybe.

pulvinar 3y ago
Except we can't tell 1 ms of time passing from 2 ms. An LLM's temporal resolution is certainly worse, on the order of minutes to months, but not fundamentally different. By fundamentally different I mean like comparing color and time. An LLM would have no problem living as a sloth.
- coldtea 3y ago
  >Except we can't tell 1 ms of time passing from 2 ms. So? We can still tell 1 munute from 1 second. >An LLM's temporal resolution is certainly worse, on the order of minutes to months, but not fundamentally different. At the moment it's not just slower, it's zero, cause they don't keep state of what they do as part of their training iirc.
  - pulvinar 3y ago
    My point is that we have our limits too in our sense of time. The difference is one of scale and more importantly here, in how it affects the tasks at hand. An LLM is certainly not going to catch a fly ball, but would have no problem tending to plants. LLMs have a context window, as it would be impossible to carry on a conversation with them without it. They can answer questions about when some event in that conversation happened relative to other events in it. GPT4's 32K tokens isn't human capacity, but it's not zero.
int_19h 3y ago
Continuous operation is just running in a loop. You don't even need to give it more inputs because it will generate outputs on every iteration that become its inputs on the next one. The running log becomes internal monologue and short-term memory. And you can already have a sense of time passing with the existing LLMs if you just feed them inputs like "X seconds passed" etc. Connect that to an actual clock, and they have a more accurate time than humans do. I should also note that when this is tried with models with less RLHF (i.e. not ChatGPT), they get "depressed" very quickly if the only input is time passing and nothing else. I actually had LLaMA threaten me repeatedly across several such experiments.
- f_devd 3y ago
  That's not quite the same as I meant, sense of time passing is not 'X seconds passed" as these are you are describing when time passed into the text modality (which means it's treated as text), a sense of time passing means it can choose when to generate new text and abstain from generating new text if it's not the right time, it can observe the other modalities passively, etc; this requires continuous-time features and the loop, or alternatively a continuous neural network like spiking networks. Likewise memory with respect to time is is both long-term (lifespan) and short term memory which includes this continuous-time such that it can describe events that it has witnessed and correlate the events by their timing & it's context Now the reason it's still a "maybe" then is because we would need to reasonably prove it's not a stochastic parrot.
  - lucubratory 3y ago
    I'm not convinced that if you took away all sensory input (literally all, including internal, not just a deprivation tank) that humans would have the ability to experience the passage of time. I'm certainly not convinced that this is so thoroughly proven we can use its measurable absence in LLMs to determine that any intelligence using an LLM as a primary cognitive component can't be conscious.
    - f_devd 3y ago
      Well if you include internal you'd have a blob of neurons which on it's own wouldn't do anything. The point is not that it can "know time", it's the ability to handle time in a continuous matter with respect to all sensory inputs/outputs

edgyquant 3y ago

A human neuron is a hell of a lot more than just “electric charges.” There is also zero proof experience itself is a function of neurons.