6 ms·

How does this differ from something like TensorFlow? "Nengo is used to implement networks for deep learning, vision.." is this true? Does this system even suppo

How does this differ from something like TensorFlow? "Nengo is used to implement networks for deep learning, vision.." is this true? Does this system even support things like automatic symbolic differentiation? This seems more like a neuro science research tool than a practical framework for building neural networks.

aurelian15 8y ago
Student from the lab that originally developed Nengo here. You're correct in the assumption that Nengo is ‒ among others ‒ a neuroscience research tool; primarily, because it allows you to build networks of spiking neurons. Apart from neuroscience you can also do things like mapping pre-trained deep neural networks onto spiking neurons. These networks can then be executed on neuromorphic hardware. However, you can also run your simulations with "regular" rate-based neurons. In this case, the interface that Nengo provides is significantly more low-level than that of TensorFlow. Still, the main difference to TensorFlow is that Nengo networks are dynamic, i.e. the network is not described in terms of discrete time steps, but as a fully dynamical system (though a numerical simulator will discretise time at some point). In conjunction with neuromorphic hardware this allows things like real-time motor control with (sub-)millisecond resolution.
- psandersen 8y ago
  That sounds pretty interesting, would you happen to know if these can be used to simulate the worm connectome (OpenWorm?) linked up in a virtual environment?
  - Seanny123 8y ago
    Other student from the lab here. You could, but it might not be particularly useful. They already have a really good simulation environment and ways to connect it to virtual environments. It would be useful if you wanted to extend the model with further neural populations!
    - psandersen 8y ago
      Awesome, thanks for the reply. So if someone had a cockroach or ant connectome the Nengo simulator could, in theory, be used to simulate a population of them connected to some virtual environment?
      - Seanny123 8y ago
        Yes, it could, but you'd first have to translate the connectome into spiking neurons, which is a non-trivial task.
- sytelus 8y ago
  I am still trying to understand basic details and unfortunately docs aren’t helping at all. You might get much more interest from community if you can compare and contrast existing NNs. Specifically, 1. Where can I find a diagram of neuron you use? 2. Where can I find a diagram of network you use (for simple example)? 3. What is an example of simple learning algorithm for above?
  - Seanny123 8y ago
    Another student from the lab here. > unfortunately docs aren’t helping at all Yeah, the docs really aren't the ideal entry point. Instead, I'd recommend installing the [Nengo GUI](https://github.com/nengo/nengo-gui https://github.com/nengo/nengo-gui) and going through the built-in tutorial. > 1. Where can I find a diagram of neuron you use? We use a bunch of different neurons [1], but the default one is the Spiking LIF. It's really common in computational neuroscience. > 2. Where can I find a diagram of network you use (for simple example)? Check out this video example in the Nengo GUI https://youtu.be/UVeIPKnQAL4 https://youtu.be/UVeIPKnQAL4 > 3. What is an example of simple learning algorithm for above? There's a tutorial in the Nengo GUI, but there's also a few Jupyter Notebook examples: https://www.nengo.ai/nengo/examples.html#learning https://www.nengo.ai/nengo/examples.html#learning [1] See related psychology.stackexchange.com question https://psychology.stackexchange.com/a/9131/4397 https://psychology.stackexchange.com/a/9131/4397

aurelian15 8y ago

Student from the lab that originally developed Nengo here. You're correct in the assumption that Nengo is ‒ among others ‒ a neuroscience research tool; primarily, because it allows you to build networks of spiking neurons. Apart from neuroscience you can also do things like mapping pre-trained deep neural networks onto spiking neurons. These networks can then be executed on neuromorphic hardware. However, you can also run your simulations with "regular" rate-based neurons. In this case, the interface that Nengo provides is significantly more low-level than that of TensorFlow. Still, the main difference to TensorFlow is that Nengo networks are dynamic, i.e. the network is not described in terms of discrete time steps, but as a fully dynamical system (though a numerical simulator will discretise time at some point). In conjunction with neuromorphic hardware this allows things like real-time motor control with (sub-)millisecond resolution.

psandersen 8y ago
That sounds pretty interesting, would you happen to know if these can be used to simulate the worm connectome (OpenWorm?) linked up in a virtual environment?
- Seanny123 8y ago
  Other student from the lab here. You could, but it might not be particularly useful. They already have a really good simulation environment and ways to connect it to virtual environments. It would be useful if you wanted to extend the model with further neural populations!
  - psandersen 8y ago
    Awesome, thanks for the reply. So if someone had a cockroach or ant connectome the Nengo simulator could, in theory, be used to simulate a population of them connected to some virtual environment?
    - Seanny123 8y ago
      Yes, it could, but you'd first have to translate the connectome into spiking neurons, which is a non-trivial task.
sytelus 8y ago
I am still trying to understand basic details and unfortunately docs aren’t helping at all. You might get much more interest from community if you can compare and contrast existing NNs. Specifically, 1. Where can I find a diagram of neuron you use? 2. Where can I find a diagram of network you use (for simple example)? 3. What is an example of simple learning algorithm for above?
- Seanny123 8y ago
  Another student from the lab here. > unfortunately docs aren’t helping at all Yeah, the docs really aren't the ideal entry point. Instead, I'd recommend installing the [Nengo GUI](https://github.com/nengo/nengo-gui https://github.com/nengo/nengo-gui) and going through the built-in tutorial. > 1. Where can I find a diagram of neuron you use? We use a bunch of different neurons [1], but the default one is the Spiking LIF. It's really common in computational neuroscience. > 2. Where can I find a diagram of network you use (for simple example)? Check out this video example in the Nengo GUI https://youtu.be/UVeIPKnQAL4 https://youtu.be/UVeIPKnQAL4 > 3. What is an example of simple learning algorithm for above? There's a tutorial in the Nengo GUI, but there's also a few Jupyter Notebook examples: https://www.nengo.ai/nengo/examples.html#learning https://www.nengo.ai/nengo/examples.html#learning [1] See related psychology.stackexchange.com question https://psychology.stackexchange.com/a/9131/4397 https://psychology.stackexchange.com/a/9131/4397