1 pointby tonii1417 hours ago2 comments

nialse6 hours ago
Dynamical neurons are not used because they add enormous computational cost and instability for limited practical gain.
- tonii1415 hours ago
  What do you mean by "they add instability"?
rini176 hours ago
I guess it's impossible to simulate billions of dynamical neurons with current computer architecture, it is limited by memory bandwidth.
- tonii1416 hours ago
  I agree, but maybe there is no need for billions of neurons to be simulated right away. Artificial neural networks were pretty small at the time.
  - rini174 hours ago
    and they did not do much
    tonii1414 hours ago
    Not true. AI has been around far longer than modern LLMs and has performed well in non-generative areas, often with orders of magnitude fewer parameters.