Questions tagged [neurons]

For questions about all aspects of a biological or artificial neuron.

A neuron, also known as a neurone (British spelling) and nerve cell, is an electrically excitable cell that receives, processes, and transmits information through electrical and chemical signals. These signals between neurons occur via specialized connections called synapses. Neurons can connect to each other to form neural networks. Neurons are the primary components of the central nervous system, which includes the brain and spinal cord, and of the peripheral nervous system, which comprises the autonomic nervous system and the somatic nervous system.

Neuron - Wikipedia

An artificial neuron is a mathematical function conceived as a model of biological neurons, a neural network. Artificial neurons are elementary units in an artificial neural network.

Artificial Neuron - Wikipedia

26 questions
19
votes
2 answers

Are Modular Neural Networks more effective than large, monolithic networks at any tasks?

Modular/Multiple Neural networks (MNNs) revolve around training smaller, independent networks that can feed into each other or another higher network. In principle, the hierarchical organization could allow us to make sense of more complex problem…
9
votes
1 answer

Are biological neurons organized in consecutive layers as well?

I'm now reading a book titled Hands-On Machine Learning with Scikit-Learn and TensorFlow and in the Chapter 10 of the book, the author writes the following: The architecture of biological neural networks (BNN)4 is still the subject of active…
Blaszard
  • 1,027
  • 2
  • 11
  • 25
9
votes
6 answers

When will the number of neurons in AI systems equal the human brain?

Based on fitting to historical data and extrapolation, when is it expected that the number of neurons in AI systems will equal those of the human brain? I'm interested in a possible direct replication of the human brain, which will need equal…
Tom Hale
  • 364
  • 3
  • 11
8
votes
3 answers

How to model inhibitory synapses in the artificial neuron?

In the brain, some synapses are stimulating and some inhibiting. In the case of artificial neural networks, ReLU erases that property, since in the brain inhibition doesn't correspond to a 0 output, but, more precisely, to a negative input. In the…
7
votes
3 answers

Is there research that employs realistic models of neurons?

Is there research that employs realistic models of neurons? Usually, the model of a neuron for a neural network is quite simple as opposed to the realistic neuron, which involves hundreds of proteins and millions of molecules (or even greater…
7
votes
3 answers

What makes the animal brain so special?

Whenever I read any book about neural networks or machine learning, their introductory chapter says that we haven't been able to replicate the brain's power due to its massive parallelism. Now, in modern times, transistors have been reduced to the…
7
votes
2 answers

CNNs: What happens from one neuron volume to the next?

I've gone through several descriptions of CNNs online and they all leave out a crucial part as if it were trivial. A "volume" of neurons consists of several parallel layers ("feature maps"), each the result of convolving with a different…
6
votes
1 answer

How many nodes/hidden layers are required to solve a classification problem where the boundary is a sinusoidal function?

A single neuron is capable of forming a decision boundary between linearly seperable data. Is there any intuition as to how many, and in what configuration, would be necessary to correctly approximate a sinusoidal decision boundary? Thanks
6
votes
4 answers

Do neurons of a neural network model a linear relationship?

I'm certain that this is a very naive question, but I am just beginning to look more deeply at neural networks, having only used decision tree approaches in the past. Also, my formal mathematics training is more than 30 years in the past, so please…
David Hoelzer
  • 787
  • 7
  • 19
5
votes
1 answer

What is the calcium equivalent role in neural networks

I understand that neural networks model biological neurons. Each node in the network represents a neuron cell and the connections between nodes represent the connections between cells. As in nature, a neuron fires an electrical signal to connected…
k rey
  • 163
  • 4
5
votes
2 answers

Neural Network with varying inputs (for a game ai)

I want to create a simple game which basically consists of 2d circles shooting smaller circles at each other (to make hitbox detection easier for the start). My goal is to create an ai which adapts its own behaviour to the player‘s. For that, i want…
Cr3ative
  • 53
  • 4
4
votes
1 answer

Is the neuron adequately comprehended?

It is possible that the signal handling of a neuron is outside the engineering comprehension of the most astute of human brains, even after the relationships of inputs to outputs are statistically characterized and the mapping of genetic information…
3
votes
2 answers

How do biological neurons weights get initialized?

When trying to map artificial neuronal models to biological facts it was not possible to find an answer regarding the biological justification of randomly initializing the weights. Perhaps this is not yet known from our current understanding of…
3
votes
2 answers

Why some neural network models in the 1980s shown as circuit models

I am familiar with the currently popular neural network in deep learning, which has weights and is trained by gradient descent. However, I found many papers that were popular in the 1980s and 1990s. These papers have titles like "Neural networks to…
dawen
  • 131
  • 3
3
votes
2 answers

How do layers in an artificial neural network transform inputs to outputs?

To me, most ANN/RNN related articles don't tell me actually how the network is implemented. I know that in the ANN you'll have multiple neurons, activation function, weights, etc. But, how do you, actually, in each neuron, convert the input to the…
1
2