Questions tagged [neat]

For questions related to the neuroevolution technique called NeuroEvolution of Augmenting Topologies (NEAT), introduced in the paper "Evolving Neural Networks through Augmenting Topologies" (2002) by Kenneth O. Stanley and Risto Miikkulainen.

See the paper that introduced NEAT Evolving Neural Networks through Augmenting Topologies (2002) by Kenneth O. Stanley and Risto Miikkulainen. See also Efficient Reinforcement Learning Through Evolving Neural Network Topologies by the same authors.

Other possibly useful resources

73 questions
19
votes
5 answers

How can I design and train a neural network to play a card game (similar to Magic: The Gathering)?

Introduction I am currently writing an engine to play a card game, as there is no engine yet for this particular game. About the game The game is similar to Magic: The Gathering. There is a commander, which has health and abilities. Players have an…
pcaston2
  • 311
  • 1
  • 2
  • 5
9
votes
6 answers

How to evaluate a NEAT neural network?

I'm trying to write my own implementation of NEAT and I'm stuck on the network evaluate function, which calculates the output of the network. NEAT as you may know contains a group of neural networks with continuously evolving topologies by the…
6
votes
0 answers

Speciation in NEAT - Advantages of keeping stable number of species

I found several methods for setting the compatibility distance in NEAT: some normalize it, some don't, some automatically adjust it. In a few tests I am running, using normalized static compatibility distance, the number of species increase very…
kuma
  • 341
  • 1
  • 9
6
votes
1 answer

What if the more fit parent has fewer nodes compared to the other, will the disjoint and excess genes be discarded?

In the paper Efficient Evolution of Neural Network Topologies (2002), the authors say Genes that do not match are inherited from the more fit parent What if the more fit parent has fewer nodes compared to the other, will the disjoint/excess genes…
6
votes
1 answer

Does training happen during NEAT?

When one uses NEAT to evolve the best fitting network for a task, does training take place in each epoch as well? If I understand correctly, training is the adjustment of the weights of the neural network via backpropagation and gradient descent.…
6
votes
1 answer

How does mating take place in NEAT?

In the Evolving Neural Networks through Augmenting Topologies (NEAT) paper it says (p. 110): The entire population is then replaced by the offspring of the remaining organisms in each species. But how does it take place? Are they paired and then…
6
votes
1 answer

In NEAT, is it a good idea to give the same ID to node genes created from the same connection gene?

Do I have to prevent nodes created from the same connection gene to have different IDs/innovation number? In this example, the node 6 is created from the connection going from node 3 to node 4: In the case where that specific node was already…
Dara Kong
  • 115
  • 1
  • 7
6
votes
2 answers

Can neuroevolution be combined with gradient descent?

Is there any precedent for using a neuroevolution algorithm, like NEAT, as a way of getting to an initialization of weights for a network that can then be fine-tuned with gradient descent and back-propagation? I wonder if this may be a faster way…
5
votes
2 answers

How does the NEAT speciation algorithm work?

I've been reading up on how NEAT (Neuro Evolution of Augmenting Topologies) works and I've got the main idea of it, but one thing that's been bothering me is how you split the different networks into species. I've gone through the algorithm but it…
Aguy
  • 65
  • 7
5
votes
1 answer

Several questions regarding the NEAT algorithm

I've recently read the paper Evolving Neural Networks through Augmenting Topologies which introduces NEAT. I am now trying to prototype it myself in JavaScript. However, I stumbled across a few questions I can't answer. What is the definition of…
5
votes
2 answers

Does NEAT require only connection genes to be marked with a global innovation number?

Does NEAT require only connection genes to be marked with a global innovation number? From the NEAT paper Whenever a new gene appears (through structural mutation), a global innovation number is incremented and assigned to that gene. It seems…
5
votes
1 answer

What happens if 2 genes have the same connection but a different innovation number?

I have read the Evolving Neural Networks through Augmenting Topologies (NEAT) paper, but some doubts are still bugging me, so I have two questions. When do mutations occur? Between which nodes? When mating, what happens if 2 genes have the same…
5
votes
1 answer

When do mutations in NEAT occur?

I read through the Evolving Neural Networks through Augmenting Topologies (NEAT) paper. I understand the algorithm now, but one thing is still unclear to me. When does the mutation occur and how does it take place? How is it chosen whether to add a…
5
votes
1 answer

Is there a neural network with a varying number of neurons?

Is there some type of neural network that changes the number of neurons while training? Using this idea, the network can increase or decrease the number of neurons when the complexity of the inputs increases or decreases.
Aura Lee
  • 239
  • 1
  • 7
5
votes
1 answer

Why would someone use NEAT over other machine learning algorithms?

Why would someone use a neuroevolution algorithm, such as NEAT, over other machine learning algorithms? What situation would only apply to an algorithm such as NEAT, but no other machine learning algorithm?
1
2 3 4 5