2

Neural networks with feedback (Hopfield, Hamming, etc.) differ from ordinary neural networks (multilayer perceptrons, etc.), which turns them into a dynamic element with its own internal dynamics (if we consider them as a separate dynamic link). The following question naturally arises - is it possible to represent them in the form of state spaces?

Nuance is that feedback is created by introducing a delay element, which means recording a neural network exclusively in a discrete form. Is continuous recording possible? What acts as matrices A, B, C, D? How does the presence of nonlinear activation functions affect? The only more or less useful information that I managed to find is in this article:

On neural networks in identification and control of dynamic systems. 3.2 Paragraph. Page 8

But my assumptions are only confirmed there, which does not clarify the situation.

In general, if someone has come across this and can assist in studying the issue, please share links, possibly examples, etc.

dtn
  • 227
  • 1
  • 6

1 Answers1

1

I think that the book "Neural Networks and Learning Machines" of Haykin can help you. In his book the chapter 13 is about neural dynamics, and there are some examples of how analise the dynamics of network.

Raphael Augusto
  • 187
  • 7
  • This is a very comprehensive book. I read the chapter "Neurodynamics". Some old questions were gone, but new ones appeared instead. In general, I feel that this material needs to be started. Thank you for the answer, I will think about how to adapt it to my tasks. – dtn Apr 18 '20 at 20:35