For questions related to Boltzmann machines (aka stochastic Hopfield network with hidden units), which are stochastic recurrent neural networks, more precisely, they are Markov random fields.
Questions tagged [boltzmann-machine]
9 questions
6
votes
1 answer
What is the role of the hidden vectors in restricted Boltzmann machines?
I'm learning about the restricted Boltzmann machine (RBM), and I just came up with two naive understandings of this model. But it seems these two understandings are so different.
My first understanding goes like this.
The hidden units are just…
meTchaikovsky
- 163
- 5
3
votes
0 answers
How do we calculate the hidden units values in a (restricted) Boltzmann machine?
Now, Boltzmann machines are energy-based undirected networks, meaning there are no forward computations. Instead, for each input configuration $x$, a scalar energy is calculated to asses this configuration. The higher the energy, the less likely for…
Achraf Oussidi
- 171
- 1
- 10
3
votes
0 answers
How is the distribution of the state related to the distribution of the units in Boltzmann machines?
I'm trying to understand Boltzmann machines. Tutorials explain it with two formulas.
Logistic function for the probability of single units:
$$p(unit=1)=\frac{1}{1+e^{-\sum_{x}wx } }$$
and, when the machine is running, every state of the machine goes…
volperossa
- 161
- 7
3
votes
1 answer
What are the main differences between a deep Boltzmann machine and a deep belief network?
What are the main differences between a deep Boltzmann machine (DBM) (a recurrent neural network) and a deep belief network (which is based on RBMs)?
kenorb
- 10,423
- 3
- 43
- 91
2
votes
0 answers
What is the difference between visible and hidden units in Boltzmann machines?
What is the difference between visible and hidden units in Boltzmann machines? What are their purposes?
Mr. Eivind
- 558
- 4
- 27
2
votes
1 answer
Does the encoding of a restricted Boltzmann machine improve with more layers?
I'm using a restricted Boltzmann machine (RBM) as an autoencoder. For now, I use a simple architecture of two layers, the input (~100 nodes) and the output (3 nodes) layers. I'm thinking to add more hidden layers.
Are there some improvements in…
Simone Morettini
- 121
- 2
1
vote
1 answer
What is the difference between a stacked restricted Boltzmann machine and deep belief network?
What is the difference between stacked restricted Boltzmann machine (RBM) and deep belief network (DBN)?
Are they the same entity? If so, why? Is the latter some specific type of the former? If so, how to tell if stacked RBM is a DBN?
Diligent Key Presser
- 113
- 5
1
vote
0 answers
How are Energy Based models really connected to Statistical Mechanics?
From statistical mechanics, the Boltzmann distribution over a system's energy states arises from the assumption that many replicas of the system are exchanging energy with each other. The distribution of these replicas in each energy level is the…
Henry Bigelow
- 111
- 1
1
vote
0 answers
What are the differences between a deep belief network, a restricted Boltzmann machine and a deep Boltzmann machine?
Can anyone list the differences between deep Belief network (DBN), restricted Boltzmann machine (RBM), deep Boltzmann machine (DBM) using simple examples?
Links to other resources are also appreciated.
Pluviophile
- 1,223
- 5
- 17
- 37