Artificial Intelligence Stack Exchange
Artificial Intelligence Stack Exchange

Questions tagged [bayesian-inference]

For questions related to Bayesian inference in the context of artificial intelligence.

7 questions
10
votes
1 answer

Can Bayesian inference be combined with knowledge-based systems?

I've been struggling with the connection between knowledge-based AI systems and Bayesian inference for a while now. While I continue to sweep through the literature, I would be happy if someone can answer these more specific questions directly Are…
PintoUbuntu
  • 103
  • 5
2
votes
0 answers

Neural Network Learning algorithms invariant to input order

Is there some work that investigates how to train neural networks s.t. they approximately yield the same weights regardless of in what order they are presented with training samples from the dataset? I am asking because I have seen other work that…
postnubilaphoebus
  • 345
  • 1
  • 11
1
vote
2 answers

Why optimise log p(x) rather than log p(x|z) in a Variational AutoEncoder?

Background The loss function in a Variational AutoEncoder is the Evidence Lower Bound (ELBO): $\mathbb{E}_q[log$ $p(x|z)] - KL[q(z)||p(z)]$ And has this inequality: $log$ $p(x) \ge \mathbb{E}_q[log$ $p(x|z)] - KL[q(z)||p(z)]$ It is said in the…
Titus Buckworth
  • 111
  • 2
1
vote
1 answer

Is there an entry level textbook on Bayesian Inference that is a nice blend of theory and applications?

I am looking for a textbook that is a nice entry level to Bayesian Inference. I was hoping that there is a nice blend of theory and applications (data sets) on how concepts are applied. Programming techniques presented are welcome. Just for…
cgo
  • 175
  • 5
1
vote
1 answer

How to perform structure learning for Bayesian network given already partially constructed Bayesian network?

Let's assume that we have a dataset of variables (random events)I apriori would like to set dependency conditions between some of them and perform structure learning to figure out the rest of the Bayesian network. How can this be done practically…
Sultan1991
  • 11
  • 2
0
votes
1 answer

What Constitutes Messages in Junction Tree Algorithm?

I'm currently studying the Junction Tree Algorithm: I'm referring to the process of transforming a Bayesian Network into a Junction Tree in order to apply inference. I understand how you build the Junction Tree, but I'm stuck on the idea of message…
Genoma
  • 25
  • 3
0
votes
1 answer

Does the Bayesian MAP give a probability distribution over unseen t*?

I'm working my way through the Bayesian world. So far, I've understood that the MLE or the MPA are point estimates, therefore using such models just output one specific value and not a distribution. Moreover, vanilla neuronal networks do in fact…
Micha Christ
  • 19
  • 2