Artificial Intelligence Stack Exchange
Artificial Intelligence Stack Exchange

Questions tagged [logarithm]

Logarithm is used in many formulations of artificial intelligence. This function has several interesting properties. Log-likelihood is one such example.

The logarithm is the inverse function to exponentiation. That means the logarithm of a given number x is the exponent to which another fixed number, the base b, must be raised, to produce that number x.

You can read this for more details: https://en.wikipedia.org/wiki/Logarithm

3 questions
3
votes
2 answers

Why do we commonly use the $\log$ to squash frequencies?

Term frequency and inverse document frequency are well-known terms in information retrieval. I am presenting the definitions for both from p:12,13 of Vector Semantics and Embeddings On term frequency Term frequency is the frequency of the word $t$…
hanugm
  • 3,571
  • 3
  • 18
  • 50
1
vote
1 answer

Why are logarithms used in GANs minimax equation?

The minimax equation for generative adversarial networks $$\min_G \max_D V(D,G) = \mathbb{E}_{\boldsymbol{x}\sim p_{data}(\boldsymbol{x})}[\log D(\boldsymbol{x})] + \mathbb{E}_{\boldsymbol{z}\sim p_{\boldsymbol{z}}(\boldsymbol{z})}[\log(1 -…
James Ellis
  • 23
  • 3
0
votes
1 answer

Query regarding the minimax value function of GANs

In the book Generative AI with Python and TensorFlow 2 from Babcock and Bali (page 172), it is stated that the value function of a GAN is the following: where D(x) is the output of the discriminator and G(z) is the output of the generator. However…
Claudia P
  • 1
  • 1