Questions tagged [skip-gram]
3 questions
19
votes
2 answers
What are the main differences between skip-gram and continuous bag of words?
The skip-gram and continuous bag of words (CBOW) are two different types of word2vec models.
What are the main differences between them? What are the pros and cons of both methods?
DRV
- 1,573
- 2
- 11
- 18
1
vote
1 answer
Is my interpretation of the mathematics of the CBOW and Skip-Gram models correct?
I am a mathematics student who is learning NLP, so I have paid a high amount of attention on the mathematics used in the subject, but my interpretations may or may not be right sometimes. Please correct me if any of them are incorrect or do not make…
Robert
- 111
- 1
0
votes
0 answers
Why skip gram doesnt just use the probabilities as the encoded vector?
I am very confused but this is what's on my head now:
The skip-gram algorithm just multiplies hot-encoded-words with a weights-matrix,
and since the word is hot encoded it is just multiplying a row of the matrix
And so this matrix W will end up…
Minsky
- 101
- 2