For questions related to the GloVe (Global Vectors for Word Representation), which is an unsupervised learning algorithm for obtaining vector representations for words.
For more details, have a look at https://nlp.stanford.edu/projects/glove/.
Questions tagged [glove]
3 questions
5
votes
1 answer
Are most things generally discovered because they work empirically and later justified mathematically, or vice-versa?
In the original GloVe paper, the authors discuss group theory when coming up with the equation (4). Is it possible that the authors came up with this model, figured out it was good, and then later found out various group theory justifications that…
Damien
- 169
- 1
2
votes
0 answers
Doubt on formulating cost function for GloVe
I'm reading the notes here and have a doubt on page 2 ("Least squares objective" section). The probability of a word $j$ occurring in the context of word $i$ is $$Q_{ij}=\frac{\exp(u_j^Tv_i)}{\sum_{w=1}^W\exp(u_w^Tv_i)}$$
The notes read:
Training…
Shirish Kulhari
- 383
- 1
- 10
1
vote
0 answers
Is there a way to parallelize GloVe cooccur function?
I would like to create a GloVe word embedding on a very large corpus (trillions of words). However, creating the co-occurence matrix with the GloVe cooccur script is projected to take weeks. Is there any way to parallelize the process of creating a…
J. Montgomery
- 41
- 3