For questions related to the concept of perplexity in machine learning, information theory and natural language processing.
Questions tagged [perplexity]
2 questions
8
votes
2 answers
Why is the perplexity a good evaluation metric for chatbots?
A few papers I have come across say that BLEU is not an appropriate evaluation metric for chatbots, so they use the perplexity.
First of all, what is perplexity? How to calculate it? And why is perplexity a good evaluation metric for chatbots?
RuiZhang1993
- 89
- 2
0
votes
0 answers
How to compare word segmentation methods?
I am comparing a few methods of word segmentation in artificial language without dictionary and "golden" segmentation.
Let's say, idolikecats is splitted by three different algorithms to i do like cats, ido li kecats and ido lik cat s.
Is there a…
dobrowol
- 1
- 1