For questions related to natural language understanding (NLU), which is a subtopic of natural language processing (NLP) that deals with machine reading comprehension. Natural-language understanding is considered a hard problem.
Questions tagged [natural-language-understanding]
58 questions
48
votes
2 answers
How does ChatGPT retain the context of previous questions?
One of the innovations with OpenAI's ChatGPT is how natural it is for users to interact with it.
What is the technical enabler for ChatGPT to maintain the context of previous questions in its answers? For example, ChatGPT understands a prompt of…
milez
- 861
- 1
- 5
- 10
38
votes
7 answers
Is the "Chinese room" an explanation of how ChatGPT works?
Sorry if this question makes no sense. I'm a software developer but know very little about AI.
Quite a while ago, I read about the Chinese room, and the person inside who has had a lot of training/instructions how to combine symbols, and, as a…
Guntram Blohm
- 491
- 1
- 2
- 7
30
votes
9 answers
What is the actual quality of machine translations?
As an AI layman, till today I am confused by the promised and achieved improvements of automated translation.
My impression is: there is still a very, very far way to go. Or are there other explanations why the automated translations (offered and…
Hans-Peter Stricker
- 811
- 1
- 8
- 20
23
votes
4 answers
How does ChatGPT know math?
ChatGPT is a language model. As far as I know and If I'm not wrong, it gets text as tokens and word embeddings. So, how can it do math? For example, I asked:
ME: Which one is bigger 5 or 9.
ChatGPT: In this case, 9 is larger than 5.
One can say,…
Peyman
- 534
- 3
- 10
18
votes
2 answers
What research has been done in the domain of "identifying sarcasm in text"?
Identifying sarcasm is considered one of the most difficult open-ended problems in the domain of ML and NLP/NLU.
So, was there any considerable research done on that front? If yes, then what is the accuracy like? Please, also, explain the NLP model…
Dawny33
- 1,371
- 13
- 29
8
votes
2 answers
What are the current big challenges in natural language processing and understanding?
I'm doing a paper for a class on the topic of big problems that are still prevalent in AI, specifically in the area of natural language processing and understanding. From what I understand, the areas:
Text classification
Entity recognition…
Landon G
- 500
- 2
- 10
7
votes
1 answer
How to recognise metaphors in texts using NLP/NLU?
What are the current NLP/NLU techniques that can extract metaphors from texts?
For example
His words cut deeper than a knife.
Or a simpler form like:
Life is a journey that must be travelled no matter how bad the roads and accommodations.
Younes Ch
- 73
- 1
- 4
7
votes
1 answer
What are the most recent and influential breakthroughs in NLP?
I'm looking at the history of NLP, starting in the 1950s, with the Georgetown–IBM experiment.
What are examples of the most recent (e.g. in the last 5-10 years) and influential breakthroughs in natural language processing?
csheroe
- 71
- 1
7
votes
2 answers
How is the F1 score calculated in a question-answering system?
I have an NLP model for answer-extraction. So, basically, I have a paragraph and a question as input, and my model extracts the span of the paragraph that corresponds to the answer to the question.
I need to know how to compute the F1 score for such…
HLeb
- 549
- 5
- 10
5
votes
1 answer
How does GPT-based language model like ChatGPT determine the n-th letter of a word?
I understand that GPT models process input text by converting words into tokens and then embedding vectors and do not process them letter by letter. Given this approach, I am curious to know how a model like ChatGPT can identify the first (or n-th)…
Peyman
- 534
- 3
- 10
4
votes
2 answers
Is there a machine learning system that is able to understand mathematical problems given in a textual description?
Is there a machine learning system that is able to "understand" mathematical problems given in a textual description, such as
A big cat needs 4 days to catch all the mice and a small cat needs 12 days. How many days need both, if they catch mice…
georg0221
- 41
- 1
4
votes
3 answers
Can we make a chatbot that really "understands" the questions?
Can we make a chatbot that really "understands" (rather than just replies to) questions based on the database/options of replies that it has? I mean, can it come up with correct/non-stupid replies/communications that don't exist in its database?
For…
James Gates
- 143
- 3
4
votes
0 answers
How is ChatGPT maintaining context?
It has been suggested in the answer to this earlier question that it is just remembering a certain amount of recent information. The reference used is this post by OpenAI which says that ChatGPT should only be able to maintain a context of around…
Kay999
- 41
- 1
- 3
4
votes
2 answers
How does ChatGPT respond to novel prompts and commands?
So I understand how a language model could scan a large data set like the internet and produce text that mimicked the statistical properties of the input data, eg completing a sentence like "eggs are healthy because ...", or producing text that…
ak0000
- 195
- 1
- 8
4
votes
0 answers
Can in principle GPT language models learn physics?
Does anyone know of research involving the GPT models to learn not only regular texts, but also learn from physics books with the equations written in latex format?
My intuition is that the model might learn the rules relating equations and…
Wolphram jonny
- 284
- 2
- 14