For questions related to the OpenAI ChatGPT model/chatbot, which was trained by Reinforcement Learning from Human Feedback (RLHF).
For more info, see https://openai.com/blog/chatgpt/.
Questions tagged [chatgpt]
98 questions
48
votes
2 answers
How does ChatGPT retain the context of previous questions?
One of the innovations with OpenAI's ChatGPT is how natural it is for users to interact with it.
What is the technical enabler for ChatGPT to maintain the context of previous questions in its answers? For example, ChatGPT understands a prompt of…
milez
- 861
- 1
- 5
- 10
46
votes
3 answers
Was ChatGPT trained on Stack Overflow data?
Has ChatGPT used highly rated and upvoted questions/answers from Stack Overflow in its training data?
For me it makes complete sense to take answers that have upwards of 100 upvotes and include them in your training data, but people around me seem…
Nicolas Zein
- 561
- 1
- 2
- 3
41
votes
2 answers
How is ChatGPT aware of today's date?
I asked ChatGPT (3.5 and 4) about current date and (s)he answered correctly. In subsequent conversation (s)he was not able to explain how (s)he has this knowledge.
I always thought that the model only sees the conversation above and a pretrained NN…
Peter Franek
- 432
- 1
- 4
- 11
38
votes
7 answers
Is the "Chinese room" an explanation of how ChatGPT works?
Sorry if this question makes no sense. I'm a software developer but know very little about AI.
Quite a while ago, I read about the Chinese room, and the person inside who has had a lot of training/instructions how to combine symbols, and, as a…
Guntram Blohm
- 491
- 1
- 2
- 7
34
votes
6 answers
How does an AI like ChatGPT answer a question in a subject which it may not know?
After seeing StackOverflow's banning of ChatGPT, I explored it out of curiosity. It's marvellous as it can write code by itself!
Later to check if it knows chess as well like Google-Deepmind's AlphaZero AI, I asked below questions:
Me: Does openai…
iammilind
- 443
- 1
- 2
- 9
27
votes
4 answers
Why is ChatGPT bad at math?
As opposed to How does ChatGPT know math?, I've been seeing some things floating around the Twitterverse about how ChatGPT can actually be very bad at math. For instance, I asked it "If it takes 5 machines 5 minutes to make 5 devices, how long would…
Mithical
- 2,885
- 5
- 27
- 39
24
votes
1 answer
Meaning of roles in the API of GPT-4/ChatGPT (system/user/assistant)
In the API of GPT-4 and ChatGPT, the prompt for a chat conversation is a list of messages, each marked as one of three roles: system, user or assistant.*
I understand which information this represents - but what does the model with that…
Volker Siegel
- 589
- 1
- 4
- 17
23
votes
4 answers
How does ChatGPT know math?
ChatGPT is a language model. As far as I know and If I'm not wrong, it gets text as tokens and word embeddings. So, how can it do math? For example, I asked:
ME: Which one is bigger 5 or 9.
ChatGPT: In this case, 9 is larger than 5.
One can say,…
Peyman
- 534
- 3
- 10
22
votes
4 answers
Why does ChatGPT fail in playing "20 questions"?
IBM Watson's success in playing "Jeopardy!" was a landmark in the history of artificial intelligence. In the seemingly simpler game of "Twenty questions" where player B has to guess a word that player A thinks of by asking questions to be answered…
Hans-Peter Stricker
- 811
- 1
- 8
- 20
15
votes
3 answers
How much energy consumption is involved in Chat GPT responses being generated?
I note this question was deemed off-topic, so I'm trying to clearly frame this question in terms of scope of response I'm interested in, namely ethics and sustainability issues associated with the soon-to-be proliferation of OpenAI Chat GPT types of…
wide_eyed_pupil
- 251
- 1
- 1
- 5
14
votes
6 answers
Why do many AI bots feel the need to be know-it-alls?
Having used various AI bots often over recent months, I noticed that often it will claim to know something, even if it doesn't.
It would then either explain something which is clearly nonsense, or by rambling on about how the answer isn't known in…
ben svenssohn
- 316
- 1
- 10
13
votes
2 answers
Why does ChatGPT not give the answer text all at once?
When ChatGPT is generating an answer to my question, it generates it word by word.
So I actually have to wait until I get the final answer.
Is this just for show?
Or is it really real-time generating the answer word by word not knowing yet what the…
Sander van den Oord
- 231
- 1
- 5
8
votes
2 answers
Are GPT-3.5 series models based on GPT-3?
In the official blog post about ChatGPT from OpenAI, there is this paragraph explaining how ChatGPT model was trained:
We trained this model using Reinforcement Learning from Human Feedback
(RLHF), using the same methods as InstructGPT, but with…
iMad
- 183
- 4
8
votes
1 answer
What causes ChatGPT to generate responses that refer to itself as a bot or LM?
ChatGPT occasionally generates responses to prompts that refer to itself as a "bot" or "language model."
For instance, when given a certain input (the first paragraph of this question) ChatGPT produces (in part) the output:
It is not appropriate…
Obie 2.0
- 183
- 6
7
votes
4 answers
OpenAI ChatGPT gives a network error at long responds. How can I fix it?
When OpenAI's ChatGPT replies with a very long answer, it will return a network error. When you check the network console, the POST request will fail with a ERR_HTTP2_PROTOCOL_ERROR:
The time of the "crash" is around 1 minute.
Lars Flieger
- 187
- 1
- 1
- 5