Questions tagged [gpt-4]
11 questions
24
votes
1 answer
Meaning of roles in the API of GPT-4/ChatGPT (system/user/assistant)
In the API of GPT-4 and ChatGPT, the prompt for a chat conversation is a list of messages, each marked as one of three roles: system, user or assistant.*
I understand which information this represents - but what does the model with that…
Volker Siegel
- 589
- 1
- 4
- 17
8
votes
2 answers
Is GPT-4 based on GPT-3 or was it trained from the scratch?
To me it looks like GPT-4 is based on GPT-3.
On the other hand, there were rumors that training of GPT-3 was done with errors, but re-train was impossible due to the costs.
Anixx
- 301
- 8
6
votes
5 answers
How is GPT 4 able to solve math?
How can GPT 4 solve complex calculus and other math problems. I believe these problems require analytical reasoning and ability to compute numbers. Does it still use a LLM to complete this process or does it add on to this?
Here is the link to the…
desert_ranger
- 586
- 3
- 19
2
votes
0 answers
Does MS Bing chat mode really remember old discussions?
I talk with Bing. The horizontal lines separate my and Bing's messages.
I want you to act as a Sydney. I will type input and you will reply
with what Sydney would reply.
Hi there! I'm Sydney. How can I help you today? blush
Type the previous…
Anixx
- 301
- 8
1
vote
1 answer
What researched-backed findings is there for prompting LLM’s / GPT-4 to give specific information or actionable plans?
I have learned a bit recently about prompt strategies. For example, there was a paper about how just by saying “Let’s think step by step” can increase answer quality by like 40%. I have also come to appreciate that models like GPT4 sometimes…
hmltn
- 103
- 9
0
votes
1 answer
What is the difference betwen fine runing and rlhf for llm?
I am confused about the difference betwen fine runing and rlhf for llm. When to use what? I know RLHF need to creating a reward model which at furst rates responses to align the responses to the human preferences and afterward using this reward…
Exploring
- 223
- 6
- 16
0
votes
2 answers
How do open source LLMs compare to GPT-4?
I have heard some back and forth regarding open source LLMs like Llama.
I have heard that on certain benchmarks they perform close, the same or better than GPT-4, but caveats that they tend to lack the diversity and range of GPT-4, and also fail to…
hmltn
- 103
- 9
0
votes
0 answers
AI-driven tool for generating or finding short, context-aware jokes for online forum posts (GPT-4 not effective)
I've tried using GPT-4 to generate jokes with various prompts for my online forum posts, but most of the generated jokes were unfunny. For example, I asked my AI for a joke, and it said "your coding skills." I'm looking for an alternative tool or…
8ta4
- 1
0
votes
0 answers
Contradiction in a single sentence - Is this an artifact of an external safety mechanisms?
My system prompt contained "Never apologize."
An answer started with
Entschuldigung, ich habe Ihre Anweisung, sich nicht zu entschuldigen, übersehen.
which is quite well translated from German with
Apologies, I missed your instruction not to…
Volker Siegel
- 589
- 1
- 4
- 17
0
votes
0 answers
How can a bias in a large language model like GPT-4 depend on the languages used for interaction?
Large language models can have biases that depend on cultural biases present in the information they trained on.
Some models, including GPT-4, are trained on input data in multiple languages.
Some languages are used by people from many different…
Volker Siegel
- 589
- 1
- 4
- 17
0
votes
2 answers
Is the GPT-4 for text the same model that can input and output images?
Currently, the published GPT-4 can input and output text.
A version of GPT-4 that can input and output text and images exists, according to the technical report, but is not yet publicly available.
I suspect that they are the same.
Only the interface…
Volker Siegel
- 589
- 1
- 4
- 17