Artificial Intelligence Stack Exchange
Artificial Intelligence Stack Exchange

Questions tagged [natural-language-generation]

For questions about the generation of human-readable text from structured data. This is related to natural-language-processing (NLP), and statistical NLP models can be used in NLG too. However, NLG also applies to templating, report writing and scripted conversations.

See https://en.wikipedia.org/wiki/Natural-language_generation

23 questions
9
votes
3 answers

Can AI write good jokes yet?

Just watched a recent WIRED video on virtual assistants' performance on telling jokes. They're composed by humans, but I'd like to know if AI has gotten good enough to write some.
user7478
4
votes
0 answers

How is ChatGPT maintaining context?

It has been suggested in the answer to this earlier question that it is just remembering a certain amount of recent information. The reference used is this post by OpenAI which says that ChatGPT should only be able to maintain a context of around…
Kay999
  • 41
  • 1
  • 3
3
votes
1 answer

How can I leverage artificial intelligence and virtual reality to create intelligent automatic story generation?

How can I leverage artificial intelligence and virtual reality to create intelligent automatic story generation? My idea is to come up with a system that is empowering the user’s imagination to create and experience stories that engage and immerse…
user108180
  • 39
  • 1
  • 2
3
votes
1 answer

What puts the "chat" in a system like ChatGPT?

So I read Wolfram's What Is ChatGPT Doing … and Why Does It Work? but it left one really big question in my mind. His summary [if it could be called that!] really emphasizes that the core model is trained to "continue a piece of text that it’s been…
natevw
  • 131
  • 3
3
votes
1 answer

How are certain machine learning models able to produce variable-length outputs given variable-length inputs?

Most machine learning models, such as multilayer perceptrons, require a fixed-length input and output, but generative (pre-trained) transformers can produce sentences or full articles of variable length. How is this possible?
Python Test
  • 33
  • 3
2
votes
2 answers

How does a LLM (transformer) pick words from its vocabulary?

I have a very rough understanding of the "attention/self attention" mechanism of transformer models and how this can be used to process a set of word vectors provided as an input/prompt to the encoder of a network and how this will produce…
MLBeginner
  • 21
  • 1
2
votes
2 answers

What temperature would you recommend for the chatgpt api?

I believe that it is recommended to have a tiny bit of temperature with GPT 3 even for noncreative tasks like 0.2 or something (I am not entirely sure why). Last I checked, and if I remember correctly, the examples from openai on their GitHub page…
userrandrand
  • 121
  • 5
2
votes
1 answer

What are the most effective methods and tools for summarizing long-form content like articles, editorials, and discussion threads for an app?

With users expecting instantaneous information and no compromise on in-depth details, app developers are challenged to condense long-form content such as articles, editorials, and discussion threads into concise summaries. To ensure that users still…
Anshu Kumar Gupta
  • 29
  • 2
2
votes
1 answer

I have 5000 html files (structured text), how can I generate a new one that "resembles" those?

I don't know anything about ML or NLP, but I was asked by someone to create brand new statutes (written laws) that resemble the ones currently in effect in my country. I have already gathered the laws, and have 5000 html files now, one per law. The…
Biganon
  • 121
  • 1
2
votes
1 answer

How can a system like Jarvis understand the commands and take actions?

I am looking to make an AI like Jarvis. A perfect real-life example of this type of system is the simple AI that Mark Zuckerberg has recently built. Here is a description of how his AI works. From what I understand, the AI understands keywords,…
Noah Chalifour
  • 43
  • 3
2
votes
1 answer

Are there any meaningful books entirely written by an artificial intelligence?

Are there any meaningful books entirely written by an artificial intelligence? I mean something with meaning, unlike random words or empty books. Something that can be charactersed as fiction literature. If yes, then I think it is also interesting…
Joe Jobs
  • 121
  • 4
1
vote
1 answer

How can I improve this toy Graph Neural Network Generative Language model

Background I'm an undergraduate student with research interests in a field of physics that has significant overlap with graph theory, and a functioning knowledge of how simple neural nets work and how to build them with TensorFlow and Keras. As many…
MomentumEigenstate
  • 11
  • 2
1
vote
0 answers

Why doesn't ChatGPT ask questions?

As far as I understand ChatGPT has been trained on a vast array of data, and it does understand questions; but it seems to never ask. Even if a person would ask clarifying questions (that I assume are in the train set) ChatGPT doesn't, opting…
EmmanuelMess
  • 207
  • 3
  • 14
1
vote
0 answers

How do I preload a conversational AI assistant like GPT-3 with complex relational data to draw on?

I'm exploring options to build a virtual assistant type of product. Creating good dialog is mostly solved with GPT-3 or even DialoGPT. My main question is how do I add larger amounts of relational data, for the AI to draw on. e.g. I have a list of…
Sam7
  • 111
  • 2
1
vote
0 answers

Can you train GPT-J to use a specific list of words and prioritise them?

Can you train GPT-J to use a specific list of words and prioritise them? If so, please could you share how I would go about this? Say you're using GPT-J to write a story, you might wish to mention certain key terms more than others, or in a specific…
Learningallday
  • 11
  • 1
1
2