Can you train GPT-J to use a specific list of words and prioritise them?

Asked May 07 '22 at 15:12

Active May 07 '22 at 19:09

Viewed 198 times

Can you train GPT-J to use a specific list of words and prioritise them? If so, please could you share how I would go about this?

Say you're using GPT-J to write a story, you might wish to mention certain key terms more than others, or in a specific order.

edited May 07 '22 at 19:09

nbro

asked May 07 '22 at 15:12

Learningallday

You might even be able to do it without training, just by artificially raising the probabilities of those words in the output. Models like GPT-J don't output words, they output probabilities of words. – user253751 May 09 '22 at 13:05

0 Answers0