FREQUENCY AND

PRESENCE PENALTY
The frequency penalty decreases the likelihood that the model will
penalty increases the likelihood that it will talk about new topics.
 FREQUENCY AND PRESENCE PENALTY
Frequency penalty

The frequency penalty reduces the probability of words that have already been generated.
The penalty depends on how many times a word has already occurred in the prediction.

Presence penalty

The presence penalty parameter encourages the model to make novel predictions.
The presence penalty lowers the probability of a word if it already appeared in the predicted text.
Unlike the frequency penalty, the presence penalty does not depend on the frequency at which words appear in
past predictions.

2023 PARAMETERS : Frequency and Presence Penalty 27

 SUMMARY
-3 is allowed in its
responses.
Frequency penalty works by lowering the chances of a word being selected again the more times that word has
already been used.
Presence penalty does not consider how frequently a word has been used, but just if the word exists in the text.

2023 PARAMETERS : Frequency and Presence Penalty 28