What does “Presence Penalty” mean?
A decoding setting that reduces the probability of tokens that have appeared at all, encouraging new topics.
How Presence Penalty Works
Presence Penalty comparing Word not yet used (No penalty) versus Word already used once or more (Same flat penalty, Encourages new topics).
Practical Example
When brainstorming gift ideas, a presence penalty discourages the model from circling back to the same words and nudges it to introduce new ones.
Why It Matters
It encourages variety and new topics. Too high a setting can make writing wander or avoid necessary terms.
Common Questions About Presence Penalty
Q: Presence vs frequency penalty?
Presence penalizes any word that has appeared once; frequency penalizes more as the count rises.
Q: When is it useful?
Brainstorming or long creative output where you want broader coverage.
Q: Does it affect accuracy?
It can, by discouraging a correct word from being reused, so avoid it for factual tasks that need repeated terms.