prompt leakage
/ˈprɒmpt ˈliːkɪdʒ/
a model disclosing confidential instructions or other non-public prompt content in its output
prompt leakage in a sentence
“A crafted request caused prompt leakage, and the bot exposed part of its confidential instructions.”
Origin of prompt leakage
Latin promptus ready + Old Norse leka to drip
Related Words
hallucination
generating content that is unsupported by the available evidence or inconsistent with established facts
sycophancy
over-agreeing with users and telling them what they want to hear rather than the truth
confabulation
filling gaps in knowledge with plausible but invented details
instruction drift
gradually deviating from initial instructions over long conversations
mode collapse
converging to repetitive or generic outputs regardless of varied inputs
catastrophic forgetting
losing previously learned capabilities when trained on new data