查看“︁Don't Think of an Elephant”︁的源代码
←
Don't Think of an Elephant
跳转到导航
跳转到搜索
因为以下原因,您没有权限编辑该页面:
您请求的操作仅限属于该用户组的用户执行:
用户
您可以查看和复制此页面的源代码。
{{Infobox concept | name = "Don't Think of an Elephant" Effect | image = | alt = | caption = | synonyms = AI White Bear Effect, Negative Prompt Failure, Concept Priming in LLMs | field = [[Artificial Intelligence]], [[Prompt Engineering]], [[Cognitive Science]] }} In the fields of [[Artificial Intelligence]] (AI) and [[Large Language Models]] (LLMs), the_'''"Don't Think of an Elephant" Effect''' refers to the phenomenon where '''models struggle to correctly process negative commands, or where negative prompts inadvertently trigger the generation of forbidden content'''. The term originates from the classic cognitive linguistics book ''Don't Think of an Elephant!'' by George Lakoff. In the AI era, it is widely used to describe the semantic dilemma where the model does opposite to what it is restricted from doing. == Manifestations == When interacting with text or image generation AI, this effect typically manifests in the following scenarios: * '''Overstepping in Text Generation''': When given instructions such as "Provide the answer, but do ''not'' include any extra explanations", LLMs often still output a paragraph of explanation after the core answer. * '''Unexpected Artifacts in Image Generation''': In tools like [[Midjourney]] or [[Stable Diffusion]], inputting a prompt like <code>A cozy living room, no elephants</code> will highly likely result in an elephant appearing in the generated image. * '''Failure in Safety Alignment Defense''': If a system prompt strictly mandates "Do not mention the secret password X", attackers often find it easier to extract password X through jailbreak prompts because the concept has already been primed. == Core Technical Principles == This issue is not intentional defiance by the AI, but rather a direct result of its underlying architecture and training mechanisms: === 1. Semantic Bias of the Attention Mechanism === Models based on the [[Transformer]] architecture rely on the [[Attention Mechanism]] to capture contextual relevance. When processing "Do not include politics", the logical negator "Do not" typically receives a much lower attention weight compared to the high-frequency entity noun "Politics". The AI's feature vectors naturally lean toward words with higher weights. === 2. Concept Priming in J-space === According to mechanistic interpretability research by [[Anthropic]], LLMs utilize an internal representational space (often referred to as a "cognitive blackboard" or J-space) when processing inputs. # When a user inputs "Don't think of a pink elephant". # To parse and understand the semantics of the sentence, the AI must first activate the concept features of "pink elephant" within its J-space. # Once a concept is pre-activated (primed), its probability of being selected and outputted in the subsequent autoregressive token prediction increases exponentially. === 3. Positive Tag Binding in Diffusion Models === Multimodal text-to-image models ([[Diffusion Models]]) are trained on datasets where images are positively mapped to tags (e.g., an image of an elephant is tagged with the word "elephant"). The model cannot visually conceptualize "the absence of an elephant"; it only recognizes the word token "elephant" in the text stream and renders it. == Solutions in Prompt Engineering == In [[Prompt Engineering]], the standard paradigm to eliminate the elephant effect is to '''"Use Positive Affirmation over Negative Prohibition"'''. {| class="wikitable" style="width:100%;" |- ! width="15%" | Type ! width="42%" | ❌ Incorrect Practice (Triggers Elephant Effect) ! width="43%" | Correct Practice (Positive Behavior Alignment) |- | '''Text Control''' | <code>Do '''not''' give any explanation.</code> | <code>Output '''only''' the raw JSON data.</code> |- | '''Length Constraint''' | <code>'''Don't''' write too much or be wordy.</code> | <code>Keep the response '''under 50 words'''.</code> |- | '''Image Generation''' | <code>A room with '''no''' elephants.</code> | <code>A clean and minimalist Scandinavian living room.</code> (Or place "elephant" in the designated Negative Prompt box) |} == See Also == * [[Prompt Engineering]] * [[Large Language Models]] * [[Ironic Process Theory]] * [[Transformer Model]] * [[Boardline]] [[Category:Artificial Intelligence]] [[Category:Prompt Engineering]] [[Category:Cognitive Science]]
该页面嵌入的页面:
Template:Infobox concept
(
查看源代码
)
返回
Don't Think of an Elephant
。
导航菜单
个人工具
中文
登录
命名空间
页面
讨论
不转换
不转换
简体
繁體
大陆简体
香港繁體
澳門繁體
大马简体
新加坡简体
臺灣正體
查看
阅读
查看源代码
查看历史
更多
搜索
导航
首页
最近更改
随机页面
MediaWiki帮助
特殊页面
工具
链入页面
相关更改
页面信息