A routine morning query on tracking users DuckDuckGo’s AI search recently returned a clean, confident answer box stating the sitting U.S. President had died of rabies earlier this month. No hedging. No disclaimers. Just a neatly summarized lie wearing the skin of a reliable answer.
That reportedly happened this month. DuckDuckGo’s AI feature apparently surfaced the false claim after ingesting content from a fabricated local news outlet called “WKNA 49” and a community of Reddit pranksters who treat AI systems like piñatas. The subreddit r/poisonai exists specifically to seed absurd falsehoods across the web and watch search engines repeat them with a straight face. Brave’s AI previously fell for similar tactics.
The mechanics matter more than the punchline. DuckDuckGo’s system apparently stitched together the fake WKNA 49 material with a real ABC News story about an unrelated rabies death in Ohio — a story that mentioned zero political figures. The AI didn’t verify the connection. It synthesized one. Think of it as a textual deepfake: the packaging looks legitimate even when the ingredients are rotten.
Here’s what the reporting shows:
- DuckDuckGo’s AI claimed Trump died of rabies — he is alive
- The primary source was WKNA 49, a fabricated news-style site
- The AI also cited an ABC News Ohio rabies story that never mentioned Trump
- The content traces back to r/poisonai, where users deliberately test AI gullibility
- Brave’s AI was previously fooled by the same subreddit’s planted content
“Search engines, with or without AI, are not oracles of truth,” Brave stated in response to its own earlier failure, according to reporting on the incidents.
The Answer Box Has No Editor
Retrieval-augmented generation pulls from the live web — and the live web includes garbage.
Wikipedia vandalism used to be the classic example of how one bad actor could temporarily corrupt an information source. But Wikipedia has editors. AI answer boxes don’t. Every time you read a synthesized search result without clicking through to verify the source, you’re trusting a system that can be gamed by anyone with a Reddit account and spare time. The AI doesn’t fact-check; it aggregates — and aggregation without verification is just a confidence game running at scale.
Pressure is building on search companies to score source credibility and clearly separate retrieved facts from synthesized output. OpenAI Secretly Funded research has shown how AI companies can act without transparency, a pattern that extends to how search products handle misinformation. Until that infrastructure exists, treat every answer box as a starting point, never a verdict. The question isn’t whether AI search can be poisoned. It already has been.
