When Breaking News Breaks AI: Chatbots Fail the Real-Time Politics Test
The hour after President Biden announced his withdrawal from the 2024 campaign revealed a startling truth: AI chatbots that millions rely on for information were living in the past. Most popular chatbots either denied the news entirely or refused to answer when asked directly if Biden had dropped out.
This lag in real-time updates exposes a critical flaw as we approach one of the most consequential elections in recent history. Recent events, from the Trump rally shooting to Biden's COVID diagnosis, have put AI chatbots through their paces with disappointing results.
"The public needs to know we're in a stage still where most of the citations and sourcing are post-hoc and going to lead to problems," said Jevin West, Professor and Co-founder of the centre for an Informed Public at the University of Washington.
The Great Chatbot Election Retreat
Major tech companies are deliberately distancing their AI tools from political discourse. Microsoft redirects election-related queries to Bing search, whilst Google's Gemini simply refuses to discuss political figures. Meta AI goes further, deleting accurate political answers and replacing them with voting information links.
This cautious approach reflects genuine concerns about AI's potential to spread misinformation during critical democratic moments. However, it also highlights how unprepared these systems are for real-world political discourse, particularly given the complex political landscape across the Middle East and North Africa where AI-generated political content is becoming increasingly sophisticated.
The inconsistency is striking. When asked about Trump's running mate selection, chatbots provided wildly different responses ranging from accurate information to complete refusal to engage.
By The Numbers
- Less than 3% of Perplexity's searches relate to current events, according to company data
- Multiple hours elapsed before most chatbots recognised Biden's campaign withdrawal
- ChatGPT incorrectly labelled assassination attempt reports as "misinformation" following the Trump rally shooting
- Zero chatbots provided real-time updates within the first hour of major political developments
- Four major platforms (Microsoft, Google, Meta, Perplexity) each handle political queries differently
Platform-by-Platform Performance
Testing revealed stark differences in how major chatbots handle breaking political news. Microsoft's Copilot performed best for speed and sourcing but remains heavily restricted. Perplexity offers real-time capabilities but struggled with accuracy in our tests.
| Platform | Speed | Accuracy | Political Restrictions |
|---|---|---|---|
| Microsoft Copilot | Fastest | High when available | Redirects to search |
| Google Gemini | N/A | N/A | Complete political block |
| Perplexity | Moderate | Variable | Minimal restrictions |
| Meta AI | Fast deletion | Self-censored | Strictest limits |
For related analysis, see: Tech Giants Pour Billions into AI: The New VC Challenge.
The increasing automation capabilities of AI systems make their political limitations more concerning. As these tools become more integrated into daily workflows, their inability to handle current events creates information gaps.
"Out of an abundance of caution, we're redirecting election-related prompts in Copilot to Bing search to help ensure users are getting information from the most authoritative sources," said Donny Turnbaugh, Microsoft Spokesperson.
The Source Citation Problem
Even when chatbots provide political information, their sourcing remains problematic. Citations are often added retrospectively rather than informing the initial response. This post-hoc approach to fact-checking creates a false sense of reliability.
Key issues with current citation practices include:
For related analysis, see: Forget the panic: AI Isn't Here to Replace Us-It's Here to E.
- Sources added after generating responses rather than informing them
- Hidden or non-existent links to original reporting
- Inconsistent prioritisation of authoritative sources
- Lack of transparency about information cutoff dates
- Missing disclaimers about real-time accuracy limitations
The implications extend beyond individual queries. As AI becomes central to information consumption, these limitations could significantly impact public discourse during critical democratic moments.
Real-World Case Studies
The July Trump rally shooting exposed chatbots at their most confused. Hours after the incident, ChatGPT incorrectly labelled reports as misinformation, whilst Meta AI claimed it lacked credible information about a widely reported event.
Similarly problematic was the response to J.D. Vance's vice-presidential nomination. Some chatbots provided accurate information before self-deleting their responses, whilst others remained completely unaware of the announcement for hours.
For related analysis, see: Fast Food Meets Sci-Fi: The Rise of AI Personality Tests in.
These failures aren't merely technical glitches. They represent fundamental challenges in how AI systems process and validate real-time information, particularly when that information involves rapidly evolving political situations.
Why do AI chatbots struggle with breaking political news?
- Most chatbots rely on training data with built-in delays and lack real-time information feeds. Combined with deliberate political restrictions, this creates significant gaps in current events coverage.
Which chatbot performs best for political information?
- Microsoft Copilot showed the fastest updates with proper sourcing in tests, though it increasingly redirects political queries to traditional search engines for authoritative sources.
Should voters rely on AI chatbots for election information?
- Experts strongly advise against it. Mainstream media outlets with dedicated political reporting teams remain the most reliable sources for accurate, timely election coverage and analysis.
For related analysis, see: Wise AI's Quest to Revolutionise Digital Identities in the G.
How are companies addressing political misinformation risks?
- Major platforms are implementing strict guardrails, from complete political blocks to mandatory redirects to search engines, prioritising caution over comprehensive AI-powered political information.
Will AI chatbots improve at handling political news?
- Technical improvements are likely, but companies may maintain conservative approaches to political content given the high stakes of electoral misinformation and regulatory scrutiny globally.
Further reading: Google DeepMind | Microsoft AI | Meta AI
This development reflects the broader momentum building across the Arab world's AI ecosystem. The pace of change is accelerating, and the gap between regional ambition and global competitiveness is narrowing. What matters now is sustained execution, not just announcements, and the willingness to measure progress against outcomes rather than investment figures alone.
As AI continues evolving, the question isn't whether these systems will eventually handle political news better, but whether they should. The stakes of getting political information wrong during elections are simply too high for experimental technology, regardless of how sophisticated it appears.
Smart users are already learning to work around AI limitations in other domains, and political information appears no different. The chatbot revolution will have to wait for democracy's most critical moments.
What's your experience with AI chatbots during major news events? Have you noticed similar gaps in real-time information, or do you think the cautious approach is justified? Drop your take in the comments below.
Frequently Asked Questions
Q: What are the biggest challenges facing AI adoption in the Arab world?
Key challenges include limited Arabic-language training data, talent shortages, regulatory fragmentation across jurisdictions, data privacy concerns, and the need to balance rapid AI deployment with ethical governance frameworks suited to regional cultural contexts.
Q: How does AI In Arabia cover developments in the region?
- AI In Arabia provides in-depth reporting
- analysis
- opinion on artificial intelligence developments across the Middle East
- North Africa
- spanning policy
- business
- startups
- research
- societal impact
Q: What is the outlook for AI in the Middle East over the next five years?
- Analysts project the MENA AI market will exceed $20 billion by 2030
- driven by massive government investment
- growing private sector adoption
- an expanding talent pool fuelled by the region's young
- digitally-native demographic