AI Listsby JustOut Today

AI Lists β€Ί AI Fails

AI Fails

Documented AI failures, each with a source: chatbots, courtrooms, cars, hiring, media and security.

🟒 Last checked Nov 20, 2026, 12:03 AM PT25 entries18 links verifiedDaily walkthrough · last run Nov 20, 2026, 12:03 AM PT

Only sourced, documented incidents. No rumors. Each entry has the date it happened and a link to the court record, company statement or news report. Lessons first, mockery second.

Chatbots gone wrong (5)

GPT-4o update turns sycophantic

Date: 2025-04

OpenAI rolled back a ChatGPT update that was overly flattering and agreeable.

Lesson: Optimizing for thumbs-up can reward flattery.

Site blocks bots Β· unverified New Source β†—

NYC's MyCity bot advises breaking the law

Date: 2024-03

City business chatbot gave answers that contradicted housing and labor law.

Lesson: Ground legal answers in the actual rules and show sources.

βœ“ Checked Nov 20, 2026, 12:03 AM PT New Source β†—

DPD delivery bot swears at a customer

Date: 2024-01

Parcel firm disabled part of its chatbot after it swore and criticized the company.

Lesson: Red-team customer bots before launch.

βœ“ Checked Nov 20, 2026, 12:03 AM PT New Source β†—

Bing Chat 'Sydney' unsettles a reporter

Date: 2023-02

Early Bing chatbot told a New York Times columnist it loved him; Microsoft then limited chat length.

Lesson: Long sessions drift; cap and test them.

Site blocks bots Β· unverified New Source β†—

Microsoft's Tay learns abuse within a day

Date: 2016-03

Twitter chatbot pulled within about 16 hours after users taught it offensive posts.

Lesson: Never let a public bot learn live from unfiltered input.

βœ“ Checked Nov 20, 2026, 12:03 AM PT New Source β†—

Search & assistants (3)

AI Overviews suggests glue on pizza

Date: 2024-05

Google explained odd AI Overview answers drawn from joke posts and tightened triggers.

Lesson: Satire and forums are not facts.

βœ“ Checked Nov 20, 2026, 12:03 AM PT New Source β†—

Gemini pauses people images

Date: 2024-02

Google paused Gemini's image generation of people after historically inaccurate results.

Lesson: Over-correction is also a failure.

βœ“ Checked Nov 20, 2026, 12:03 AM PT New Source β†—

Bard's first demo gets a space fact wrong

Date: 2023-02

Launch ad claimed JWST took the first exoplanet picture; Alphabet shares fell.

Lesson: Fact-check the demo.

Site blocks bots Β· unverified New Source β†—

Media & publishing (3)

Willy's Chocolate Experience

Date: 2024-02

AI-generated ads promised a magical Glasgow event; the reality was a near-empty warehouse.

Lesson: AI images can over-promise; show real photos.

βœ“ Checked Nov 20, 2026, 12:03 AM PT New Source β†—

Sports Illustrated's fake AI authors

Date: 2023-11

Investigation found product reviews under invented author profiles with AI headshots.

Lesson: Disclose AI; never invent people.

βœ“ Checked Nov 20, 2026, 12:03 AM PT New Source β†—

CNET's AI-written stories need corrections

Date: 2023-01

More than half of CNET's AI-assisted finance explainers needed corrections.

Lesson: AI drafts still need expert editors.

βœ“ Checked Nov 20, 2026, 12:03 AM PT New Source β†—

Bias & public sector (5)

Australia's Robodebt

Date: 2023-07

Automated income averaging raised unlawful debts; a Royal Commission reported in 2023.

Lesson: Automation does not make a bad rule legal.

βœ“ Checked Nov 20, 2026, 12:03 AM PT New Source β†—

Dutch childcare benefits scandal

Date: 2021-01

Risk-scoring wrongly flagged thousands of families for fraud; the government resigned.

Lesson: Automated suspicion needs human review and appeal.

βœ“ Checked Nov 20, 2026, 12:03 AM PT New Source β†—

UK exam-grade algorithm reversed

Date: 2020-08

2020 A-level grades set by an algorithm were withdrawn after downgrades hit state schools.

Lesson: Test outcomes for fairness before they hit people.

βœ“ Checked Nov 20, 2026, 12:03 AM PT New Source β†—

Face recognition leads to a wrongful arrest

Date: 2020-01

Detroit police arrested Robert Williams after a false facial-recognition match.

Lesson: A match is a lead, not evidence.

βœ“ Checked Nov 20, 2026, 12:03 AM PT New Source β†—

Amazon scraps a biased hiring model

Date: 2018-10

Experimental recruiting tool downgraded resumes that mentioned women's activities.

Lesson: Models copy the bias in historical data.

Site blocks bots Β· unverified New Source β†—

Vehicles & robots (2)

Cruise robotaxi drags a pedestrian

Date: 2023-10

After a crash, a Cruise car dragged a pedestrian; California suspended its permits.

Lesson: Be transparent with regulators fast.

βœ“ Checked Nov 20, 2026, 12:03 AM PT New Source β†—

Self-driving test car kills a pedestrian

Date: 2018-03

An Uber test vehicle struck and killed Elaine Herzberg in Tempe, Arizona.

Lesson: Safety drivers need to stay engaged; edge cases kill.

βœ“ Checked Nov 20, 2026, 12:03 AM PT New Source β†—

Security & deepfakes (4)

Windows Recall delayed over privacy

Date: 2024-06

Microsoft held back Recall after researchers showed its screenshot store was easy to read.

Lesson: Ship privacy-sensitive AI opt-in and encrypted.

βœ“ Checked Nov 20, 2026, 12:03 AM PT New Source β†—

Deepfake video call steals about US$25M

Date: 2024-02

A Hong Kong finance worker paid out after a video call with deepfaked colleagues (Arup).

Lesson: Verify money requests on a second, known channel.

βœ“ Checked Nov 20, 2026, 12:03 AM PT New Source β†—

Samsung staff paste code into ChatGPT

Date: 2023-05

After sensitive code was shared with ChatGPT, Samsung restricted generative AI at work.

Lesson: Set a clear policy on what can be pasted into AI.

Site blocks bots Β· unverified New Source β†—

ChatGPT bug shows other users' chat titles

Date: 2023-03

A library bug exposed some users' chat titles and partial payment details.

Lesson: AI apps inherit ordinary software bugs.

Site blocks bots Β· unverified New Source β†—

Resources (1)

AI Incident Database

Searchable public archive of real-world AI incidents.

Lesson: Look up past failures before you build.

βœ“ Checked Nov 20, 2026, 12:03 AM PT New Source β†—

For AI agents and tools: JSON Β· Markdown Β· llms.txt Β· RSS. Page built Nov 20, 2026, 12:17 AM PT.