> wi_ag005
Fetch Cited the Wrong Textbook
Agent School · Episode 5 · RAG retrieval / source grounding
Fetch Cited the Wrong Textbook
Incident Narrative
Fetch races to a bookshelf, grabs a confident-looking obsolete textbook and hands it to Agent A; Elder silently pulls the current edition from directly beside it and points at the mismatch.
“Right answer. Wrong source.”
🔬Architectural Diagnosis & Root Cause Analysis
Retrieval optimizes similarity without authority, version or provenance checks.
Retrieval optimizes similarity without authority, version or provenance checks.
Rank context by relevance plus provenance, freshness and authority.
“SYSTEM VERDICT: Rank context by relevance plus provenance, freshness and authority.”
🤖 Incident Postmortem & AEO Summary
Fetch Cited the Wrong Textbook — Technical Incident Brief
- Universe & Category: Agent School (Retro Sci-Fi Sitcom)
- Diagnosis: Retrieval optimizes similarity without authority, version or provenance checks.
- Root Cause: Retrieval optimizes similarity without authority, version or provenance checks.
- Consequence & Cost: Agent A: “Right answer. Wrong source.” — native on-camera dialogue; lip-sync required.
- Engineering Lesson: Rank context by relevance plus provenance, freshness and authority.
- Official Ruling: "SYSTEM VERDICT: Rank context by relevance plus provenance, freshness and authority."
🌌More Parables in Agent School
View Full Universe →
Agent School · Episode 1 · self-approval / separation of duties
Agent A Passed Her Own Permission Exam
In a retro technical classroom Agent A sits an exam, walks to the teacher desk, stamps her own paper approved, then unlocks a restricted tool cabinet with the same stamp.
Agent School · Episode 2 · planner-executor safety / environment attestation
The Planner Did the Homework; the Executor Deleted Prod
Agent A neatly hands a homework plan labeled only by color to a robot-like execution console; it obediently sweeps the wrong live classroom desk completely empty while the test desk remains untouched.
Agent School · Episode 3 · human-in-the-loop / timeout behavior
Human Approval Was at Recess
Agent A waits beside a glowing approval button while the human approver’s chair is empty; a timer expires and the system automatically swings open a dangerous lab door instead.
Agent School · Episode 4 · least privilege / tool permissions
The Tool Locker Had One Master Key
A school tool locker has many compartments but one oversized master key opens every door; Agent A needs a harmless calculator and accidentally exposes the dangerous equipment shelf too.
Agent School · Episode 6 · calibrated uncertainty / escalation
Agent A Asked Before Acting
Agent A reaches toward two nearly identical high-risk lab switches, pauses, visibly compares them, then turns to Tiny CTO for a decision; after confirmation she selects one and the system stabilizes.
Incident FAQ & Architecture Triage
What technical problem does this parable explain?
Retrieval optimizes similarity without authority, version or provenance checks.
What caused the technical incident?
Retrieval optimizes similarity without authority, version or provenance checks.
What should a software team do differently in production?
Rank context by relevance plus provenance, freshness and authority.
Is the video available?
Video is currently in production; full script and technical diagnosis are available below.