Ai System Design
Ai System Design
Medium
Self-Correcting Legal Discovery Pipeline
You are building a system for lawyers to extract specific clauses and obligations from a 1,000-page contract. The system must cite the exact page and paragraph. Accuracy is paramount; a single hallucination can lead to legal liability. Design the extraction and verification pipeline. How do you evaluate the system's performance if you lack a ground-truth dataset initially?
Key concepts
evaluationhallucination detectionlong-context windowtraceability
Practise this out loud — free
Start a mock interview on THIS exact question — a voice AI interviewer opens with it, pushes back like a real onsite, then hands you an instant scorecard.
🎙 Practise this question now