Ai System Design
Ai System Design
Easy
Dynamic Routing Gateway for Enterprise Support
An enterprise handles 1M+ support queries daily. Design an LLM-based system that routes simple queries to cheap models (e.g., Llama 3-8B), complex queries to high-reasoning models (e.g., GPT-4), and sensitive data queries to an on-premise model.
Key concepts
llm routingcost optimizationsemantic classification
Practise this out loud — free
Start a mock interview on THIS exact question — a voice AI interviewer opens with it, pushes back like a real onsite, then hands you an instant scorecard.
🎙 Practise this question now