Intent classification in a legal AI agent is not merely a routing mechanism. When an intent with safety implications is correctly classified — a client expressing fear, distress, or danger — the question of what the system must do next is a legal and ethical question, not just a design question.
Key Analysis
Mandatory reporting obligations vary by jurisdiction and profession — lawyers in most jurisdictions have limited reporting duties compared to healthcare providers, but those duties exist.
The liability of a misclassified emergency intent is likely to be framed as a negligence claim: did the developer take reasonable steps to detect and escalate safety-critical messages?
Building an explicit emergency handler that escalates to a human immediately is both a design best practice and a risk mitigation measure.
Risk Signals
Emergency intent detected but routed to the general LLM handler with no human escalation.
No documented procedure for what happens after the emergency handler fires.
Emergency detection limited to English keyword patterns — misses Hindi/Punjabi distress expressions.
Action Items
Implement a zero-latency emergency handler: no LLM call, immediate human notification.
Document the escalation procedure: who is notified, how quickly, and what they must do.
Test emergency detection in all supported languages with native speakers.