Signature project
SENTINEL — Trust & Safety Triage Agent
Problem: Unguarded LLM triage produced plausible-sounding enforcement rationales with hallucinated or out-of-scope policy citations—and no automated accuracy regression.
Built: A local LangGraph agent with policy-RAG retrieval (Chroma), code-level citation grounding, layered input/output guardrails, and a CI golden-set eval gate.
Outcome: 0 ungrounded escalations across 75+ live cases; 90% routing accuracy on the CI gate; 0.699 Ragas faithfulness.