AI · 2026-08-18
Production AI is a permissions problem
Umer Javed · 4 min read
Most “AI features” are chat windows with no idea who the user is. In an enterprise, that is a security incident waiting for a screenshot.
Retrieval must respect access
If a document is not visible in the source system, it must not appear in the answer. That is not a prompt trick. It is an identity and indexing problem.
Evaluate before you scale
Ship an eval set with the first slice. Latency, cost, and refusal behaviour are product metrics, not research notes.
Keep a fallback
When the model is wrong, the operator still has a path. Human-in-the-loop is not a compromise. It is how you get to production.