Zero wrong answers with the model unplugged

2026-07-20 · 1 min read

How much of your "AI product" is actually just a thin wrapper around an LLM API?

We wanted to prove that Epistom's semantic core is robust independently of the underlying language model. So, we ran a cross-model gauntlet. We ran our full Natural Language Query (NLQ) evaluation suite with the LLM completely disconnected, throttled, or quota-capped.

The results? Zero wrong answers.

Across 6 runs and 2 model families, every single failure resulted in an explicit abstention ("I don't know"). Meanwhile, our deterministic tiers (like the Virtual Knowledge Graph and Verified Queries) kept functioning perfectly, answering questions accurately without needing the LLM.

This proves our core architectural philosophy: the gate does the work, not the model. The LLM is just a highly capable interface layer. The actual understanding, validation, and security come from the semantic trust layer beneath it. When the model goes down, your enterprise shouldn't start generating hallucinations—it should gracefully degrade to deterministic safety.