Skip to content

Where We're Going: Deterministic Assertions and Regression Gates

The direction is two verdicts per test case instead of one. A test case keeps its Hamming assertions for the fuzzy questions, and gains a second assertion type, a deterministic Oversight assertion, that names a registered check and its expected value ("transfer destination equals French", "appointment created is true") and returns exact true or false. Avoca already owns the engine: Oversight runs deterministic tags on production calls today and writes structured results, so the net-new work is the bridge (an expected-value comparison, which a tag alone has no notion of), a handful of new checks, and firing the analysis on test calls. Authoring changes shape with it: instead of a prose box that can express "the vibe was good," a deterministic assertion is built as field, operator, value, where every field is backed by a real check, so you can only build something the system can actually settle. Around that sits the gating story: a fast text-replay diff before save, a configuration audit before publish, quality and post-call suites before go-live, and scheduled drift and canary runs after, each required with a recorded override so hotfixes stay possible and silent skipping does not.