verbatimeter - check how grounded your LLM / RAG agent is in real-time
Deterministic groundedness verification using longest common subsequence instead of judge models or embeddings.
Minimalist, deterministic, lightweight, fast, and portable verification of AI-generated text: measure groundedness in a source as verbatim reuse (contiguous matching) or verbatim paraphrasing (LCS). Use as a decorator over generate(), a CLI or a CI gate. Useful for research and production purposes.
Deterministic verbatim checking beats probabilistic evals for catching hallucinated quotes.
LLM application developers, RAG engineers
Ragas · Arize Phoenix · LangSmith
Deterministic groundedness verification using longest common subsequence instead of judge models or embeddings.
Fail-closed policy layer blocks LLM tool calls before execution, no LLM in decision path.
Deterministic FSM guards LLM outputs to prevent hallucination spirals in .NET.
Deterministic prompt compression cuts tokens 50-80% without extra model calls.
Finally separates JSON validity from actual value hallucination in LLM outputs.
It skips headless Chromium entirely and implements an HTML/CSS-to-PDF pipeline in Rust, exposing a Python wheel and CLI that releases the GIL and uses Rayon for parallel batch renders. The deterministic bits — fixed-point base unit, --repro-record/--repro-check, SHA256 outputs and vendored assets — are a clear, practical play for audited VDP/transactional workflows; what's still unknown is CSS spec coverage and whether subtle print-layout quirks will require hand-holding.