Pennoyer Systems
Retrieval for authoritative legal text that answers only in verbatim, cited spans.
Air-gapped and quote-locked: every answer is a passage that exists in the corpus, with its provenance attached. There is no free-generation path to hallucinate through.
Machine-graded under preregistered adversarial examination
1.73%fabrication
Texas · 7/404 sealed traps · Wilson 95% [0.8–3.5]
1.00%fabrication
Louisiana · 3/300 sealed traps, exactly flat · [0.3–2.9]
- Examination rules preregistered and signed before any result existed.
- Corpus-anchored false-premise traps; machine-graded; failures count against the score.
- Sealed one-shot holdouts — no re-runs, no tuning against the test.
For context: an independent 2024 Stanford study measured leading commercial legal-AI research tools at 17–33% hallucination on comparable questioning.
Inquiries: luke@pennoyersystems.com