Debug retrieval failures and hidden behaviors in text embeddings.
-
Updated
May 23, 2026 - Python
Debug retrieval failures and hidden behaviors in text embeddings.
Portable, content-addressed reliability evidence for LLM systems. Capture how a model behaves under perturbation; preserve, verify, and diff the evidence across model changes.
yuragi — LLM Confidence Fragility Analyzer. Perturbation-driven hallucination detection with workshop-grade real benchmarks (TruthfulQA n=412 ensemble AUC 0.73, TriviaQA n=200 confidence-inversion AUC 0.75).
Add a description, image, and links to the perturbation-testing topic page so that developers can more easily learn about it.
To associate your repository with the perturbation-testing topic, visit your repo's landing page and select "manage topics."