calibrated-agent-evaluation results¶
write every stored estimate (intervals, bounds, refusals) to one CSV table
usage: calibrated-agent-evaluation results [-h] --out FILE [--backend {local,langfuse}]
[--root PATH] [--explain]
Read every record under <root>/records/ and write one CSV row per interval or bound, with its
method, level, sidedness, n and provenance; a refused estimate keeps its row with the reason.
options:
-h, --help show this help message and exit
--out FILE CSV file to write: one row per stored estimate, refusals included
--backend {local,langfuse}
trace-store backend (default: local, offline)
--root PATH local root for the trace store and the stage records (default:
$CALIBRATED_AGENT_EVALUATION_LOCAL_ROOT, else ./.calibrated-agent-
evaluation; quickstart defaults to a temp dir)
--explain after the plain summary, print the statistics behind it (bounds, methods,
thresholds, record paths); CALIBRATED_AGENT_EVALUATION_EXPLAIN=1 turns it
on for every command