calibrated-agent-evaluation load¶
read a dump directory back into the store and the local root's records
usage: calibrated-agent-evaluation load [-h] [--format {json,csv}] [--backend {local,langfuse}]
[--root PATH] [--explain]
directory
positional arguments:
directory directory written by `calibrated-agent-evaluation dump` (a judges-only
dump is recognized by its manifest)
options:
-h, --help show this help message and exit
--format {json,csv} which file of the pair to read (default: json, the lossless one; csv is
the human-readable mirror)
--backend {local,langfuse}
trace-store backend (default: local, offline)
--root PATH local root for the trace store and the stage records (default:
$CALIBRATED_AGENT_EVALUATION_LOCAL_ROOT, else ./.calibrated-agent-
evaluation; quickstart defaults to a temp dir)
--explain after the plain summary, print the statistics behind it (bounds, methods,
thresholds, record paths); CALIBRATED_AGENT_EVALUATION_EXPLAIN=1 turns it
on for every command