Skip to content

calibrated-agent-evaluation load

read a dump directory back into the store and the local root's records

usage: calibrated-agent-evaluation load [-h] [--format {json,csv}] [--backend {local,langfuse}]
                                        [--root PATH] [--explain]
                                        directory

positional arguments:
  directory             directory written by `calibrated-agent-evaluation dump` (a judges-only
                        dump is recognized by its manifest)

options:
  -h, --help            show this help message and exit
  --format {json,csv}   which file of the pair to read (default: json, the lossless one; csv is
                        the human-readable mirror)
  --backend {local,langfuse}
                        trace-store backend (default: local, offline)
  --root PATH           local root for the trace store and the stage records (default:
                        $CALIBRATED_AGENT_EVALUATION_LOCAL_ROOT, else ./.calibrated-agent-
                        evaluation; quickstart defaults to a temp dir)
  --explain             after the plain summary, print the statistics behind it (bounds, methods,
                        thresholds, record paths); CALIBRATED_AGENT_EVALUATION_EXPLAIN=1 turns it
                        on for every command