calibrated-agent-evaluation dump¶
write the store's traces and labels, and the local root's records, to a directory (--judges-only: just what another store needs to score with given judges)
usage: calibrated-agent-evaluation dump [-h] [--judges-only] [--judge FILE] [--profile PROFILE]
[--region REGION] [--backend {local,langfuse}]
[--root PATH] [--explain]
directory
positional arguments:
directory target directory for the CSV+JSON artifact set
options:
-h, --help show this help message and exit
--judges-only export only what another store needs to admit and score with the --judge
files: each file with its certifying calibration record and CLEAR bias
battery (no traces or labels); `calibrated-agent-evaluation load DIR`
restores it
--judge FILE a judge file to export with --judges-only (repeatable)
--profile PROFILE an AgentCore judge file: AWS profile (default: AWS_PROFILE)
--region REGION an AgentCore judge file: AWS region (default: the profile's)
--backend {local,langfuse}
trace-store backend (default: local, offline)
--root PATH local root for the trace store and the stage records (default:
$CALIBRATED_AGENT_EVALUATION_LOCAL_ROOT, else ./.calibrated-agent-
evaluation; quickstart defaults to a temp dir)
--explain after the plain summary, print the statistics behind it (bounds, methods,
thresholds, record paths); CALIBRATED_AGENT_EVALUATION_EXPLAIN=1 turns it
on for every command