Skip to content

calibrated-agent-evaluation dump

write the store's traces and labels, and the local root's records, to a directory (--judges-only: just what another store needs to score with given judges)

usage: calibrated-agent-evaluation dump [-h] [--judges-only] [--judge FILE] [--profile PROFILE]
                                        [--region REGION] [--backend {local,langfuse}]
                                        [--root PATH] [--explain]
                                        directory

positional arguments:
  directory             target directory for the CSV+JSON artifact set

options:
  -h, --help            show this help message and exit
  --judges-only         export only what another store needs to admit and score with the --judge
                        files: each file with its certifying calibration record and CLEAR bias
                        battery (no traces or labels); `calibrated-agent-evaluation load DIR`
                        restores it
  --judge FILE          a judge file to export with --judges-only (repeatable)
  --profile PROFILE     an AgentCore judge file: AWS profile (default: AWS_PROFILE)
  --region REGION       an AgentCore judge file: AWS region (default: the profile's)
  --backend {local,langfuse}
                        trace-store backend (default: local, offline)
  --root PATH           local root for the trace store and the stage records (default:
                        $CALIBRATED_AGENT_EVALUATION_LOCAL_ROOT, else ./.calibrated-agent-
                        evaluation; quickstart defaults to a temp dir)
  --explain             after the plain summary, print the statistics behind it (bounds, methods,
                        thresholds, record paths); CALIBRATED_AGENT_EVALUATION_EXPLAIN=1 turns it
                        on for every command