Gen AI Evaluation Toolkit on AWS

v2.0.0

Copyright © 2026 Amazon Web Services, Inc. and/or its affiliates. All rights reserved. Amazon’s trademarks and trade dress may not be used in connection with any product or service that is not Amazon’s, in any manner that is likely to cause confusion among customers, or in any manner that disparages or discredits Amazon. All other trademarks not owned by Amazon are the property of their respective owners, who may or may not be affiliated with, connected to, or sponsored by Amazon.

Table of contents

• Class: SubmitScoringJobCommand
  • Example
  • Param
  • See
  • Throws
  • Throws
  • Throws
  • Throws
  • Throws
  • Throws
  • Extends
  • Constructors

@awssolutions/gen-ai-evaluation-toolkit-ts-client

---

@awssolutions/gen-ai-evaluation-toolkit-ts-client / SubmitScoringJobCommand

Class: SubmitScoringJobCommand

Submit a scoring-only job: score existing results in a report

Example

Use a bare-bones client and the command you need to make an API call.

import { GenAiEvaluationToolkitClient, SubmitScoringJobCommand } from "@awssolutions/gen-ai-evaluation-toolkit-ts-client"; // ES Modules import
// const { GenAiEvaluationToolkitClient, SubmitScoringJobCommand } = require("@awssolutions/gen-ai-evaluation-toolkit-ts-client"); // CommonJS import
// import type { GenAiEvaluationToolkitClientConfig } from "@awssolutions/gen-ai-evaluation-toolkit-ts-client";
const config = {}; // type is GenAiEvaluationToolkitClientConfig
const client = new GenAiEvaluationToolkitClient(config);
const input = { // SubmitScoringJobInput
  reportName: "STRING_VALUE",
  experimentName: "STRING_VALUE",
  processLocally: true || false,
  continueBufferMs: Number("int"),
  heartbeatSeconds: Number("int"),
  evaluatorName: "STRING_VALUE", // required
  reportId: "STRING_VALUE",
  sourceReportId: "STRING_VALUE",
  testResults: [ // InlineTestResultList
    { // InlineTestResult
      input: "DOCUMENT_VALUE",
      expected: "DOCUMENT_VALUE",
      context: "DOCUMENT_VALUE",
      metadata: "DOCUMENT_VALUE",
      output: "DOCUMENT_VALUE",
    },
  ],
  scorers: { // ScorerMap
    "<keys>": { // ScorerConfig
      params: "DOCUMENT_VALUE",
      scores: { // SubScoreMap
        "<keys>": "DOCUMENT_VALUE",
      },
      evaluatorName: "STRING_VALUE",
    },
  },
};
const command = new SubmitScoringJobCommand(input);
const response = await client.send(command);
// { // SubmitScoringJobOutput
//   jobId: "STRING_VALUE", // required
//   reportId: "STRING_VALUE", // required
//   sourceReportId: "STRING_VALUE",
//   evaluatorName: "STRING_VALUE", // required
//   jobType: "FULL" || "SCORE" || "APP_INVOKE", // required
//   status: "PENDING" || "RUNNING" || "SUCCESS" || "PARTIAL_FAILURE" || "FAILURE", // required
//   experimentName: "STRING_VALUE",
//   createdAt: new Date("TIMESTAMP"),
//   job: { // EvaluationJob
//     jobId: "STRING_VALUE", // required
//     evaluatorName: "STRING_VALUE", // required
//     jobType: "FULL" || "SCORE" || "APP_INVOKE", // required
//     testCases: { // TestDataSource Union: only one key present
//       dataset: { // DatasetReference
//         datasetId: "STRING_VALUE", // required
//         datasetVersion: "STRING_VALUE",
//         filter: { // AnnotationConditionExpression Union: only one key present
//           condition: { // AnnotationCondition Union: only one key present
//             numericCondition: { // NumericAnnotationCondition
//               name: "STRING_VALUE", // required
//               value: Number("float"), // required
//               comparator: "=" || "!=" || "<" || "<=" || ">" || ">=", // required
//             },
//             stringEnumCondition: { // StringEnumAnnotationCondition
//               name: "STRING_VALUE", // required
//               value: "STRING_VALUE", // required
//               comparator: "=" || "!=", // required
//             },
//           },
//           and: [ // AnnotationConditionExpressionList
//             {//  Union: only one key present
//               condition: {//  Union: only one key present
//                 numericCondition: {
//                   name: "STRING_VALUE", // required
//                   value: Number("float"), // required
//                   comparator: "=" || "!=" || "<" || "<=" || ">" || ">=", // required
//                 },
//                 stringEnumCondition: {
//                   name: "STRING_VALUE", // required
//                   value: "STRING_VALUE", // required
//                   comparator: "=" || "!=", // required
//                 },
//               },
//               and: [
//                 "<AnnotationConditionExpression>",
//               ],
//               or: [
//                 "<AnnotationConditionExpression>",
//               ],
//               not: "<AnnotationConditionExpression>",
//             },
//           ],
//           or: [
//             "<AnnotationConditionExpression>",
//           ],
//           not: "<AnnotationConditionExpression>",
//         },
//       },
//       inline: [ // InlineTestCaseList
//         { // InlineTestCase
//           input: "DOCUMENT_VALUE",
//           expected: "DOCUMENT_VALUE",
//           context: "DOCUMENT_VALUE",
//           metadata: "DOCUMENT_VALUE",
//         },
//       ],
//     },
//     reportId: "STRING_VALUE", // required
//     sourceReportId: "STRING_VALUE",
//     scorers: { // ScorerMap
//       "<keys>": { // ScorerConfig
//         params: "DOCUMENT_VALUE",
//         scores: { // SubScoreMap
//           "<keys>": "DOCUMENT_VALUE",
//         },
//         evaluatorName: "STRING_VALUE",
//       },
//     },
//     experimentName: "STRING_VALUE",
//     createdAt: new Date("TIMESTAMP"),
//   },
// };

Param

SubmitScoringJobCommandInput

See

• SubmitScoringJobCommandInput for command's input shape.
• SubmitScoringJobCommandOutput for command's response shape.
• config for GenAiEvaluationToolkitClient's config shape.

Throws

ValidationException (client fault) A standard error for input validation failures. This should be thrown by services when a member of the input structure falls outside of the modeled or documented constraints.

Throws

UnauthorizedException (client fault) UnauthorizedException is thrown when request is missing or has bad auth

Throws

ThrottlingException (client fault) ThrottlingException is thrown when request was denied due to request throttling

Throws

InternalServerException (server fault) InternalServerException is thrown when unexpected error occurs during processing of request

Throws

ResourceNotFoundException (client fault) ResourceNotFoundException is thrown when request references a resource which does not exist

Throws

GenAiEvaluationToolkitServiceException

Base exception class for all service exceptions from GenAiEvaluationToolkit service.

Extends

• CommandImpl\<SubmitScoringJobCommandInput, SubmitScoringJobCommandOutput, GenAiEvaluationToolkitClientResolvedConfig, ServiceInputTypes, ServiceOutputTypes, this>

Constructors

Constructor

new SubmitScoringJobCommand(input): SubmitScoringJobCommand

Parameters

input

SubmitScoringJobCommandInput

Returns

SubmitScoringJobCommand

Inherited from

$Command .classBuilder< SubmitScoringJobCommandInput, SubmitScoringJobCommandOutput, GenAiEvaluationToolkitClientResolvedConfig, ServiceInputTypes, ServiceOutputTypes >() .ep(commonParams) .m(function (this: any, Command: any, cs: any, config: GenAiEvaluationToolkitClientResolvedConfig, o: any) { return [getEndpointPlugin(config, Command.getEndpointParameterInstructions())]; }) .s("GenAiEtk", "SubmitScoringJob", {}) .n("GenAiEvaluationToolkitClient", "SubmitScoringJobCommand") .sc(SubmitScoringJob$) .build().constructor

Constructor

new SubmitScoringJobCommand(...__namedParameters): SubmitScoringJobCommand

Parameters

__namedParameters

...[SubmitScoringJobCommandInput]

Returns

SubmitScoringJobCommand

Inherited from

$Command .classBuilder< SubmitScoringJobCommandInput, SubmitScoringJobCommandOutput, GenAiEvaluationToolkitClientResolvedConfig, ServiceInputTypes, ServiceOutputTypes >() .ep(commonParams) .m(function (this: any, Command: any, cs: any, config: GenAiEvaluationToolkitClientResolvedConfig, o: any) { return [getEndpointPlugin(config, Command.getEndpointParameterInstructions())]; }) .s("GenAiEtk", "SubmitScoringJob", {}) .n("GenAiEvaluationToolkitClient", "SubmitScoringJobCommand") .sc(SubmitScoringJob$) .build().constructor