Gen AI Evaluation Toolkit on AWS
v2.0.0
Copyright © 2026 Amazon Web Services, Inc. and/or its affiliates. All rights reserved. Amazon’s trademarks and trade dress may not be used in connection with any product or service that is not Amazon’s, in any manner that is likely to cause confusion among customers, or in any manner that disparages or discredits Amazon. All other trademarks not owned by Amazon are the property of their respective owners, who may or may not be affiliated with, connected to, or sponsored by Amazon.
Table of contents
@awssolutions/gen-ai-evaluation-toolkit-ts-client
@awssolutions/gen-ai-evaluation-toolkit-ts-client¶
Namespaces¶
- AnnotationCondition
- AnnotationConditionExpression
- AnnotationValue
- AnnotationValueType
- Condition
- ConditionExpression
- TestDataSource
- WorkflowConfiguration
Enumerations¶
- DatasetStatus
- JobStage
- JobStatus
- JobType
- LifecycleStage
- NumericLogicalComparator
- ReportStatus
- StepFunctionJobStatus
- StringEnumLogicalComparator
- TaskStatus
- ViewType
- Workflow
Classes¶
- ArchiveAnnotationSchemaCommand
- BatchCreateResultsCommand
- BatchDeleteResultsCommand
- BatchUpdateScoresCommand
- ConflictException
- CreateAnnotationSchemaCommand
- CreateConfigurationCommand
- CreateDatasetCommand
- CreateDatasetVersionCommand
- CreateExperimentCommand
- CreateJobSchedulerCommand
- CreateReportCommand
- CreateTestCaseCommand
- DeleteDatasetCommand
- DeleteDatasetVersionAnnotationCommand
- DeleteExperimentCommand
- DeleteJobSchedulerCommand
- DeleteReportCommand
- DeleteTestCaseAnnotationCommand
- DeleteTestCaseCommand
- ExecutionLimitExceeded
- GenAiEvaluationToolkit
- GenAiEvaluationToolkitClient
- GenAiEvaluationToolkitServiceException
- GetAnnotationSchemaCommand
- GetConfigurationCommand
- GetDatasetCommand
- GetDatasetVersionCommand
- GetEvaluatorJobCommand
- GetExperimentCommand
- GetGenerationCommand
- GetJobSchedulerCommand
- GetReportCommand
- GetTestCaseCommand
- GetTestResultCommand
- InternalServerException
- ListAnnotationSchemasCommand
- ListConfigurationsCommand
- ListDatasetsCommand
- ListDatasetVersionsCommand
- ListExperimentOutputsCommand
- ListExperimentsCommand
- ListGenerationsCommand
- ListJobSchedulersCommand
- ListJobsCommand
- ListReportsCommand
- ListTestCasesCommand
- ListTestResultsCommand
- PutDatasetVersionAnnotationCommand
- PutTestCaseAnnotationCommand
- ResourceNotFoundException
- RestoreDatasetCommand
- StartGenerationCommand
- StopGenerationCommand
- SubmitAppInvocationJobCommand
- SubmitEvaluationJobCommand
- SubmitScoringJobCommand
- ThrottlingException
- UnauthorizedException
- UnprocessableEntityException
- UpdateConfigurationCommand
- UpdateEvaluatorJobStatusCommand
- UpdateExperimentCommand
- UpdateJobSchedulerCommand
- ValidationException
Interfaces¶
- Annotation
- AnnotationSchema
- AppConfig
- ArchiveAnnotationSchemaCommandInput
- ArchiveAnnotationSchemaCommandOutput
- ArchiveAnnotationSchemaRequest
- AsyncContext
- BatchCreateResultsCommandInput
- BatchCreateResultsCommandOutput
- BatchCreateResultsInput
- BatchCreateResultsOutput
- BatchDeleteResultsCommandInput
- BatchDeleteResultsCommandOutput
- BatchDeleteResultsInput
- BatchDeleteResultsOutput
- BatchItemError
- BatchResultInput
- BatchResultOutput
- BatchScoreItem
- BatchUpdateScoresCommandInput
- BatchUpdateScoresCommandOutput
- BatchUpdateScoresInput
- BatchUpdateScoresOutput
- ClientDefaults
- ClientInputEndpointParameters
- ConfigurationDetail
- ConfigurationReference
- CreateAnnotationSchemaCommandInput
- CreateAnnotationSchemaCommandOutput
- CreateAnnotationSchemaRequest
- CreateConfigurationCommandInput
- CreateConfigurationCommandOutput
- CreateConfigurationRequest
- CreateConfigurationResponse
- CreateDatasetCommandInput
- CreateDatasetCommandOutput
- CreateDatasetRequest
- CreateDatasetVersionCommandInput
- CreateDatasetVersionCommandOutput
- CreateDatasetVersionRequest
- CreateDatasetVersionResponse
- CreateExperimentCommandInput
- CreateExperimentCommandOutput
- CreateExperimentRequest
- CreateExperimentResponse
- CreateJobSchedulerCommandInput
- CreateJobSchedulerCommandOutput
- CreateJobSchedulerInput
- CreateJobSchedulerOutput
- CreateReportCommandInput
- CreateReportCommandOutput
- CreateReportInput
- CreateReportOutput
- CreateTestCaseCommandInput
- CreateTestCaseCommandOutput
- CreateTestCaseRequest
- Dataset
- DatasetReference
- DatasetVersion
- DeleteDatasetCommandInput
- DeleteDatasetCommandOutput
- DeleteDatasetRequest
- DeleteDatasetVersionAnnotationCommandInput
- DeleteDatasetVersionAnnotationCommandOutput
- DeleteDatasetVersionAnnotationRequest
- DeleteExperimentCommandInput
- DeleteExperimentCommandOutput
- DeleteExperimentRequest
- DeleteJobSchedulerCommandInput
- DeleteJobSchedulerCommandOutput
- DeleteJobSchedulerInput
- DeleteJobSchedulerOutput
- DeleteReportCommandInput
- DeleteReportCommandOutput
- DeleteReportInput
- DeleteReportOutput
- DeleteTestCaseAnnotationCommandInput
- DeleteTestCaseAnnotationCommandOutput
- DeleteTestCaseAnnotationRequest
- DeleteTestCaseCommandInput
- DeleteTestCaseCommandOutput
- DeleteTestCaseRequest
- DeleteTestCaseResponse
- EvaluationJob
- EvaluatorJobSummary
- Experiment
- ExperimentOutput
- ExperimentTag
- GenAiEvaluationToolkitClientConfig
- GenAiEvaluationToolkitClientResolvedConfig
- GenAiEvaluationToolkitExtensionConfiguration
- GenAiEvaluationToolkitPaginationConfiguration
- GenerationJobListItem
- GenerationStep
- GetAnnotationSchemaCommandInput
- GetAnnotationSchemaCommandOutput
- GetAnnotationSchemaRequest
- GetConfigurationCommandInput
- GetConfigurationCommandOutput
- GetConfigurationRequest
- GetConfigurationResponse
- GetDatasetCommandInput
- GetDatasetCommandOutput
- GetDatasetRequest
- GetDatasetVersionCommandInput
- GetDatasetVersionCommandOutput
- GetDatasetVersionRequest
- GetEvaluatorJobCommandInput
- GetEvaluatorJobCommandOutput
- GetEvaluatorJobInput
- GetEvaluatorJobOutput
- GetExperimentCommandInput
- GetExperimentCommandOutput
- GetExperimentRequest
- GetExperimentResponse
- GetGenerationCommandInput
- GetGenerationCommandOutput
- GetGenerationInput
- GetGenerationOutput
- GetJobSchedulerCommandInput
- GetJobSchedulerCommandOutput
- GetJobSchedulerInput
- GetJobSchedulerOutput
- GetReportCommandInput
- GetReportCommandOutput
- GetReportInput
- GetReportOutput
- GetTestCaseCommandInput
- GetTestCaseCommandOutput
- GetTestCaseRequest
- GetTestResultCommandInput
- GetTestResultCommandOutput
- GetTestResultInput
- GetTestResultOutput
- InlineTestCase
- InlineTestResult
- JobError
- JobSchedulerSummary
- ListAnnotationSchemasCommandInput
- ListAnnotationSchemasCommandOutput
- ListAnnotationSchemasRequest
- ListAnnotationSchemasResponse
- ListConfigurationsCommandInput
- ListConfigurationsCommandOutput
- ListConfigurationsRequest
- ListConfigurationsResponse
- ListDatasetsCommandInput
- ListDatasetsCommandOutput
- ListDatasetsRequest
- ListDatasetsResponse
- ListDatasetVersionsCommandInput
- ListDatasetVersionsCommandOutput
- ListDatasetVersionsRequest
- ListDatasetVersionsResponse
- ListExperimentOutputsCommandInput
- ListExperimentOutputsCommandOutput
- ListExperimentOutputsRequest
- ListExperimentOutputsResponse
- ListExperimentsCommandInput
- ListExperimentsCommandOutput
- ListExperimentsRequest
- ListExperimentsResponse
- ListGenerationsCommandInput
- ListGenerationsCommandOutput
- ListGenerationsInput
- ListGenerationsOutput
- ListJobSchedulersCommandInput
- ListJobSchedulersCommandOutput
- ListJobSchedulersInput
- ListJobSchedulersOutput
- ListJobsCommandInput
- ListJobsCommandOutput
- ListJobsInput
- ListJobsOutput
- ListReportsCommandInput
- ListReportsCommandOutput
- ListReportsInput
- ListReportsOutput
- ListTestCasesCommandInput
- ListTestCasesCommandOutput
- ListTestCasesRequest
- ListTestCasesResponse
- ListTestResultsCommandInput
- ListTestResultsCommandOutput
- ListTestResultsInput
- ListTestResultsOutput
- NumericAnnotationCondition
- NumericCondition
- OrchestrationContext
- PutDatasetVersionAnnotationCommandInput
- PutDatasetVersionAnnotationCommandOutput
- PutDatasetVersionAnnotationRequest
- PutTestCaseAnnotationCommandInput
- PutTestCaseAnnotationCommandOutput
- PutTestCaseAnnotationRequest
- Report
- RestoreDatasetCommandInput
- RestoreDatasetCommandOutput
- RestoreDatasetRequest
- RestoreDatasetResponse
- Run
- RuntimeExtension
- ScoreInput
- ScoreOutput
- ScorerConfig
- StartGenerationCommandInput
- StartGenerationCommandOutput
- StartGenerationInput
- StartGenerationOutput
- StopGenerationCommandInput
- StopGenerationCommandOutput
- StopGenerationInput
- StopGenerationOutput
- StringConfigurations
- StringEnumAnnotationCondition
- StringEnumCondition
- SubmitAppInvocationJobCommandInput
- SubmitAppInvocationJobCommandOutput
- SubmitAppInvocationJobInput
- SubmitAppInvocationJobOutput
- SubmitEvaluationJobCommandInput
- SubmitEvaluationJobCommandOutput
- SubmitEvaluationJobInput
- SubmitEvaluationJobOutput
- SubmitScoringJobCommandInput
- SubmitScoringJobCommandOutput
- SubmitScoringJobInput
- SubmitScoringJobOutput
- TaskState
- TestCase
- TestCaseReference
- TestResult
- Unit
- UpdateConfigurationCommandInput
- UpdateConfigurationCommandOutput
- UpdateConfigurationRequest
- UpdateConfigurationResponse
- UpdateEvaluatorJobStatusCommandInput
- UpdateEvaluatorJobStatusCommandOutput
- UpdateEvaluatorJobStatusInput
- UpdateEvaluatorJobStatusOutput
- UpdateExperimentCommandInput
- UpdateExperimentCommandOutput
- UpdateExperimentRequest
- UpdateExperimentResponse
- UpdateJobSchedulerCommandInput
- UpdateJobSchedulerCommandOutput
- UpdateJobSchedulerInput
- UpdateJobSchedulerOutput
- ValidationExceptionField
Type Aliases¶
- AnnotationCondition
- AnnotationConditionExpression
- AnnotationValue
- AnnotationValueType
- Condition
- ConditionExpression
- GenAiEvaluationToolkitClientConfigType
- GenAiEvaluationToolkitClientResolvedConfigType
- ServiceInputTypes
- ServiceOutputTypes
- TestDataSource
- WorkflowConfiguration
Variables¶
- Annotation$
- AnnotationCondition$
- AnnotationConditionExpression$
- AnnotationSchema$
- AnnotationValue$
- AnnotationValueType$
- AppConfig$
- ArchiveAnnotationSchema$
- ArchiveAnnotationSchemaRequest$
- AsyncContext$
- BatchCreateResults$
- BatchCreateResultsInput$
- BatchCreateResultsOutput$
- BatchDeleteResults$
- BatchDeleteResultsInput$
- BatchDeleteResultsOutput$
- BatchItemError$
- BatchResultInput$
- BatchResultOutput$
- BatchScoreItem$
- BatchUpdateScores$
- BatchUpdateScoresInput$
- BatchUpdateScoresOutput$
- Condition$
- ConditionExpression$
- ConfigurationDetail$
- ConfigurationReference$
- ConflictException$
- CreateAnnotationSchema$
- CreateAnnotationSchemaRequest$
- CreateConfiguration$
- CreateConfigurationRequest$
- CreateConfigurationResponse$
- CreateDataset$
- CreateDatasetRequest$
- CreateDatasetVersion$
- CreateDatasetVersionRequest$
- CreateDatasetVersionResponse$
- CreateExperiment$
- CreateExperimentRequest$
- CreateExperimentResponse$
- CreateJobScheduler$
- CreateJobSchedulerInput$
- CreateJobSchedulerOutput$
- CreateReport$
- CreateReportInput$
- CreateReportOutput$
- CreateTestCase$
- CreateTestCaseRequest$
- Dataset$
- DatasetReference$
- DatasetVersion$
- DeleteDataset$
- DeleteDatasetRequest$
- DeleteDatasetVersionAnnotation$
- DeleteDatasetVersionAnnotationRequest$
- DeleteExperiment$
- DeleteExperimentRequest$
- DeleteJobScheduler$
- DeleteJobSchedulerInput$
- DeleteJobSchedulerOutput$
- DeleteReport$
- DeleteReportInput$
- DeleteReportOutput$
- DeleteTestCase$
- DeleteTestCaseAnnotation$
- DeleteTestCaseAnnotationRequest$
- DeleteTestCaseRequest$
- DeleteTestCaseResponse$
- errorTypeRegistries
- EvaluationJob$
- EvaluatorJobSummary$
- ExecutionLimitExceeded$
- Experiment$
- ExperimentOutput$
- ExperimentTag$
- GenAiEvaluationToolkitServiceException$
- GenerationJobListItem$
- GenerationStep$
- GetAnnotationSchema$
- GetAnnotationSchemaRequest$
- GetConfiguration$
- GetConfigurationRequest$
- GetConfigurationResponse$
- GetDataset$
- GetDatasetRequest$
- GetDatasetVersion$
- GetDatasetVersionRequest$
- GetEvaluatorJob$
- GetEvaluatorJobInput$
- GetEvaluatorJobOutput$
- GetExperiment$
- GetExperimentRequest$
- GetExperimentResponse$
- GetGeneration$
- GetGenerationInput$
- GetGenerationOutput$
- GetJobScheduler$
- GetJobSchedulerInput$
- GetJobSchedulerOutput$
- GetReport$
- GetReportInput$
- GetReportOutput$
- GetTestCase$
- GetTestCaseRequest$
- GetTestResult$
- GetTestResultInput$
- GetTestResultOutput$
- InlineTestCase$
- InlineTestResult$
- InternalServerException$
- JobError$
- JobSchedulerSummary$
- ListAnnotationSchemas$
- ListAnnotationSchemasRequest$
- ListAnnotationSchemasResponse$
- ListConfigurations$
- ListConfigurationsRequest$
- ListConfigurationsResponse$
- ListDatasets$
- ListDatasetsRequest$
- ListDatasetsResponse$
- ListDatasetVersions$
- ListDatasetVersionsRequest$
- ListDatasetVersionsResponse$
- ListExperimentOutputs$
- ListExperimentOutputsRequest$
- ListExperimentOutputsResponse$
- ListExperiments$
- ListExperimentsRequest$
- ListExperimentsResponse$
- ListGenerations$
- ListGenerationsInput$
- ListGenerationsOutput$
- ListJobs$
- ListJobSchedulers$
- ListJobSchedulersInput$
- ListJobSchedulersOutput$
- ListJobsInput$
- ListJobsOutput$
- ListReports$
- ListReportsInput$
- ListReportsOutput$
- ListTestCases$
- ListTestCasesRequest$
- ListTestCasesResponse$
- ListTestResults$
- ListTestResultsInput$
- ListTestResultsOutput$
- NumericAnnotationCondition$
- NumericCondition$
- OrchestrationContext$
- paginateListAnnotationSchemas
- paginateListConfigurations
- paginateListDatasets
- paginateListDatasetVersions
- paginateListExperimentOutputs
- paginateListExperiments
- paginateListGenerations
- paginateListJobs
- paginateListReports
- paginateListTestCases
- paginateListTestResults
- PutDatasetVersionAnnotation$
- PutDatasetVersionAnnotationRequest$
- PutTestCaseAnnotation$
- PutTestCaseAnnotationRequest$
- Report$
- ResourceNotFoundException$
- RestoreDataset$
- RestoreDatasetRequest$
- RestoreDatasetResponse$
- Run$
- ScoreInput$
- ScoreOutput$
- ScorerConfig$
- StartGeneration$
- StartGenerationInput$
- StartGenerationOutput$
- StopGeneration$
- StopGenerationInput$
- StopGenerationOutput$
- StringConfigurations$
- StringEnumAnnotationCondition$
- StringEnumCondition$
- SubmitAppInvocationJob$
- SubmitAppInvocationJobInput$
- SubmitAppInvocationJobOutput$
- SubmitEvaluationJob$
- SubmitEvaluationJobInput$
- SubmitEvaluationJobOutput$
- SubmitScoringJob$
- SubmitScoringJobInput$
- SubmitScoringJobOutput$
- TaskState$
- TestCase$
- TestCaseReference$
- TestDataSource$
- TestResult$
- ThrottlingException$
- UnauthorizedException$
- UnprocessableEntityException$
- UpdateConfiguration$
- UpdateConfigurationRequest$
- UpdateConfigurationResponse$
- UpdateEvaluatorJobStatus$
- UpdateEvaluatorJobStatusInput$
- UpdateEvaluatorJobStatusOutput$
- UpdateExperiment$
- UpdateExperimentRequest$
- UpdateExperimentResponse$
- UpdateJobScheduler$
- UpdateJobSchedulerInput$
- UpdateJobSchedulerOutput$
- ValidationException$
- ValidationExceptionField$
- WorkflowConfiguration$