generative-ai-cdk-constructs

@cdklabs/generative-ai-cdk-constructs


@cdklabs/generative-ai-cdk-constructs / bedrock / PromptConfiguration

Interface: PromptConfiguration

Contains configurations to override a prompt template in one part of an agent sequence.

Properties

basePromptTemplate

readonly basePromptTemplate: string

Defines the prompt template with which to replace the default prompt template.

length 0-100000


inferenceConfiguration

readonly inferenceConfiguration: InferenceConfiguration

Contains inference parameters to use when the agent invokes a foundation model in the part of the agent sequence defined by the promptType.


parserMode?

readonly optional parserMode: ParserMode

Specifies whether to override the default parser Lambda function when parsing the raw foundation model output in the part of the agent sequence defined by the promptType. If you set the field as OVERRIDEN, the overrideLambda field in the PromptOverrideConfiguration must be specified with the ARN of a Lambda function.


promptCreationMode

readonly promptCreationMode: PromptCreationMode

Specifies whether to override the default prompt template for this promptType. Set this value to OVERRIDDEN to use the prompt that you provide in the basePromptTemplate. If you leave it as DEFAULT, the agent uses a default prompt template.


promptState

readonly promptState: PromptState

Specifies whether to allow the agent to carry out the step specified in the promptType. If you set this value to DISABLED, the agent skips that step. The default state for each promptType is as follows.

PRE_PROCESSING – ENABLED
ORCHESTRATION – ENABLED
KNOWLEDGE_BASE_RESPONSE_GENERATION – ENABLED
POST_PROCESSING – DISABLED

promptType

readonly promptType: PromptType

The step in the agent sequence that this prompt configuration applies to.