aws_ddk_core package

Base

BaseStack(*args, **kwargs)

Base Stack to inherit from.

CICD

CICDPipelineStack(*args, **kwargs)

Create a stack that contains DDK Continuous Integration and Delivery (CI/CD) pipeline.

Config

Config([config_strategy])

Class used to read configuration with a configurable strategy.

JSONConfigStrategy([path])

Read config from ddk.json in the root of the repo.

Data Pipelines

DataPipeline(*args, **kwargs)

Class that represents a data pipeline.

DataStage(*args, **kwargs)

Class that represents a data stage within a data pipeline.

EventStage(*args, **kwargs)

Class that represents an event stage within a data pipeline.

StateMachineStage(*args, **kwargs)

DataStage with helper methods to simplify StateMachine stages creation.

Resources

DataBrewFactory()

Class factory to create and configure DataBrew DDK resources, including Jobs.

DMSFactory()

Class factory create and configure DMS DDK resources, including endpoints, replication tasks and replication instances.

GlueFactory()

Class factory to create and configure Glue DDK resources, including Jobs.

KinesisFirehoseFactory()

Class factory create and configure Kinesis DDK resources, including Delivery Streams.

KinesisStreamsFactory()

Class factory create and configure Kinesis DDK resources, including Data Streams.

KMSFactory()

Class factory to create and configure Key Management Service DDK resources, including Keys.

LambdaFactory()

Class factory to create and configure Lambda DDK resources, including Functions.

S3Factory()

Class factory to create and configure Simple Storage Service DDK resources, including Buckets.

SQSFactory()

Class factory create and configure Simple Queue Service DDK resources, including Queues.

StepFunctionsFactory()

Class factory create and configure AWS Step Functions Service DDK resources, including State Machines.

Data Stages

AppFlowIngestionStage(*args, **kwargs)

Class that represents an AppFlow DDK DataStage.

AthenaSQLStage(*args, **kwargs)

Class that represents a Athena SQL DDK DataStage.

DataBrewTransformStage(*args, **kwargs)

Class that represents a DataBrew Transform DDK DataStage.

DMSS3ToS3Stage(*args, **kwargs)

Class that represents a DMS to S3 to S3 Replication DDK Stage.

GlueTransformStage(*args, **kwargs)

Class that represents a Glue Transform DDK DataStage.

KinesisToS3Stage(*args, **kwargs)

Class that represents a Firehose to S3 Ingestion DDK Stage.

S3EventStage(*args, **kwargs)

Class that represents an S3 Event DDK Stage.

SqsToLambdaStage(*args, **kwargs)

Class that represents an SQS to Lambda Transform DDK Stage.