Skip to main content

DataZoneMskAssetType

DataZone custom asset type for MSK topics.

Overview​

DataZoneMskAssetType is a custom asset type implementation for Kafka topics hosted in MSK clusters. MSK clusters can be provisioned or serverless. Topics can be linked to a Glue Schema Registry. The construct is a CDK custom resource that creates the corresponding DataZone Form Types and Asset Type required to store metadata related to MSK Topics. It includes:

  • A MSK Source Reference Form Type containing metadata about the MSK Cluster including the cluster ARN and type.
  • A Kafka Schema For Type containing metadata about the topic including the topic name, schema version, Glue Schema Registry ARN and Glue Schema ARN.

DataZone MSK asset type

Usage​

new dsf.governance.DataZoneMskAssetType(this, 'DataZoneMskAssetType', {
domainId: 'aba_dc999t9ime9sss',
});

Reusing an existing owner project​

The DataZoneMskAssetType requires a DataZone project to own the custom asset type. By default, it will create a MskGovernance project within the domain but you pass an existing project. The construct will make the IAM custom resource Role a member of the projectto be able to create the asset type and the form types.

new dsf.governance.DataZoneMskAssetType(this, 'DataZoneMskAssetType', {
domainId: 'aba_dc999t9ime9sss',
projectId: 'xxxxxxxxxxx'
});

Reusing a Custom Asset Type Factory​

By default, the DataZoneMskAssetType creates its own factory resources required to connect to DataZone and create the custom asset type. But it's possible to reuse a Factory across multiple Custom Asset Types to limit the number of custom resource providers and DataZone project membership:

  const dataZoneAssetFactory = new dsf.governance.DataZoneCustomAssetTypeFactory(this, 'DataZoneCustomAssetTypeFactory', {
    domainId: 'aba_dc999t9ime9sss',
  });

  new dsf.governance.DataZoneMskAssetType(this, 'DataZoneMskAssetType', {
    domainId: 'aba_dc999t9ime9sss',
    projectId: 'xxxxxxxxxxx',
    dzCustomAssetTypeFactory: dataZoneAssetFactory
  });