📄️ Introduction
Note: The blueprints for streaming platforms are currently in the process of development.
📄️ EMR on EKS with Spark Streaming
This is a project developed in Python CDK.
📄️ EMR on EKS with Flink Streaming
Please note that we are working on adding more features to this blueprint such as Flink examples with multiple connectors, Ingress for WebUI, Grafana dashboards etc.
📄️ Flink Operator on EKS
Please note that we are working on adding more features to this blueprint such as Flink examples with multiple connectors, Ingress for WebUI, Grafana dashboards etc.
📄️ Kafka on EKS
Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications.
📄️ Apache NiFi on EKS
Introduction
📄️ Spark Streaming from Kafka in EKS
This example showcases the usage of Spark Operator to create a producer and consumer stack using Kafka (Amazon MSK). The main idea is to show Spark Streaming working with Kafka, persisting data in Parquet format using Apache Iceberg.