Tag: Kafka
Creating Serverless Event Streaming Applications with Amazon MSK and AWS Lambda
by Jordan Smith and Alex Johnson
on 26 JUN 2025
in Amazon Managed Streaming for Apache Kafka (Amazon MSK), Analytics, AWS Lambda, Best Practices, Serverless
In this article, we explore how to enhance your event-driven application architecture through the integration of AWS Lambda with Amazon MSK. We provide a detailed guide on configuring Lambda to serve as a consumer for Kafka topics, covering cross-account setups and strategies to optimize both cost and performance for these applications. For more insights, check out this another blog post.
Developing a Scalable Streaming Data Platform for Real-Time and Batch Analytics of Electric Vehicles on AWS
by Emily Chen and Michael Brown
on 17 JUL 2024
in Amazon Managed Streaming for Apache Kafka (Amazon MSK), Amazon OpenSearch Service, Amazon QuickSight, Analytics, Best Practices, Internet of Things
The automotive sector is experiencing a significant shift due to the rising popularity of electric vehicles (EVs). Known for their eco-friendliness and sustainability, EVs are ushering in a new age of transportation. As environmental issues and the demand for greener technologies gain traction, the adoption of EVs is set to reshape the industry. For further reading, visit this authoritative source.
Best Practices for Managing Production Workloads with Amazon MSK Tiered Storage
by Sarah Lee and Mark Wilson
on 14 JUN 2023
in Amazon Managed Streaming for Apache Kafka (Amazon MSK), Analytics, Best Practices, Expert (400)
In the second post of our series, we delve into fundamental aspects of the Amazon Managed Streaming for Apache Kafka (Amazon MSK) tiered storage feature, elucidating how read and write operations function within a tiered storage-enabled cluster. This article emphasizes how to size your MSK tiered storage cluster appropriately, as well as which metrics to monitor for optimal performance.
Utilizing MSK Connect for Managed MirrorMaker 2 Deployment with IAM Authentication
by David Green, Chris White, and Lisa Thompson
on 20 OCT 2022
in Advanced (300), Amazon Managed Service for Apache Flink, Amazon Managed Streaming for Apache Kafka (Amazon MSK), Analytics, AWS Big Data, How-To, Serverless
In March 2025, this post was reviewed and updated for accuracy. The MSK Replicator now simplifies the process of establishing cross-Region and same-Region replication without the need for MirrorMaker 2. In this post, we demonstrate how to deploy MirrorMaker 2 using MSK Connect with AWS Identity and Access Management (IAM) authentication. We create a seamless integration for your Kafka ecosystem. For visual learners, this is an excellent resource.
Real-Time Stream Processing Using Apache Spark Streaming and Apache Kafka on AWS
by Rachel Green
on 30 SEP 2016
in Amazon EMR, AWS Big Data
This post offers a comprehensive guide on setting up Apache Kafka on EC2, utilizing Spark Streaming on EMR to process data streaming into Apache Kafka topics, and employing Spark SQL on EMR for querying streaming data.
Leave a Reply