- Home
- Event Streaming Platforms
- Amazon Managed Streaming for Apache Kafka
Amazon Managed Streaming for Apache Kafka
What it is
Amazon Managed Streaming for Apache Kafka (MSK) manages Apache Kafka infrastructure for developers and platform engineers running streaming applications on AWS. It provisions and configures clusters, replaces failed servers, coordinates patches and upgrades, and handles monitoring and scaling. Provisioned clusters let customers choose broker and storage options, while Serverless clusters adjust resources to workload needs. MSK maintains compatibility with the Apache Kafka open-source client protocol, allowing existing Kafka applications and tools to work without application code changes. Integrations include Amazon S3, Amazon Redshift, Managed Service for Apache Flink, AWS Lambda, Glue Schema Registry, and Database Migration Service. Clusters span multiple Availability Zones, with three as the default, and the service-level agreement guarantees three 9s of availability. Security options include IAM, SASL/SCRAM or mutual TLS for Provisioned clusters, and encryption in transit and at rest. CloudWatch provides more than 50 default metrics at no additional cost; enhanced metrics and other storage, processing, and connectivity charges are separate.
For and against
For
- Managed provisioning and upgrades
- Provisioned and Serverless cluster choices
- Kafka client compatibility
- Multi-Availability-Zone clusters
- AWS service integrations
Against
- No free plan
- Enhanced metrics incur CloudWatch charges
- Storage and connectivity can cost extra
The verdict
MSK offloads Kafka cluster operations while offering Provisioned and Serverless deployment choices. Its usage-based components and separate service charges should be included in architecture and cost planning.
Who it suits
MSK is intended for developers and DevOps or platform engineers building streaming data applications on AWS. It suits teams that want managed Kafka operations while retaining Kafka client compatibility.
Plans and prices
MSK Connect
Each MCU provides 1 vCPU and 4 GB memory; total cost depends on worker count and size
Read 3 Oct 2026 · aws.amazon.com
MSK Provisioned — Standard brokers
Storage, optional provisioned storage throughput, data transfer, and private connectivity are charged separately
Read 3 Oct 2026 · aws.amazon.com
MSK Replicator
Cross-Region and same-Region replication supported; other charges may apply, including private connectivity
Read 3 Oct 2026 · aws.amazon.com
MSK Provisioned — Express brokers
Also charged for data ingested and storage; data transfer and private connectivity may incur separate charges
Read 3 Oct 2026 · aws.amazon.com
MSK Serverless
Usage charges vary by cluster-hours, partition-hours, data written and read, and storage; data transfer may be additional
Read 3 Oct 2026 · aws.amazon.com
On the record
- Broker logs
- MSK broker logs can be delivered to CloudWatch Logs, Amazon S3, or Amazon Data Firehose, and MSK API calls can be logged with CloudTrail.aws.amazon.com · read 3 Oct 2026
- Cluster options
- MSK offers Provisioned clusters, where customers choose broker and storage options, and Serverless clusters, which automatically adjust resources to workload needs.aws.amazon.com · read 3 Oct 2026
- Compliance
- AWS states that it supports 143 security standards and compliance certifications, including PCI-DSS, HIPAA/HITECH, FedRAMP, GDPR, FIPS 140-3, and NIST 800-171.aws.amazon.com · read 3 Oct 2026
- Integrations
- Listed integrations include Amazon S3, Amazon Redshift, Amazon Managed Service for Apache Flink, AWS Lambda, AWS Glue Schema Registry, and AWS Database Migration Service.aws.amazon.com · read 3 Oct 2026
- Intended users
- AWS describes MSK as intended for developers and DevOps or platform engineers building streaming data applications on AWS.aws.amazon.com · read 3 Oct 2026
- Kafka compatibility
- MSK maintains compatibility with the Apache Kafka open source client protocol, allowing Kafka applications and tools to work without application code changes.aws.amazon.com · read 3 Oct 2026
- Managed operations
- MSK provisions and configures clusters, replaces failed servers, orchestrates patches and upgrades, and handles monitoring and scaling.aws.amazon.com · read 3 Oct 2026
- Monitoring
- CloudWatch provides a default set of over 50 metrics at no additional cost; enhanced broker and topic metrics are billed at standard CloudWatch rates.aws.amazon.com · read 3 Oct 2026
- Notable cost limit
- Enhanced CloudWatch metrics are billed at standard CloudWatch rates, and MSK pricing also lists separate charges for storage, data processing, and some connectivity.aws.amazon.com · read 3 Oct 2026
- Open monitoring
- For Provisioned clusters, MSK can export JMX and node metrics for monitoring with Prometheus-compatible solutions including Datadog, Lenses, New Relic, and Sumo Logic.aws.amazon.com · read 3 Oct 2026
- Purpose
- Amazon MSK manages Apache Kafka infrastructure and operations so developers and platform engineers can run Kafka on AWS without becoming experts in operating it.aws.amazon.com · read 3 Oct 2026
- Resilience
- Clusters are distributed across multiple Availability Zones, with three as the default, and the MSK service level agreement guarantees three 9s of availability.aws.amazon.com · read 3 Oct 2026
- Security
- MSK supports IAM access control, SASL/SCRAM or mutual TLS authentication for Provisioned clusters, and encryption at rest and in transit.aws.amazon.com · read 3 Oct 2026
