AWS First Steps
New feature

MSK Replicator now supports OAuth 2.0 (SASL/OAUTHBEARER) authentication

Amazon MSK Replicator adds OAuth 2.0 authentication for replicating data from external Kafka clusters, preserving topic names and synchronizing consumer group offsets bidirectionally.

Amazon MSK Replicator now enables OAuth 2.0 (SASL/OAUTHBEARER) authentication for replicating data from external Apache Kafka clusters-including on-premises, self-managed on AWS, or other cloud providers-to Amazon MSK Provisioned clusters. This allows clusters using OAuth/OIDC authentication to migrate workloads to Amazon MSK, use MSK clusters for disaster recovery, and distribute data across hybrid and multi-cloud environments. MSK Replicator automates data replication between Kafka clusters, eliminating the need for custom infrastructure or open-source tools. In addition to previous SASL/SCRAM and mTLS support, it now allows OAuth 2.0 authentication. The service retains original topic names during replication and prevents infinite loops, while synchronizing consumer group offsets bidirectionally for flexible producer and consumer movement between clusters.

Why it matters

This update affects users needing data replication from external Kafka clusters to Amazon MSK. MSK Replicator automates replication between Kafka clusters, and this enhancement benefits those using OAuth 2.0 authentication.

Read the original AWS announcement

Related articles and terms

Amazon MSKA fully managed Apache Kafka service for real-time streaming data processingManaged Kafka Streaming - Building Large-Scale Real-Time Data Pipelines with Amazon MSKLearn how to build a fully managed Kafka cluster with Amazon MSK (Managed Streaming for Apache Kafka) and when to choose it over Kinesis. This article covers design patterns for large-scale real-time data streaming infrastructure.Getting Started with Event Streaming on Amazon MSK Serverless - Building a Zero-Ops Kafka EnvironmentLearn how to build a cluster-free Kafka environment with IAM authentication and simplify event streaming through integration with EventBridge Pipes.Building an Apache Kafka Streaming Platform with Amazon MSK - Cluster Design and OperationsDesign a managed Apache Kafka cluster, learn when to choose MSK Serverless, and explore data integration patterns with MSK Connect.Amazon Managed Service for Apache FlinkA fully managed service for running Apache Flink applications that processes and analyzes real-time streaming data from Kinesis Data Streams and MSK with low latency