AWS First Steps
LanguageEnglish
New feature

Amazon Kinesis Data Streams announces Service-Managed Partition Keys for simplified data ingestion

Amazon Kinesis Data Streams now supports service-managed partition keys for On-Demand Standard and On-Demand Advantage streams, automatically distributing records across shards without requiring customers to specify partition keys, simplifying data ingestion for workloads where record ordering is not required.

Amazon Kinesis Data Streams now supports service-managed partition keys for on-demand standard and on-demand advantage streams. This removes the need for customers to specify partition keys when publishing data, automatically distributing records across shards. The feature simplifies data ingestion for workloads where record ordering is unnecessary, eliminating hot partition keys and improving streaming workload productivity. Customers no longer need to generate random partition keys like UUIDs, as the service automatically distributes records based on available warm capacity, enabling scaling to gigabits per second. Service-managed partition keys are available in all AWS commercial regions at no additional cost. For more information, see the Amazon Kinesis Data Streams documentation.

Why it matters

Amazon Kinesis Data Streams is a serverless streaming data service that makes it easy to capture, process, and store data streams at any scale. This update is particularly useful for streaming use cases such as log aggregation, metrics collection, and IoT telemetry.

Read the original AWS announcement

Related articles and terms

Real-Time Data Streaming - Instant Data Processing with Amazon KinesisLearn design patterns for real-time data pipelines combining Kinesis Data Streams and Data Firehose. This article covers shard design, buffering, Lambda transformations, and delivery to S3, Redshift, and OpenSearch.Designing Streaming Data Processing - Building Real-Time Data Pipelines with KinesisLearn streaming data processing design techniques with Amazon Kinesis, including building real-time data pipelines with Data Streams, Data Firehose, and Lambda integration.How DynamoDB Guarantees Single-Digit Millisecond Latency - Partition Splitting and Request Router InternalsExplore how DynamoDB maintains single-digit millisecond latency regardless of scale, through its three-layer architecture of partition splitting algorithms, request routers, and storage nodes.Amazon DynamoDBA fully managed NoSQL database delivering single-digit millisecond latencyBuilding a Real-Time Data Pipeline with Amazon Kinesis - Choosing Between Data Streams and Data FirehoseIngest real-time data with Data Streams and automatically deliver it to S3, Redshift, and OpenSearch with Data Firehose. This article explains how to build a streaming pipeline with shard design and on-demand mode selection.