AWS First Steps
LanguageEnglish
New feature

Amazon DynamoDB Streams now supports timestamp-based stream processing

Amazon DynamoDB Streams now supports timestamp-based stream processing, allowing you to start reading stream records from a specific point in time and avoid reprocessing entire retained streams or missing records when resuming stream consumption.

Amazon DynamoDB Streams now supports timestamp-based stream processing, allowing reads to start from a specific time using the AT_TIMESTAMP shard iterator type. This enables processing from the first record written at that time, avoiding full retention reprocessing or record loss on resumption. The feature works with the DynamoDB Streams Kinesis adapter via the Amazon Kinesis Client Library (KCL), supporting common use cases like post-interruption recovery, debugging, auditing, and skipping backlogs. It is available in all commercial AWS regions, AWS GovCloud (US), and China regions at no additional cost beyond standard GetRecords API request charges. For details, see the DynamoDB developer guide's Amazon DynamoDB Streams timestamp documentation.

Why it matters

This change increases the flexibility of stream processing by allowing you to start reading stream records from a specific point in time. It helps avoid reprocessing entire retained streams or missing records when resuming stream consumption, making it useful for data replay, recovery, auditing, and other use cases.

Regions: All Regions

Read the original AWS announcement

Related articles and terms

Amazon KinesisA service for collecting, processing, and analyzing real-time streaming dataReal-Time Data Streaming - Instant Data Processing with Amazon KinesisLearn design patterns for real-time data pipelines combining Kinesis Data Streams and Data Firehose. This article covers shard design, buffering, Lambda transformations, and delivery to S3, Redshift, and OpenSearch.Designing Streaming Data Processing - Building Real-Time Data Pipelines with KinesisLearn streaming data processing design techniques with Amazon Kinesis, including building real-time data pipelines with Data Streams, Data Firehose, and Lambda integration.Building a Real-Time Data Pipeline with Amazon Kinesis - Choosing Between Data Streams and Data FirehoseIngest real-time data with Data Streams and automatically deliver it to S3, Redshift, and OpenSearch with Data Firehose. This article explains how to build a streaming pipeline with shard design and on-demand mode selection.Real-Time Stream Processing with Amazon Managed Service for Apache Flink - Stateful Processing and Window AggregationRun real-time stream processing with SQL or Java/Python applications in a fully managed Apache Flink environment. This article covers design patterns for window aggregation, pattern detection, and Kinesis/MSK integration.