AWS First Steps
New feature

Amazon Redshift now supports streaming 10MiB records from Amazon Kinesis Data Streams

Amazon Redshift extends support for Amazon Kinesis Data Streams record sizes up to 10MiB, enabling larger payloads and simplifying ingestion pipelines

Amazon Redshift has increased the maximum record size for Amazon Kinesis Data Streams from 1MiB to 10MiB, aligning with Kinesis Data Streams' own limits. This allows users to stream larger payloads directly into Redshift without splitting records, simplifying ingestion pipelines and enabling new use cases for high-volume, large-record workloads. The feature is available in all commercial AWS regions where Amazon Redshift is offered.

Why it matters

This update benefits users handling streaming data processing and large-scale data analytics, particularly those leveraging direct streaming from Kinesis Data Streams to Redshift

Read the original AWS announcement

Related articles and terms

Real-Time Data Streaming - Instant Data Processing with Amazon KinesisLearn design patterns for real-time data pipelines combining Kinesis Data Streams and Data Firehose. This article covers shard design, buffering, Lambda transformations, and delivery to S3, Redshift, and OpenSearch.Designing Streaming Data Processing - Building Real-Time Data Pipelines with KinesisLearn streaming data processing design techniques with Amazon Kinesis, including building real-time data pipelines with Data Streams, Data Firehose, and Lambda integration.Amazon KinesisA service for collecting, processing, and analyzing real-time streaming dataAmazon RedshiftA cloud data warehouse service for high-speed analytics on petabyte-scale dataBuilding a Real-Time Data Pipeline with Amazon Kinesis - Choosing Between Data Streams and Data FirehoseIngest real-time data with Data Streams and automatically deliver it to S3, Redshift, and OpenSearch with Data Firehose. This article explains how to build a streaming pipeline with shard design and on-demand mode selection.