Amazon Kinesis Data Streams announces streaming tables, delivering data to Apache Iceberg tables on Amazon S3 Tables
Amazon Kinesis Data Streams adds streaming tables, enabling continuous data delivery from Kinesis streams to Amazon S3 Tables in Apache Iceberg format. This eliminates the need for self-managed Iceberg pipelines, reducing delivery costs by up to 50% and query costs by up to 30% through intelligent inline compaction.
Amazon Kinesis Data Streams has introduced streaming tables, a new fully serverless capability that continuously delivers data from Kinesis streams to Amazon S3 Tables in Apache Iceberg format. Streaming tables remove the need to build and operate self-managed Iceberg delivery pipelines, cutting data delivery costs by up to 50 percent. Intelligent inline compaction addresses the small file problem, keeping query performance predictable and reducing downstream query costs by up to 30 percent. Kinesis Data Streams automatically handles scaling, retries, compaction, and delivery reliability, delivering data in minutes without custom applications, self-managed compute, or operational overhead. Customers can configure streaming tables in just a few clicks via the console or APIs. Streaming tables support On Demand Advantage and On Demand Standard capacity modes with usage-based pricing, no setup fees, and no minimum commitments. Users are charged only for successfully delivered data. Streaming tables are available in all AWS Regions where Amazon Kinesis Data Streams is offered, including AWS GovCloud (US) and China regions.
Why it matters
This update benefits users who need to deliver streaming data to Apache Iceberg tables for near real-time analytics and AI/ML feature pipelines. Amazon Kinesis Data Streams is a serverless streaming data service that simplifies capturing, processing, and storing data streams at any scale.