Amazon EventBridge Pipes New2022年〜
A service that connects event sources to targets with point-to-point integration
What It Does
Amazon EventBridge Pipes connects event sources to targets in a point-to-point fashion without writing code. It retrieves events from sources like SQS queues, Kinesis streams, and DynamoDB Streams, then delivers them to targets after optional filtering and transformation. It enables event-driven integration without writing Lambda functions.
Use Cases
It is used to connect DynamoDB changes to Step Functions workflows, forward SQS queue messages to API Gateway, filter Kinesis stream data before passing it to Lambda, and other scenarios where you need simple connections between event sources.
Everyday Analogy
Think of it like an automatic mail sorting machine at a post office. It automatically sorts incoming mail (events) by destination (filtering), repackages them if needed (transformation), and delivers them to the correct recipient (target).
What Is EventBridge Pipes?
EventBridge Pipes is an integration service that directly connects event sources to targets. Previously, you needed to write Lambda functions to retrieve data from event sources and pass it to other services. With Pipes, you can build these connections through console configuration alone. You can optionally add filtering, enrichment, and transformation steps.
Pipeline Structure
A Pipes pipeline consists of four steps: source, filter, enrichment, and target. Sources include SQS, Kinesis, DynamoDB Streams, MSK, and more. Filters use event patterns to exclude unwanted events. Enrichment is an optional step that processes data with Lambda or Step Functions. Targets can be selected from over 15 AWS services. For design patterns and operational practices for pipeline configuration, technical books on Amazon provide detailed coverage.
Getting Started
Select 'Create pipe' in the EventBridge console and specify the source and target. Set up filter patterns as needed and use input transformers to adjust the data format passed to the target. Once you activate the pipe, events are automatically retrieved from the source and delivered to the target.
Things to Watch Out For
- Pipes is designed for point-to-point connections. If you need fan-out to multiple targets, use EventBridge rules instead
- Using Lambda in the enrichment step incurs additional Lambda execution charges
