Running Apache Airflow as a Managed Service with Amazon MWAA - DAG Design and Workflow Automation
Learn how to set up an Airflow environment with MWAA, design DAGs, integrate with S3, and leverage AWS operators for workflow automation.
Application Integration
Articles on EventBridge, SQS, SNS, API Gateway, and other application integration services
Building Asynchronous Messaging with Amazon SQS - Designing Standard and FIFO Queues
Learn how to choose between Standard and FIFO queues, use DLQs for failed message handling, and automate processing with Lambda event source mappings.
Building Pub/Sub Messaging with Amazon SNS - Fan-Out Patterns and Filtering
Learn about topic-based messaging with SNS, subscription filters, and the SQS fan-out pattern for scalable event distribution.
Notification Design with Amazon SNS - Topic and Subscription Patterns
Learn how to choose between Standard and FIFO topics, implement the SQS fan-out pattern, and use subscription filters for conditional routing.
Running a Message Broker with Amazon MQ - Choosing Between ActiveMQ and RabbitMQ and Migration Patterns
Compare ActiveMQ and RabbitMQ selection criteria, explore migration patterns from on-premises, and learn about high-availability configurations. Also covers when to use SQS/SNS instead.
EventBridge Pipes Design Best Practices - Optimizing Filtering and Batch Processing
Learn practical best practices for EventBridge Pipes filtering design, batch size optimization, error handling strategies, and cost efficiency improvements.
SaaS Data Integration with Amazon AppFlow - Connecting Salesforce, Slack, and Google Analytics
Sync data from Salesforce and Slack to S3 and Redshift with no code. Learn about event-driven triggers, PII masking, and secure transfers via PrivateLink.
Workflow Management - Running Apache Airflow as a Managed Service with Amazon MWAA
Learn about data pipeline orchestration with Amazon MWAA (Managed Workflows for Apache Airflow). This article covers setup, DAG management, and when to choose Step Functions instead.
IoT Event Detection - Automatically Detecting and Responding to Device State Changes with AWS IoT Events
Learn how to monitor IoT device state and automate responses with AWS IoT Events. Covers detector models for defining state transitions, alarm features, and SNS/Lambda integration.
Event Integration with Amazon EventBridge Pipes - Connection Patterns for Sources and Targets
Learn how to connect event sources like SQS, DynamoDB Streams, and Kinesis directly to targets, with filtering and enrichment steps in between.
Does SQS Really Deliver Messages "At Least Once"? - How At-Least-Once Delivery Works and Its Pitfalls
Explore why SQS Standard queues produce duplicates under At-Least-Once delivery, how visibility timeout works internally, the differences from FIFO queue's Exactly-Once processing, and why idempotent design is essential.
Event-Driven Architecture - Building Loosely Coupled Systems with Amazon EventBridge
Learn how to build event-driven architectures using Amazon EventBridge.
Automating Data Integration - Building a SaaS Integration Platform with Amazon AppFlow
Learn about SaaS application data integration using Amazon AppFlow. This article explains how to connect external services like Salesforce, Slack, and Google Analytics with AWS services using no code, and build real-time or schedule-based data flows.