Articles on Athena, OpenSearch, Glue, data lake construction, and other AWS data analytics and search services
Explains how to build blockchain networks with Amazon Managed Blockchain, plus where Amazon QLDB (discontinued July 31, 2025) fits and its official migration path to Aurora PostgreSQL.
Learn how to collect, model, and visualize industrial equipment data with AWS IoT SiteWise. Covers OPC-UA gateways, asset models, and SiteWise Monitor dashboards.
AWS IoT Analytics ended on December 15, 2025. This article covers the official migration targets (Kinesis Data Streams / Data Firehose, S3 / Timestream, Glue + Athena) and its original four-component architecture.
Learn design patterns for real-time data pipelines combining Kinesis Data Streams and Data Firehose. This article covers shard design, buffering, Lambda transformations, and delivery to S3, Redshift, and OpenSearch.
Learn streaming data processing design techniques with Amazon Kinesis, including building real-time data pipelines with Data Streams, Data Firehose, and Lambda integration.
Run real-time stream processing with SQL or Java/Python applications in a fully managed Apache Flink environment. This article covers design patterns for window aggregation, pattern detection, and Kinesis/MSK integration.
Explore concrete use cases for sales, IT, and finance departments, along with design patterns for notifications, approvals, and multi-step workflows using Quick Flows.
Explains how to build interactive BI dashboards with Amazon QuickSight and a serverless data analytics platform with Athena integration. Covers high-speed visualization with the SPICE engine and practical methods for sharing insights across the organization.
Run joint analysis across multiple companies without sharing or copying data. Learn about aggregation rules for preventing individual identification and Cryptographic Computing for encrypted analysis.
Learn how to perform entity resolution (record matching) on customer data using AWS Entity Resolution. This article covers ML-based matching, rule-based matching, privacy protection, and integration with Clean Rooms.
Procure third-party data products via Marketplace and build automated delivery pipelines to S3. This article also covers how to productize and monetize your own data.
Explore data lake design patterns using S3 as the storage foundation and Lake Formation for fine-grained access control. This article also covers ETL pipelines and cost optimization.
Learn about building, access control, and governance for data lakes using AWS Lake Formation. This article covers fine-grained column-level and row-level permission management for S3-based data lakes, along with Glue and Athena integration.
Learn how to acquire and utilize third-party data with AWS Data Exchange. This article covers building data pipelines with S3 integration and publishing data as a data provider.
Learn about data search and analytics design with Amazon OpenSearch Service, including how to build an analytics foundation with full-text search, log analysis, and dashboard visualization.
Learn how to build a domain-based data catalog and implement data discovery, sharing, and access control through subscription workflows.
Learn how to build digital twins with AWS IoT TwinMaker. This article covers 3D scene creation, IoT data integration, Grafana dashboard integration, and industrial equipment visualization.
Learn how to run Spark jobs and Hive queries on EMR clusters, choose between EMR Serverless, and optimize costs with managed scaling.
Learn how to build Spark clusters with EMR, choose between EMR Serverless, and optimize costs with spot instances.
Learn about running Spark and Hive jobs with EMR Serverless, job run design, and cost optimization strategies.
Learn about record matching across multiple data sources with Entity Resolution and how to design matching workflows.
Learn how to collect vehicle telemetry data with AWS IoT FleetWise, including vehicle modeling, edge-side data filtering, and efficient data transfer to the cloud.
Automatically detect schemas with crawlers and execute ETL processing with Glue jobs. This guide covers Data Catalog usage patterns and visual development with Glue Studio.
Ingest real-time data with Data Streams and automatically deliver it to S3, Redshift, and OpenSearch with Data Firehose. This article explains how to build a streaming pipeline with shard design and on-demand mode selection.
Establish data lake governance with column-level and row-level fine-grained access control and tag-based management. This article covers integration with Glue Data Catalog and cross-account access.
Learn how to build a fully managed Kafka cluster with Amazon MSK (Managed Streaming for Apache Kafka) and when to choose it over Kinesis. This article covers design patterns for large-scale real-time data streaming infrastructure.
Design a managed Apache Kafka cluster, learn when to choose MSK Serverless, and explore data integration patterns with MSK Connect.
Learn how to build a cluster-free Kafka environment with IAM authentication and simplify event streaming through integration with EventBridge Pipes.
Build a log analytics platform and optimize costs with index lifecycle management. Learn about OpenSearch Dashboards and Serverless mode.
Amazon OpenSearch Serverless is a fully managed service that handles search and analytics workloads with auto-scaling while eliminating cluster management. This article explains the OCU billing model, collection type selection criteria, and index design best practices from a practical perspective.
Learn about privacy-enhanced data analytics with AWS Clean Rooms. Explore multi-organization data collaboration, access control through analysis rules, and differential privacy.
Learn practical approaches to quantum computing with Amazon Braket. This article covers quantum circuit simulators, access to real quantum hardware, implementing hybrid quantum-classical algorithms, and integration patterns with Lambda.
Achieve fast queries with the SPICE engine and integrate BI capabilities into your own applications using the embedding API. This article introduces Q's natural language queries and Reader session-based pricing.
Learn the criteria for choosing between Serverless and RA3 provisioned clusters, and how to prevent data silos using data sharing and Spectrum for data lake integration.
Learn how to select distribution styles and sort keys, design workload management (WLM), and accelerate queries with AQUA in Amazon Redshift.
Learn how to build a video transcoding pipeline using AWS Elemental MediaConvert and S3. This article covers multi-format output, HDR support, and cost-efficient serverless media processing techniques.