AWS First Steps
Region expansion

AWS Glue now supports catalog federation for remote Apache Iceberg catalogs in AWS GovCloud (US) regions

AWS Glue provides catalog federation for remote Iceberg REST catalogs, enabling direct and secure access to tables without data movement

AWS Glue now enables catalog federation for remote Iceberg REST catalogs in AWS GovCloud (US) regions. This feature allows secure, direct access to Iceberg tables stored in Amazon S3 and managed in remote catalogs using AWS analytics services. It synchronizes metadata in real time between AWS Glue Data Catalog and remote catalogs when querying tables, ensuring up-to-date results. Users can select the best price-performance options for analyzing remote Iceberg tables with preferred AWS analytics tools while maintaining consistent security controls. The feature supports various analytics engines including Amazon Redshift, Amazon EMR, Amazon Athena, AWS Glue, and third-party tools like Apache Spark. Access control is managed through AWS Lake Formation, providing fine-grained controls, cross-account sharing, and trusted identity propagation. Catalog federation is available via the Lake Formation console and AWS Glue and Lake Formation SDKs and APIs, and is generally available in the AWS GovCloud (US-East) and AWS GovCloud (US-West) regions.

Why it matters

This update impacts users performing data analysis in AWS GovCloud (US) regions. Direct access to remote Iceberg catalogs and real-time metadata synchronization enhance flexibility and efficiency in data analysis.

Read the original AWS announcement

Related articles and terms

AWS Lake FormationA service that centralizes data lake construction, management, and security, providing column-level and row-level fine-grained access control for data on S3AWS Data Analytics and Data Lakes - The Integrated Ecosystem of Athena, Glue, Lake Formation, and RedshiftExplore how the integrated AWS data analytics stack of Athena, Glue, Lake Formation, Redshift, and Amazon Quick (formerly Amazon QuickSight) is put together, along with the concrete differences from Azure Synapse Analytics / Microsoft Fabric and GCP BigQuery, to clarify the axes for choosing between them.Data Lake Governance - Centralized Access Control with AWS Lake FormationLearn about building, access control, and governance for data lakes using AWS Lake Formation. This article covers fine-grained column-level and row-level permission management for S3-based data lakes, along with Glue and Athena integration.Building a Data Lake with AWS Lake Formation - Fine-Grained Access Control and Data CatalogEstablish data lake governance with column-level and row-level fine-grained access control and tag-based management. This article covers integration with Glue Data Catalog and cross-account access.Building a Data Lake with Amazon S3 and Lake Formation - Design Patterns and GovernanceExplore data lake design patterns using S3 as the storage foundation and Lake Formation for fine-grained access control. This article also covers ETL pipelines and cost optimization.