Region expansionMedium

SageMaker AI Inference Now Available with G6 Instances in AWS GovCloud (US-East)

Amazon SageMaker introduces G6 instances in AWS GovCloud (US-East), enabling government agencies and organizations to run generative AI workloads while meeting strict compliance and data residency requirements

Amazon EC2 G6 instances are now available for Amazon SageMaker AI inference in the AWS GovCloud (US-East) region. G6 instances feature up to 8 NVIDIA L4 Tensor Core GPUs, each with 24 GB of memory, and third-generation AMD EPYC processors, delivering up to 2x the deep learning inference performance compared to G4dn instances. This region expansion allows government agencies and organizations operating in GovCloud to deploy inference endpoints on G6 instances for generative AI workloads-including small-to-medium language models, image generation, and computer vision tasks-while meeting strict compliance and data residency requirements. G6 instances offer strong price-performance for production inference workloads that fit within 24 GB of GPU memory.

Read the original AWS announcement

Related articles and terms

Amazon Elastic Inference[Discontinued] Service that attached fractional GPU accelerators to EC2 and SageMaker for inference. Inferentia (Inf1 / Inf2), GPU instances, and SageMaker AI inference are the replacementsThe Layered Architecture of AWS AI/ML Services - Flexibility Through the Three Tiers of SageMaker, Bedrock, and API ServicesThis article organizes AWS AI/ML services into three layers - SageMaker (full control), Bedrock (managed generative AI), and Rekognition/Comprehend/etc. (API-based) - and explains AWS's flexibility through comparisons with GCP Vertex AI and Azure OpenAI Service, including custom silicon integration.Amazon SageMakerA fully managed platform for building, training, and deploying machine learning models end-to-end, significantly boosting productivity for data scientists and ML engineersBuilding an ML Platform with Amazon SageMaker - From Model Development to DeploymentFrom development in Studio to managed spot training, MLOps with Pipelines, and data drift detection with Model Monitor, this article covers how to integrate the entire ML lifecycle.AWS Graviton and Custom Silicon Strategy - How In-House Chips Are Reshaping Cloud EconomicsExplore how AWS's Arm-based Graviton processors and AI-focused custom silicon (Inferentia and Trainium) are transforming cloud cost structures and performance, compared with Azure and GCP approaches.