AWS First Steps
New feature

Amazon SageMaker AI Batch Transform Now Supports G6e Instances

Amazon SageMaker AI adds support for EC2 G6e instances in Batch Transform, enhancing performance for offline inference on large datasets

Amazon SageMaker AI now supports Amazon EC2 G6e instances for batch transforms, enabling offline inference for gpu-intensive workloads like large language models and diffusion models that generate images, video, or audio. The G6e instances feature up to eight NVIDIA L40S Tensor Core GPUs and third-generation AMD EPYC processors, making them ideal for large datasets that do not require a persistent inference endpoint. Supported regions include US East (N. Virginia), US East (Ohio), US West (Oregon), Asia Pacific (Mumbai), and Asia Pacific (Hyderabad).

Why it matters

This update affects users running large-scale offline inference tasks that require GPU resources. Users of Amazon SageMaker AI's batch transform functionality can now perform inference with higher performance.

Read the original AWS announcement

Related articles and terms

Amazon SageMakerA fully managed platform for building, training, and deploying machine learning models end-to-end, significantly boosting productivity for data scientists and ML engineersAmazon Elastic Inference[Discontinued] Service that attached fractional GPU accelerators to EC2 and SageMaker for inference. Inferentia (Inf1 / Inf2), GPU instances, and SageMaker AI inference are the replacementsThe Layered Architecture of AWS AI/ML Services - Flexibility Through the Three Tiers of SageMaker, Bedrock, and API ServicesThis article organizes AWS AI/ML services into three layers - SageMaker (full control), Bedrock (managed generative AI), and Rekognition/Comprehend/etc. (API-based) - and explains AWS's flexibility through comparisons with GCP Vertex AI and Azure OpenAI Service, including custom silicon integration.Building an ML Platform with Amazon SageMaker - From Model Development to DeploymentFrom development in Studio to managed spot training, MLOps with Pipelines, and data drift detection with Model Monitor, this article covers how to integrate the entire ML lifecycle.Batch Computing Infrastructure - Large-Scale Parallel Processing with AWS BatchLearn how to build large-scale batch processing with AWS Batch. Covers job queue design, auto-scaling compute environments, cost optimization with Spot Instances, and building batch infrastructure ideal for scientific computing and large-scale data processing.