AWS First Steps
New feature

Amazon SageMaker Studio notebooks now support G7 instance types

Amazon SageMaker Studio notebooks now support G7 instances powered by NVIDIA RTX PRO 4500 Blackwell Server Edition GPUs, delivering up to 4.6x AI inference performance over previous-generation G6 instances for tasks like conversational AI and video streaming.

Amazon SageMaker Studio notebooks now support G7 instances powered by NVIDIA RTX PRO 4500 Blackwell Server Edition GPUs. G7 instances deliver up to 4.6x AI inference performance compared to previous-generation G6 instances. With up to 8 GPUs and 700 Gbps of EFA-enabled network bandwidth, G7 instances help run AI inference, graphics, and data analytics workloads more efficiently. Custom Intel Xeon 6 processors, 7x EFA-enabled bandwidth and 1.5x higher FP16 Flops than G6 enable deploying models with lower latency for applications like conversational assistants, content generation tools, and recommendation engines. G7 instances are available for SageMaker Studio notebooks in the AWS US East (N. Virginia and Ohio) and US West (Oregon) regions.

Read the original AWS announcement

Related articles and terms

Amazon SageMakerAn integrated platform for building, training, and deploying machine learning modelsBuilding an ML Platform with Amazon SageMaker - From Model Development to DeploymentFrom development in Studio to managed spot training, MLOps with Pipelines, and data drift detection with Model Monitor, this article covers how to integrate the entire ML lifecycle.The Layered Architecture of AWS AI/ML Services - Flexibility Through the Three Tiers of SageMaker, Bedrock, and API ServicesThis article organizes AWS AI/ML services into three layers - SageMaker (full control), Bedrock (managed generative AI), and Rekognition/Comprehend/etc. (API-based) - and explains AWS's flexibility through comparisons with GCP Vertex AI and Azure OpenAI Service, including custom silicon integration.Amazon Elastic Inference[Discontinued] Service that attached fractional GPU accelerators to EC2 and SageMaker for inference. Inferentia (Inf1 / Inf2), GPU instances, and SageMaker AI inference are the replacementsNo-Code ML with Amazon SageMaker Canvas - Building Prediction Models with a Visual InterfaceA visual tool for building ML models without writing code. Simply upload a CSV and select a prediction target to build a model, with bidirectional sharing with Studio.