AWS First Steps
LanguageEnglish
New feature

OpenAI GPT-6 Astra now supports UltraFast mode on Amazon Bedrock

Amazon Bedrock now offers UltraFast mode for OpenAI's GPT-6 Astra, delivering up to 6x faster API inference at up to 300 tokens per second for latency-sensitive applications.

AWS today announced GPT-6 Astra on Amazon Bedrock in UltraFast mode, offering up to 6x faster API inference and 300 tokens per second for latency-sensitive workloads. This premium tier delivers the performance, security, and reliability needed for production environments, enabling real-time coding assistants, interactive agents, and high-quality customer experiences, all manageable through existing AWS controls via the Amazon Bedrock console or supported APIs. For details on supported regions, endpoints, APIs, features, inference profiles, and pricing, see Amazon Bedrock documentation.

Why it matters

This update impacts developers building latency-sensitive applications and organizations deploying AI models in production, offering faster inference speeds combined with existing AWS security features for high-quality user experiences.

Read the original AWS announcement

Related articles and terms

Generative AI Platform - Building an Enterprise AI Foundation with Amazon BedrockLearn how to build generative AI applications using Amazon Bedrock. This guide covers foundation model selection, RAG pattern implementation, safety guardrails, and SageMaker integration for designing enterprise-grade AI infrastructure.The Layered Architecture of AWS AI/ML Services - Flexibility Through the Three Tiers of SageMaker, Bedrock, and API ServicesThis article organizes AWS AI/ML services into three layers - SageMaker (full control), Bedrock (managed generative AI), and Rekognition/Comprehend/etc. (API-based) - and explains AWS's flexibility through comparisons with GCP Vertex AI and Azure OpenAI Service, including custom silicon integration.Amazon BedrockA fully managed service that provides access to multiple large language models via API, with built-in customization using your own data and configurable guardrailsAmazon Elastic Inference[Discontinued] Service that attached fractional GPU accelerators to EC2 and SageMaker for inference. Inferentia (Inf1 / Inf2), GPU instances, and SageMaker AI inference are the replacementsBuilding an ML Platform with Amazon SageMaker - From Model Development to DeploymentFrom development in Studio to managed spot training, MLOps with Pipelines, and data drift detection with Model Monitor, this article covers how to integrate the entire ML lifecycle.