AWS First Steps
LanguageEnglish
New feature

AWS Parallel Computing Service now supports scaling logs

AWS Parallel Computing Service now supports scaling logs that record how AWS PCS scales compute node groups in your cluster, making it easier to troubleshoot scaling issues.

AWS Parallel Computing Service (AWS PCS) now supports scaling logs that record compute node group scaling activities. Each log entry captures a single node state transition, such as instance launch, node registration, scale-down, or launch failures with reasons. These logs simplify troubleshooting scaling issues, allowing users to verify why a group didn't reach its target size, which instances failed due to capacity, and when specific nodes started or stopped. Scaling log delivery is opt-in, configurable via AWS PCS to output logs to Amazon CloudWatch Logs, Amazon S3, or Amazon Data Firehose, and available in all AWS regions where AWS PCS is offered.

Why it matters

AWS Parallel Computing Service is a managed service that simplifies running and scaling HPC workloads on AWS using Slurm; this new scaling log feature makes it easier to monitor and troubleshoot cluster scaling behavior.

Read the original AWS announcement

Related articles and terms

AWS Auto ScalingA service that automatically scales EC2, ECS, DynamoDB, and other resources based on demandWhy CloudWatch Logs Costs More Than You Expect - The Cost Structure of Ingestion, Storage, and AnalysisThis article explains the pricing structure where CloudWatch Logs ingestion costs over 20 times more than storage, the cost explosions caused by VPC Flow Logs and Lambda logs, and optimization strategies using the Infrequent Access class and S3 export.Demand-Driven Infrastructure with AWS Auto Scaling - Designing and Optimizing Scaling PoliciesLearn how to use target tracking, predictive, and scheduled scaling policies effectively, and optimize costs with mixed instances policies that leverage Spot Instances.Building an HPC Environment with AWS ParallelCluster - Automated Slurm Cluster Provisioning and ScalingAutomatically provision HPC clusters with CloudFormation and manage jobs with the Slurm scheduler. Also covers cost optimization with Spot Instances.AWS ParallelClusterAn open-source tool that automatically builds HPC (High Performance Computing) clusters on AWS, efficiently executing batch computations with the Slurm job scheduler