Amazon Managed Service for Prometheus now supports out of order sample ingestion
Amazon Managed Service for Prometheus now supports out-of-order sample ingestion and workspace-level rule query offset, reducing data loss and improving alert accuracy for distributed workloads
Amazon Managed Service for Prometheus now supports out-of-order sample ingestion and a workspace-level rule query offset. All workspaces have a default out-of-order time window of 1 minute, allowing the workspace to accept metric samples arriving outside strict chronological order. This window can be adjusted to match ingestion patterns or set to 0 to disable the feature and discard out-of-order samples. A global rule query offset can also be configured to introduce a delay before rule evaluation queries run, giving late-arriving samples time to be ingested before rules execute. Together, these features reduce data loss and improve alerting accuracy for workloads with distributed collectors, batched exports, or variable network latency. Out-of-order sample support ensures late-arriving data points are ingested rather than discarded, preserving metric completeness. The rule query offset compensates for expected ingestion delay; without it, rules evaluate instantly and may miss samples that haven't landed yet, producing results that differ from the same expression evaluated after all metrics arrive. Two new CloudWatch vended metrics, OutOfOrderIngestionRate and OutOfOrderSampleAge, provide visibility into ingestion patterns, helping tune both settings for your workload. Out-of-order sample ingestion and rule query offset are available in all AWS regions where Amazon Managed Service for Prometheus is generally available. To get started, configure the out-of-order time window and rule query offset in your workspace settings via AWS console, API, or CLI. For more information, see Amazon Managed Service for Prometheus user documentation.