AWS First Steps
LanguageEnglish
Storage

Amazon FSx

A fully managed service offering four file system variants - Lustre, Windows File Server, NetApp ONTAP, and OpenZFS - providing the optimal choice for each workload.

About 4 min read

Overview

Amazon FSx is a service family that provides industry-standard file systems in a fully managed manner. It offers four variants: FSx for Lustre for high-performance computing (HPC) and machine learning, FSx for Windows File Server for Windows-based applications, FSx for NetApp ONTAP with enterprise NAS capabilities, and FSx for OpenZFS as a general-purpose POSIX-compatible file system. All variants have backups, patching, and hardware failure handling managed by AWS, freeing you from on-premises file server operations. While EFS (Elastic File System) provides a general-purpose NFS file system, FSx is positioned to offer choices optimized for specific protocols and workloads.

The Four Variants and a Selection Flowchart

The first thing to check when selecting FSx is your protocol requirements. If Windows applications require the SMB protocol or Active Directory integration, the choice narrows to FSx for Windows File Server. It supports Windows-native features such as NTFS access control lists (ACLs), DFS namespaces, and shadow copies, making it a candidate migration target from on-premises Windows file servers. If you need high throughput with S3 integration for HPC or machine learning training jobs, choose FSx for Lustre. Lustre can link an S3 bucket as a data repository and supports lazy loading, which automatically loads data from S3 on first file access. This is particularly powerful when loading large datasets at high speed for SageMaker training jobs. If you need multi-protocol support (NFS, SMB, iSCSI) or enterprise NAS features like snapshots, clones, and tiering, FSx for NetApp ONTAP is the right fit. If you have no specific protocol requirements and need a general-purpose POSIX-compatible file system, FSx for OpenZFS is an option.

Choosing Between EFS and FSx - Versatility vs. Specialization

EFS and FSx are frequently compared as AWS managed file systems. EFS is a general-purpose NFS v4 file system with automatic capacity scaling and easy mounting from Lambda and ECS. FSx, on the other hand, is optimized for specific workloads with significantly different performance characteristics. On the cost side, EFS automatically optimizes through access frequency-based tiering (Standard / Infrequent Access), while for FSx for Lustre, the SSD and HDD storage classes require you to specify storage capacity at creation (it can be increased later), and the Intelligent-Tiering storage class does not require a file system size and charges for the amount of data stored. The corresponding Azure services include Azure Files (SMB) and Azure NetApp Files (NFS/SMB).

Lustre and S3 Integration - Accelerating Data Pipelines

One feature of FSx for Lustre is its integration with S3. When you link an S3 bucket as a data repository, S3 object metadata is automatically mapped onto the Lustre file system. Actual data is loaded from S3 to Lustre storage on first file access using a lazy loading approach, eliminating the need to copy all data in advance. To write processing results back to S3, you use the hsm_archive command or the automatic export feature. There are two deployment types: Scratch and Persistent. Scratch provides temporary high-speed storage without data redundancy, offering lower cost but risking data loss on hardware failure. It is suited for batch processing and training jobs where source data is stored in S3 and can be re-executed. Persistent replicates data within the same AZ for the SSD and HDD storage classes and across multiple AZs for the Intelligent-Tiering storage class, and is suited for long-running workloads or retaining intermediate data that is expensive to recompute. For the SSD and HDD storage classes, throughput is chosen as a value per unit of storage capacity, with higher settings costing more. One approach is to start with a low throughput setting and increase it as needed while monitoring CloudWatch metrics.

References (Official AWS Resources)

The primary sources for this page are the official AWS website and documentation. Check the official pages below for the latest specifications and pricing.

If this page and the official documentation disagree, treat the official documentation as authoritative.

Share

Related Terms

Amazon EFSAmazon S3Amazon EBSAmazon SageMakerAWS Batch

Related Services

Amazon EFSAmazon S3Amazon SageMakerAWS Batch

Related Articles

GPU-Based Machine Learning Training with AWS Batch - Cost-Efficient Large-Scale TrainingRun GPU training with your existing Docker containers, and cut costs by up to 90% using Spot Instances and checkpointing. Includes guidance on when to choose Batch over SageMaker.Accelerating Data Transfer with AWS DataSync - Migration from On-Premises to S3 and EFSAutomate high-speed data transfer from on-premises to S3 and EFS. This guide covers agent deployment, task scheduling, and transfer data integrity verification.Choosing a Managed File System with Amazon FSx - When to Use Lustre, Windows, ONTAP, and OpenZFSCompare the four FSx file system types - Lustre, Windows, ONTAP, and OpenZFS - and learn guidelines for S3 integration and performance design.No-Code ML with Amazon SageMaker Canvas - Building Prediction Models with a Visual InterfaceA visual tool for building ML models without writing code. Simply upload a CSV and select a prediction target to build a model, with bidirectional sharing with Studio.Building an ML Platform with Amazon SageMaker - From Model Development to DeploymentFrom development in Studio to managed spot training, MLOps with Pipelines, and data drift detection with Model Monitor, this article covers how to integrate the entire ML lifecycle.

Similar Terms and Articles

Managed File Systems - High-Performance Shared Storage Achieved with Amazon FSx and EFSThis article explains how to build / operate managed file systems making use of Amazon FSx and Amazon EFS.Amazon FSxFully managed file systems for Windows File Server, Lustre, NetApp ONTAP, and OpenZFSChoosing a Managed File System with Amazon FSx - When to Use Lustre, Windows, ONTAP, and OpenZFSCompare the four FSx file system types - Lustre, Windows, ONTAP, and OpenZFS - and learn guidelines for S3 integration and performance design.AWS DataSyncA service that automates and accelerates data transfers between on-premises and AWS or between AWS services, supporting scheduled transfers across NFS/SMB/HDFS/S3/EFS/FSxHybrid Storage - Integrating On-Premises and Cloud with AWS Storage GatewayLearn about integrating on-premises and cloud storage with AWS Storage Gateway. Covers the four gateway types - S3 File Gateway, FSx File Gateway, Volume Gateway, and Tape Gateway - with use cases and deployment patterns.