AWS Data Exchange Specialized2019年〜
A data marketplace that makes it easy to find, subscribe to, and use third-party datasets
What It Does
AWS Data Exchange is a data marketplace where you can easily find, subscribe to, and use third-party datasets on AWS. Over 300 data providers offer thousands of datasets including financial data, weather data, geospatial data, and healthcare data. Subscribed data is delivered directly to S3 and integrates seamlessly with AWS analytics services like Athena, Redshift, and SageMaker. You can also publish and sell your own data as a data provider.
Use Cases
It is used for investment analysis and risk management with financial market data, demand forecasting and logistics optimization with weather data, marketing strategy development with demographic data, store location analysis with geospatial data, accelerating drug research with medical research data, and creating new revenue streams by selling proprietary data externally - supporting data-driven decision-making across the board.
Everyday Analogy
Think of it like an online shopping mall for data. You browse a catalog (marketplace) for the data (products) you need, purchase it, and have it delivered directly to your home (S3). Previously, you had to contact each data provider individually, sign contracts, and download via FTP, but with Data Exchange you can start a subscription with just one click.
What Is Data Exchange?
AWS Data Exchange is a data marketplace service launched in 2019. For data-driven decision-making, organizations need not only internal data but also external data. However, the traditional data acquisition process involved many steps - individual negotiations with providers, contract procedures, and technical data transfer setup. Data Exchange standardizes these processes and leverages the AWS Marketplace infrastructure for efficient data transactions.
Finding and Subscribing to Data
Data Exchange lets you search for datasets by category or keyword. Each dataset includes detailed information such as sample data, update frequency, data format, and pricing, so you can review the content before purchasing. Many free datasets are also available. Once you subscribe, data is automatically delivered to your S3 bucket, and you are notified when new revisions are available. Programmatic data retrieval via API is also supported. For a deeper understanding of data discovery and subscription, books on Amazon are a useful resource.
Using Data Exchange as a Provider
Data Exchange offers functionality not just for data consumers but also for providers to publish and sell data. You can register your datasets on Data Exchange, define pricing and access conditions, and publish them. AWS handles data delivery automatically, so providers can focus on maintaining data quality. A subscription-based billing model also enables recurring revenue.
Things to Watch Out For
- Dataset pricing is set by providers, so prices for similar data can vary significantly. Compare multiple providers before subscribing
- The scope of data usage is governed by the Data Use Agreement (DUA), so check whether commercial use and redistribution are permitted before subscribing
