CLF-C02 Practice Question 99: Serverless Data Integration
AWS Certified Cloud Practitioner (CLF-C02) · Test 10 · question 9 of 10
A data team receives CSV and JSON files from several systems into Amazon S3. It wants to discover the files' schemas automatically and record them in a central data catalog, then run extract, transform and load (ETL) jobs that clean the data and convert it into an analytics-friendly format. The team does not want to provision or manage any servers or clusters. Which service meets these requirements?
Show answer and explanation
Answer:
AWS Glue is a serverless data integration service for discovering, preparing, moving and integrating data from multiple sources. Crawlers automatically infer schema information and add it to the AWS Glue Data Catalog, a central catalog that Amazon Athena, Amazon EMR and Amazon Redshift Spectrum can query. Glue also lets you create, run and monitor ETL jobs that clean and transform data, and because it's serverless, there is no infrastructure to manage.
Option B, Kinesis Data Streams, ingests *real-time streams* of records. It doesn't catalog files already in S3 or run ETL jobs over them. Option C, Amazon Athena, runs SQL queries against data in S3, often using the Glue Data Catalog for table definitions, but it is not the service that crawls schemas and runs transformation jobs. Option D, Amazon Redshift, is a data warehouse that stores and queries data. It isn't a serverless ETL and cataloging service for raw files in S3.
Reference: What is AWS Glue?