‹ All DEA-C01 questions

DEA-C01 Practice Question 96: Glue Data Catalog Hive Metastore

AWS Certified Data Engineer – Associate (DEA-C01) · Test 10 · question 6 of 10

Data Store Managementeasy

A team runs transient Amazon EMR clusters that are created for each job and terminated afterward. Hive table definitions created on one cluster are lost when it terminates, and analysts also want to query the same tables from Amazon Athena. Which change solves both problems?

Select one answer
Show answer and explanation

Answer:

  • C. Configure Hive on the clusters to use the AWS Glue Data Catalog as its metastore.

AWS recommends using the Glue Data Catalog as the Hive metastore *"when you require a persistent metastore or a metastore shared by different clusters, services, applications, or AWS accounts."* The Data Catalog *"provides a unified metadata repository across a variety of data sources and data formats, integrating with Amazon EMR as well as Amazon RDS, Amazon Redshift, Redshift Spectrum, Athena, and any application compatible with the Apache Hive metastore"* (option C). Table definitions survive cluster termination and are visible to Athena.

- A is wrong because HDFS on the primary node disappears when the cluster terminates, and other services cannot read it. - B is wrong because re-running scripts recreates definitions on every start but does not create a shared catalog that Athena can use, and it can drift from the actual tables. - D is wrong because a custom DynamoDB table is not a Hive metastore, so neither Hive nor Athena would read schemas from it without custom integration.

Reference: Using the AWS Glue Data Catalog as the metastore for Hive

Practice Test 10 ›

Study guides for DEA-C01