An insurance company has raw data in JSON format that is sent without a predefined schedule through an Amazon Kinesis Data Firehose delivery stream to an Amazon S3 bucket. An AWS Glue crawler is scheduled to run every 8 hours to update the schema in the data catalog of the tables stored in the S3 bucket. Data analysts analyze the data using Apache Spark SQL on Amazon EMR set up with AWS Glue Data Catalog as the metastore. Data analysts say that, occasionally, the data they receive is stale. A data engineer needs to provide access to the most up-to-date data. Which solution meets these requirements?
A) Create an external schema based on the AWS Glue Data Catalog on the existing Amazon Redshift cluster to query new data in Amazon S3 with Amazon Redshift Spectrum.
B) Use Amazon CloudWatch Events with the rate (1 hour) expression to execute the AWS Glue crawler every hour.
C) Using the AWS CLI, modify the execution schedule of the AWS Glue crawler from 8 hours to 1 minute.
D) Run the AWS Glue crawler from an AWS Lambda function triggered by an S3:ObjectCreated:* event notification on the S3 bucket.
Correct Answer:
Verified
Q32: A company stores its sales and marketing
Q33: A large financial company is running its
Q34: A company that produces network devices has
Q35: A transportation company uses IoT sensors attached
Q36: A company leverages Amazon Athena for ad-hoc
Q38: A company has a business unit uploading
Q39: A company wants to improve the data
Q40: A data analyst is using AWS Glue
Q41: A company needs to store objects containing
Q42: A banking company wants to collect large
Unlock this Answer For Free Now!
View this answer and more for free by performing one of the following actions
Scan the QR code to install the App and get 2 free unlocks
Unlock quizzes for free by uploading documents