You are designing a cloud-native historical data processing system to meet the following conditions: The data being analyzed is in CSV, Avro, and PDF formats and will be accessed by multiple analysis tools including Cloud Dataproc, BigQuery, and Compute Engine. A streaming data pipeline stores new data daily. Peformance is not a factor in the solution. The solution design should maximize availability. How should you design data storage for this solution?
A) Create a Cloud Dataproc cluster with high availability. Store the data in HDFS, and peform analysis as needed.
B) Store the data in BigQuery. Access the data using the BigQuery Connector on Cloud Dataproc and Compute Engine.
C) Store the data in a regional Cloud Storage bucket. Access the bucket directly using Cloud Dataproc, BigQuery, and Compute Engine.
D) Store the data in a multi-regional Cloud Storage bucket. Access the data directly using Cloud Dataproc, BigQuery, and Compute Engine.

Question

Quizplus · Accepted Answer

Cloud Storage is a highly available object storage service that can store data in multiple regions. This ensures that the data is available even if one region experiences an outage. BigQuery and Cloud Dataproc can both access data directly from Cloud Storage, so this solution meets all of the requirements.

You Are Designing a Cloud-Native Historical Data Processing System to Meet