Google Associate Data Practitioner : ADP

You work for a healthcare company. You have a daily ETL pipeline that extracts patient data from a legacy system, transforms it, and loads it into BigQuery for analysis. The pipeline currently runs manually using a shell script. You want to automate this process and add monitoring to ensure pipeline observability and troubleshooting insights. You want one centralized solution, using open-source tooling, without rewriting the ETL code. What should you do?

• A. Create a Cloud Run function that runs the pipeline daily. Monitor the functions execution using Cloud Monitoring.
• B. Create a direct acyclic graph (DAG) in Cloud Composer to orchestrate a pipeline trigger daily. Monitor the pipeline's execution using the Apache Airflow web interface and Cloud Monitoring.
• C. Configure Cloud Dataflow to implement the ETL pipeline, and use Cloud Scheduler to trigger the Dataflow pipeline daily. Monitor the pipelines execution using the Dataflow job monitoring interface and Cloud Monitoring.
• D. Use Cloud Scheduler to trigger a Dataproc job to execute the pipeline daily. Monitor the job's progress using the Dataproc job web interface and Cloud Monitoring.

Your organization uses a BigQuery table that is partitioned by ingestion time. You need to remove data that is older than one year to reduce your organization's storage costs. You want to use the most efficient approach while minimizing cost. What should you do?

• A. Create a scheduled query that periodically runs an update statement in SQL that sets the "deleted" column to "yes" for data that is more than one year old. Create a view that filters out rows that have been marked deleted.
• B. Require users to specify a partition filter using the alter table statement in SQL.
• C. Create a view that filters out rows that are older than one year.
• D. Set the table partition expiration period to one year using the ALTER TABLE statement in SQL.

Your organization is building a new application on Google Cloud. Several data files will need to be stored in Cloud Storage. Your organization has approved only two specific cloud regions where these data files can reside. You need to determine a Cloud Storage bucket strategy that includes automated high availability.
What should you do?

• A. Create a dual-region bucket, and upload the files to this bucket.
• B. Create a single-region bucket in each of the two regions, and use Storage Transfer Service to replicate the data across the buckets in both regions.
• C. Create a multi-region bucket, and upload the files to this bucket.
• D. Create a single-region bucket in each of the two regions, and use the gcloud storage command to replicate the data across the buckets in both regions.

Your organization uses Dataflow pipelines to process real-time financial transactions. You discover that one of your Dataflow jobs has failed. You need to troubleshoot the issue as quickly as possible. What should you do?

• A. Create a custom script to periodically poll the Dataflow API for job status updates, and send email alerts if any errors are identified.
• B. Use the gcloud CLI tool to retrieve job metrics and logs, and analyze them for errors and performance bottlenecks.
• C. Set up a Cloud Monitoring dashboard to track key Dataflow metrics, such as data throughput, error rates, and resource utilization.
• D. Navigate to the Dataflow Jobs page in the Google Cloud console. Use the job logs and worker logs to identify the error.

Your company wants to implement a data transformation (ETL) pipeline for their BigQuery data warehouse.
You need to identify a managed transformation solution that allows users to develop with SQL and JavaScript, has version control, allows for modular code, and has data quality checks. What should you do?

• A. Use Dataproc to create an Apache Spark cluster and implement the transformations by using PySpark SQL.
• B. Create BigQuery scheduled queries to define the transformations in SQL.
• C. Create a Cloud Composer environment, and orchestrate the transformations by using the BigQueryinsertJob operator.
• D. Use Dataform to define the transformations in SQLX.