Skip to main content

Question 163

You have data pipelines running on BigQuery, Dataflow, and Dataproc. You need to perform health checks and monitor their behavior, and then notify the team managing the pipelines if they fail. You also need to be able to work across multiple projects. Your preference is to use managed products or features of the platform. What should you do?

  • A. Export the information to Cloud Monitoring, and set up an Alerting policy
  • B. Run a Virtual Machine in Compute Engine with Airflow, and export the information to Cloud Monitoring
  • C. Export the logs to BigQuery, and set up App Engine to read that information and send emails if you find a failure in the logs
  • D. Develop an App Engine application to consume logs using GCP API calls, and send emails if you find a failure in the logs