Where do you look for pipeline logs on Google Cloud?
Why B is the answer
Cloud Logging
Cloud Logging is where pipeline logs are searched on Google Cloud.
In detail
- Pipeline logs go to Cloud Logging.
- Cloud Monitoring holds metrics and alerts.
Use case
An illustrative scenario, not a real incident.
An engineer searches Cloud Logging for a failed pipeline step.
See it in different ways
sequenceDiagram participant C as Managed Service for Apache Airflow participant J as Dataproc job participant L as Cloud Logging participant O as Operator C->>J: Start the step J--xC: Fails C->>J: Retry J->>L: Logs C-->>O: Alert if retries run out
flowchart TD
Q{"What do you need?"}
Q -->|"Log messages"| A0["Cloud Logging"]
Q -->|"Metrics and alerts"| A1["Cloud Monitoring"]Key point: Pipeline logs live in Cloud Logging.
Why the other options are wrong
- A. Pub/Sub
- Pub/Sub carries messages.
- C. Transfer Appliance
- An appliance moves data.
- D. BigLake
- BigLake is for analytics.