Data from a supported SaaS source must load into BigQuery on a schedule. What fits?
Why C is the answer
BigQuery Data Transfer Service
The Data Transfer Service automates scheduled loads.
In detail
- BigQuery Data Transfer Service loads supported sources on a schedule.
- There is no pipeline to build.
Use case
An illustrative scenario, not a real incident.
Ad data must arrive daily from a supported source, and Data Transfer Service schedules that.
See it in different ways
flowchart TD
A{"What are you moving?"} -->|"Huge offline data"| B["Transfer Appliance"]
A -->|"SaaS or warehouse data into BigQuery"| C["BigQuery Data Transfer Service"]
A -->|"A relational database"| D["Database Migration Service"]
A -->|"Ongoing change data capture"| E["Datastream"]stateDiagram-v2 [*] --> Source Source --> TransferAppliance: petabytes, slow network Source --> Datastream: database changes, continuous Source --> DataTransferService: SaaS on a schedule TransferAppliance --> Validate Datastream --> Validate DataTransferService --> Validate Validate --> [*]
flowchart LR S0["Choose a source"] --> S1["Set a schedule"] --> S2["Data arrives in BigQuery"]
Key point: Data Transfer Service automates scheduled loads.
Why the other options are wrong
- A. Pub/Sub
- Pub/Sub carries events.
- B. Transfer Appliance
- An appliance moves bulk data offline.
- D. Datastream
- Datastream replicates database changes.