Event-driven channels

Google Cloud Datastream

Google Cloud Datastream is a serverless change data capture (CDC) and replication service that allows you to synchronize data across heterogeneous databases, storage systems, and applications reliably and with minimal latency.

3 channels across 1 AsyncAPI spec · Provider profile

Channels

bigquery/{projectId}/{datasetId}/{tableId}

BigQuery destination table populated by Datastream. Datastream appends a STRUCT column named datastream_metadata to each replicated table. In merge write mode, datastream_metadata contains UUID and SO

Google Cloud Datastream CDC Events
cloud-storage/{bucket}/{rootPath}/{schemaTable}/{yyyy}/{mm}/{dd}/{hh}/{minute}/{objectFile}

Cloud Storage destination path for a Datastream change event file. Datastream organizes data by object and source timestamp. The first folder under the configured root path is [schema]_[table], follow

Google Cloud Datastream CDC Events
spanner/{projectId}/{instanceId}/{databaseId}/{tableId}

Cloud Spanner destination table populated by Datastream. Event ordering is determined by combining commit_timestamp, record_sequence, and mod_index.

Google Cloud Datastream CDC Events