load_google_cloud_pubsub
Subscribes to a Google Cloud Pub/Sub subscription and obtains bytes.
load_google_cloud_pubsub project_id=string, subscription_id=string, [timeout=duration]Description
Section titled “Description”The operator acquires raw bytes from a Google Cloud Pub/Sub subscription.
project_id = string
Section titled “project_id = string”The project to connect to. Note that this is the project id, not the display name.
subscription_id = string
Section titled “subscription_id = string”The subscription to subscribe to.
timeout = duration (optional)
Section titled “timeout = duration (optional)”How long to wait for messages before ending the connection. A duration of zero means the operator will run forever.
The default value is 0s.
URI support & integration with from
Section titled “URI support & integration with from”The load_google_cloud_pubsub operator can also be used from the from
operator. For this, the gcps:// scheme can be used. The URI is then translated:
from "gcps://my_project/my_subscription"load_google_cloud_pubsub project_id="my_project", subscription_id="my_subscription"Examples
Section titled “Examples”Read JSON messages from a subscription
Section titled “Read JSON messages from a subscription”Subscribe to my-subscription in the project amazing-project-123456 and parse
the messages as JSON:
load_google_cloud_pubsub project_id="amazing-project-123456", subscription_id="my-subscription"read_json