PublishGCPubSubLite

Description:

Publishes the content of the incoming FlowFile to the configured Google Cloud PubSub Lite topic. The processor supports dynamic properties. If any dynamic properties are present, they will be sent along with the message in the form of 'attributes'.

Tags:

google, google-cloud, gcp, message, pubsub, publish, lite

Properties:

In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.

Display NameAPI NameDefault ValueAllowable ValuesDescription
Topic Namegcp-pubsub-topicName of the Google Cloud PubSub Topic. Example: projects/8476107443/locations/europe-west1-d/topics/my-lite-topic
Supports Expression Language: true (will be evaluated using variable registry only)
GCP Credentials Provider ServiceGCP Credentials Provider ServiceController Service API:
GCPCredentialsService
Implementation: GCPCredentialsControllerService
The Controller Service used to obtain Google Cloud Platform credentials.
Ordering Keygcp-ordering-keyMessages with the same ordering key will always get published to the same partition. When this property is not set, messages can get published to different partitions if more than one partition exists for the topic.
Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)
Batch Size Thresholdgcp-pubsub-publish-batch-size15Indicates the number of messages the cloud service should bundle together in a batch. If not set and left empty, only one message will be used in a batch
Batch Bytes Thresholdgcp-batch-bytes3 MBPublish request gets triggered based on this Batch Bytes Threshold property and the Batch Size Threshold property, whichever condition is met first.
Supports Expression Language: true (will be evaluated using variable registry only)
Batch Delay Thresholdgcp-pubsub-publish-batch-delay100 millisIndicates the delay threshold to use for batching. After this amount of time has elapsed (counting from the first element added), the elements will be wrapped up in a batch and sent. This value should not be set too high, usually on the order of milliseconds. Otherwise, calls might appear to never complete.

Dynamic Properties:

Supports Sensitive Dynamic Properties: No

Dynamic Properties allow the user to specify both the name and value of a property.

NameValueDescription
Attribute nameValue to be set to the attributeAttributes to be set for the outgoing Google Cloud PubSub Lite message
Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)

Relationships:

NameDescription
successFlowFiles are routed to this relationship after a successful Google Cloud Pub/Sub operation.
failureFlowFiles are routed to this relationship if the Google Cloud Pub/Sub operation fails.

Reads Attributes:

None specified.

Writes Attributes:

NameDescription
gcp.pubsub.messageIdID of the pubsub message published to the configured Google Cloud PubSub topic
gcp.pubsub.topicName of the Google Cloud PubSub topic the message was published to

State management:

This component does not store state.

Restricted:

This component is not restricted.

Input requirement:

This component requires an incoming relationship.

System Resource Considerations:

ResourceDescription
MEMORYThe entirety of the FlowFile's content will be read into memory to be sent as a PubSub message.

See Also:

ConsumeGCPubSubLite