PutAzureCosmosDBRecord

Description:

This processor is a record-aware processor for inserting data into Cosmos DB with Core SQL API. It uses a configured record reader and schema to read an incoming record set from the body of a Flowfile and then inserts those records into a configured Cosmos DB Container.

Tags:

azure, cosmos, insert, record, put

Properties:

In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values.

Display NameAPI NameDefault ValueAllowable ValuesDescription
Cosmos DB Connection Serviceazure-cosmos-db-connection-serviceController Service API:
AzureCosmosDBConnectionService
Implementation: AzureCosmosDBClientService		If configured, the controller service used to obtain the connection string and access key
Cosmos DB URIazure-cosmos-db-uriCosmos DB URI, typically in the form of https://{databaseaccount}.documents.azure.com:443/ Note this host URL is for Cosmos DB with Core SQL API from Azure Portal (Overview->URI)
Sensitive Property: true
Cosmos DB Access Keyazure-cosmos-db-keyCosmos DB Access Key from Azure Portal (Settings->Keys). Choose a read-write key to enable database or container creation at run time
Sensitive Property: true
Cosmos DB Consistency Levelazure-cosmos-db-consistency-levelSESSION
  • STRONG
  • BOUNDED_STALENESS
  • SESSION
  • CONSISTENT_PREFIX
  • EVENTUAL
Choose from five consistency levels on the consistency spectrum. Refer to Cosmos DB documentation for their differences
Cosmos DB Nameazure-cosmos-db-nameThe database name or id. This is used as the namespace for document collections or containers
Cosmos DB Container IDazure-cosmos-db-container-idThe unique identifier for the container
Cosmos DB Partition Keyazure-cosmos-db-partition-keyThe partition key used to distribute data among servers
Record Readerrecord-readerController Service API:
RecordReaderFactory
Implementations: GrokReader
JsonTreeReader
WindowsEventLogReader
ReaderLookup
ParquetReader
CSVReader
Syslog5424Reader
ExcelReader
CEFReader
XMLReader
ScriptedReader
SyslogReader
JsonPathReader
AvroReader
YamlTreeReader		Specifies the Controller Service to use for parsing incoming data and determining the data's schema
Insert Batch Sizeinsert-batch-size20The number of records to group together for one single insert operation against Cosmos DB
Cosmos DB Conflict Handling Strategyazure-cosmos-db-conflict-handling-strategyIgnore
  • Ignore Conflicting records will not be inserted, and FlowFile will not be routed to failure
  • Upsert Conflicting records will be upserted, and FlowFile will not be routed to failure
Choose whether to ignore or upsert when conflict error occurs during insertion

Relationships:

NameDescription
successAll FlowFiles that are written to Cosmos DB are routed to this relationship
failureAll FlowFiles that cannot be written to Cosmos DB are routed to this relationship

Reads Attributes:

None specified.

Writes Attributes:

None specified.

State management:

This component does not store state.

Restricted:

This component is not restricted.

Input requirement:

This component requires an incoming relationship.

System Resource Considerations:

ResourceDescription
MEMORYAn instance of this component can cause high usage of this system resource. Multiple instances or high concurrency settings may result a degradation of performance.