PutDruidRecord

Description:

Sends records to Druid for Indexing. Leverages Druid Tranquility Controller service.

Tags:

druid, timeseries, olap, ingest, put, record

Properties:

In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values.

NameDefault ValueAllowable ValuesDescription
Record ReaderController Service API:
RecordReaderFactory
Implementations: Syslog5424Reader
AvroReader
JsonPathReader
ScriptedReader
XMLReader
GrokReader
JsonTreeReader
SyslogReader
CSVReader
Specifies the Controller Service to use for parsing incoming data and determining the data's schema.
Record WriterController Service API:
RecordSetWriterFactory
Implementations: ScriptedRecordSetWriter
JsonRecordSetWriter
CSVRecordSetWriter
AvroRecordSetWriter
XMLRecordSetWriter
FreeFormTextRecordSetWriter
The Record Writer to use in order to serialize the data to outgoing relationships.
Tranquility ServiceController Service API:
DruidTranquilityService
Implementation: DruidTranquilityController
Tranquility Service to use for sending events to Druid.

Relationships:

NameDescription
successFlowFiles are routed to this relationship when they are successfully processed by Druid
droppedFlowFiles are routed to this relationship when they are outside of the configured time window, timestamp format is invalid, ect...
failureFlowFiles are routed to this relationship when they cannot be parsed or otherwise processed by Druid

Reads Attributes:

None specified.

Writes Attributes:

NameDescription
record.countThe number of messages that were sent to Druid for this FlowFile. FlowFiles on the success relationship will have a value of this attribute that indicates the number of records successfully processed by Druid, and the FlowFile content will be only the successful records. This behavior applies to the failure and dropped relationships as well.

State management:

This component does not store state.

Restricted:

This component is not restricted.

Input requirement:

This component requires an incoming relationship.

System Resource Considerations:

None specified.