Converts records from one data format to another using configured Record Reader and Record Write Controller Services. The Reader and Writer must be configured with "matching" schemas. By this, we mean the schemas must have the same field names. The types of the fields do not have to be the same if a field value can be coerced from one type to another. For instance, if the input schema has a field named "balance" of type double, the output schema can have a field named "balance" with a type of string, double, or float. If any field is present in the input that is not present in the output, the field will be left out of the output. If any field is specified in the output schema but is not present in the input data/schema, then the field will not be present in the output or will have a null value, depending on the writer.
convert, record, generic, schema, json, csv, avro, log, logs, freeform, text
In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values.
| Display Name | API Name | Default Value | Allowable Values | Description |
|---|---|---|---|---|
| Record Reader | Record Reader | Controller Service API: RecordReaderFactory Implementations: CSVReader JsonPathReader AvroReader CEFReader Syslog5424Reader JsonTreeReader WindowsEventLogReader XMLReader SyslogReader JASN1Reader ReaderLookup ParquetReader GrokReader ScriptedReader YamlTreeReader ExcelReader | Specifies the Controller Service to use for reading incoming data | |
| Record Writer | Record Writer | Controller Service API: RecordSetWriterFactory Implementations: XMLRecordSetWriter FreeFormTextRecordSetWriter AvroRecordSetWriter ScriptedRecordSetWriter JsonRecordSetWriter ParquetRecordSetWriter RecordSetWriterLookup CSVRecordSetWriter | Specifies the Controller Service to use for writing out the records | |
| Include Zero Record FlowFiles | Include Zero Record FlowFiles | true |
| When converting an incoming FlowFile, if the conversion results in no data, this property specifies whether or not a FlowFile will be sent to the corresponding relationship |
| Name | Description |
|---|---|
| failure | If a FlowFile cannot be transformed from the configured input format to the configured output format, the unchanged FlowFile will be routed to this relationship |
| success | FlowFiles that are successfully transformed will be routed to this relationship |
| Name | Description |
|---|---|
| mime.type | Sets the mime.type attribute to the MIME Type specified by the Record Writer |
| record.count | The number of records in the FlowFile |
| record.error.message | This attribute provides on failure the error message encountered by the Reader or Writer. |
Convert data from one record-oriented format to another
The Record Reader should be configured according to the incoming data format.
The Record Writer should be configured according to the desired output format.