ConvertCSVToAvro

Description:

Converts CSV files to Avro according to an Avro Schema

Tags:

kite, csv, avro

Properties:

In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.

NameDefault ValueAllowable ValuesDescription
Hadoop configuration filesA comma-separated list of Hadoop configuration files
Record schemaOutgoing Avro schema for each record created from a CSV row
Supports Expression Language: true
CSV charsetutf8Character set for CSV files
Supports Expression Language: true
CSV delimiter,Delimiter character for CSV records
Supports Expression Language: true
CSV quote character"Quote character for CSV values
Supports Expression Language: true
CSV escape character\Escape character for CSV values
Supports Expression Language: true
Use CSV header linefalseWhether to use the first line as a header
Supports Expression Language: true
Lines to skip0Number of lines to skip before reading header or data
Supports Expression Language: true
Compression typeSNAPPY
  • BZIP2
  • DEFLATE
  • NONE
  • SNAPPY
  • LZO
Compression type to use when writting Avro files. Default is Snappy.

Relationships:

NameDescription
successAvro content that was converted successfully from CSV
failureCSV content that could not be processed
incompatibleCSV content that could not be converted

Reads Attributes:

None specified.

Writes Attributes:

None specified.

State management:

This component does not store state.

Restricted:

This component is not restricted.

Input requirement:

This component requires an incoming relationship.