SchemaRegistry
Implementations: ConfluentSchemaRegistry
AmazonGlueSchemaRegistry
HortonworksSchemaRegistry
DatabaseTableSchemaRegistry
AvroSchemaRegistry
Specifies the Controller Service to use for the Schema Registry
This Property is only considered if the [Schema Access Strategy] Property is set to one of the following values: [Confluent Content-Encoded Schema Reference], [Use 'Schema Name' Property], [HWX Schema Reference Attributes], [HWX Content-Encoded Schema Reference] | Schema Name | schema-name | ${schema.name} | | Specifies the name of the schema to lookup in the Schema Registry property Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)
This Property is only considered if the [Schema Access Strategy] Property has a value of "Use 'Schema Name' Property". |
Schema Version | schema-version | | | Specifies the version of the schema to lookup in the Schema Registry. If not specified then the latest version of the schema will be retrieved. Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)
This Property is only considered if the [Schema Access Strategy] Property has a value of "Use 'Schema Name' Property". |
Schema Branch | schema-branch | | | Specifies the name of the branch to use when looking up the schema in the Schema Registry property. If the chosen Schema Registry does not support branching, this value will be ignored. Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)
This Property is only considered if the [Schema Access Strategy] Property has a value of "Use 'Schema Name' Property". |
Schema Text | schema-text | ${avro.schema} | | The text of an Avro-formatted Schema Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)
This Property is only considered if the [Schema Access Strategy] Property has a value of "Use 'Schema Text' Property". |
Grok Patterns | Grok Pattern File | | | Grok Patterns to use for parsing logs. If not specified, a built-in default Pattern file will be used. If specified, all patterns specified will override the default patterns. See the Controller Service's Additional Details for a list of pre-defined patterns.
This property requires exactly one resource to be provided. That resource may be any of the following types: URL, file, text.
Supports Expression Language: true (will be evaluated using variable registry only) |
Grok Expressions | Grok Expression | | | Specifies the format of a log line in Grok format. This allows the Record Reader to understand how to parse each log line. The property supports one or more Grok expressions. The Reader attempts to parse input lines according to the configured order of the expressions.If a line in the log file does not match any expressions, the line will be assumed to belong to the previous log message.If other Grok patterns are referenced by this expression, they need to be supplied in the Grok Pattern File property.
This property requires exactly one resource to be provided. That resource may be any of the following types: URL, file, text.
|
No Match Behavior | no-match-behavior | Append to Previous Message | - Append to Previous Message
- Skip Line
- Raw Line
| If a line of text is encountered and it does not match the given Grok Expression, and it is not part of a stack trace, this property specifies how the text should be processed. |
State management:
This component does not store state.Restricted:
Required Permission | Explanation |
---|
reference remote resources | Patterns and Expressions can reference resources over HTTP |
System Resource Considerations:
None specified.