-
Processors
- AttributeRollingWindow
- AttributesToCSV
- AttributesToJSON
- CalculateRecordStats
- CaptureChangeMySQL
- CompressContent
- ConnectWebSocket
- ConsumeAMQP
- ConsumeAzureEventHub
- ConsumeElasticsearch
- ConsumeGCPubSub
- ConsumeIMAP
- ConsumeJMS
- ConsumeKafka
- ConsumeKinesisStream
- ConsumeMQTT
- ConsumePOP3
- ConsumeSlack
- ConsumeTwitter
- ConsumeWindowsEventLog
- ControlRate
- ConvertCharacterSet
- ConvertRecord
- CopyAzureBlobStorage_v12
- CopyS3Object
- CountText
- CryptographicHashContent
- DebugFlow
- DecryptContentAge
- DecryptContentPGP
- DeduplicateRecord
- DeleteAzureBlobStorage_v12
- DeleteAzureDataLakeStorage
- DeleteByQueryElasticsearch
- DeleteDynamoDB
- DeleteFile
- DeleteGCSObject
- DeleteGridFS
- DeleteMongo
- DeleteS3Object
- DeleteSFTP
- DeleteSQS
- DetectDuplicate
- DistributeLoad
- DuplicateFlowFile
- EncodeContent
- EncryptContentAge
- EncryptContentPGP
- EnforceOrder
- EvaluateJsonPath
- EvaluateXPath
- EvaluateXQuery
- ExecuteGroovyScript
- ExecuteProcess
- ExecuteScript
- ExecuteSQL
- ExecuteSQLRecord
- ExecuteStreamCommand
- ExtractAvroMetadata
- ExtractEmailAttachments
- ExtractEmailHeaders
- ExtractGrok
- ExtractHL7Attributes
- ExtractRecordSchema
- ExtractText
- FetchAzureBlobStorage_v12
- FetchAzureDataLakeStorage
- FetchBoxFile
- FetchDistributedMapCache
- FetchDropbox
- FetchFile
- FetchFTP
- FetchGCSObject
- FetchGoogleDrive
- FetchGridFS
- FetchS3Object
- FetchSFTP
- FetchSmb
- FilterAttribute
- FlattenJson
- ForkEnrichment
- ForkRecord
- GenerateFlowFile
- GenerateRecord
- GenerateTableFetch
- GeoEnrichIP
- GeoEnrichIPRecord
- GeohashRecord
- GetAsanaObject
- GetAwsPollyJobStatus
- GetAwsTextractJobStatus
- GetAwsTranscribeJobStatus
- GetAwsTranslateJobStatus
- GetAzureEventHub
- GetAzureQueueStorage_v12
- GetDynamoDB
- GetElasticsearch
- GetFile
- GetFTP
- GetGcpVisionAnnotateFilesOperationStatus
- GetGcpVisionAnnotateImagesOperationStatus
- GetHubSpot
- GetMongo
- GetMongoRecord
- GetS3ObjectMetadata
- GetSFTP
- GetShopify
- GetSmbFile
- GetSNMP
- GetSplunk
- GetSQS
- GetWorkdayReport
- GetZendesk
- HandleHttpRequest
- HandleHttpResponse
- IdentifyMimeType
- InvokeHTTP
- InvokeScriptedProcessor
- ISPEnrichIP
- JoinEnrichment
- JoltTransformJSON
- JoltTransformRecord
- JSLTTransformJSON
- JsonQueryElasticsearch
- ListAzureBlobStorage_v12
- ListAzureDataLakeStorage
- ListBoxFile
- ListDatabaseTables
- ListDropbox
- ListenFTP
- ListenHTTP
- ListenOTLP
- ListenSlack
- ListenSyslog
- ListenTCP
- ListenTrapSNMP
- ListenUDP
- ListenUDPRecord
- ListenWebSocket
- ListFile
- ListFTP
- ListGCSBucket
- ListGoogleDrive
- ListS3
- ListSFTP
- ListSmb
- LogAttribute
- LogMessage
- LookupAttribute
- LookupRecord
- MergeContent
- MergeRecord
- ModifyBytes
- ModifyCompression
- MonitorActivity
- MoveAzureDataLakeStorage
- Notify
- PackageFlowFile
- PaginatedJsonQueryElasticsearch
- ParseEvtx
- ParseNetflowv5
- ParseSyslog
- ParseSyslog5424
- PartitionRecord
- PublishAMQP
- PublishGCPubSub
- PublishJMS
- PublishKafka
- PublishMQTT
- PublishSlack
- PutAzureBlobStorage_v12
- PutAzureCosmosDBRecord
- PutAzureDataExplorer
- PutAzureDataLakeStorage
- PutAzureEventHub
- PutAzureQueueStorage_v12
- PutBigQuery
- PutBoxFile
- PutCloudWatchMetric
- PutDatabaseRecord
- PutDistributedMapCache
- PutDropbox
- PutDynamoDB
- PutDynamoDBRecord
- PutElasticsearchJson
- PutElasticsearchRecord
- PutEmail
- PutFile
- PutFTP
- PutGCSObject
- PutGoogleDrive
- PutGridFS
- PutKinesisFirehose
- PutKinesisStream
- PutLambda
- PutMongo
- PutMongoBulkOperations
- PutMongoRecord
- PutRecord
- PutRedisHashRecord
- PutS3Object
- PutSalesforceObject
- PutSFTP
- PutSmbFile
- PutSNS
- PutSplunk
- PutSplunkHTTP
- PutSQL
- PutSQS
- PutSyslog
- PutTCP
- PutUDP
- PutWebSocket
- PutZendeskTicket
- QueryAirtableTable
- QueryAzureDataExplorer
- QueryDatabaseTable
- QueryDatabaseTableRecord
- QueryRecord
- QuerySalesforceObject
- QuerySplunkIndexingStatus
- RemoveRecordField
- RenameRecordField
- ReplaceText
- ReplaceTextWithMapping
- RetryFlowFile
- RouteHL7
- RouteOnAttribute
- RouteOnContent
- RouteText
- RunMongoAggregation
- SampleRecord
- ScanAttribute
- ScanContent
- ScriptedFilterRecord
- ScriptedPartitionRecord
- ScriptedTransformRecord
- ScriptedValidateRecord
- SearchElasticsearch
- SegmentContent
- SendTrapSNMP
- SetSNMP
- SignContentPGP
- SplitAvro
- SplitContent
- SplitExcel
- SplitJson
- SplitPCAP
- SplitRecord
- SplitText
- SplitXml
- StartAwsPollyJob
- StartAwsTextractJob
- StartAwsTranscribeJob
- StartAwsTranslateJob
- StartGcpVisionAnnotateFilesOperation
- StartGcpVisionAnnotateImagesOperation
- TagS3Object
- TailFile
- TransformXml
- UnpackContent
- UpdateAttribute
- UpdateByQueryElasticsearch
- UpdateCounter
- UpdateDatabaseTable
- UpdateRecord
- ValidateCsv
- ValidateJson
- ValidateRecord
- ValidateXml
- VerifyContentMAC
- VerifyContentPGP
- Wait
-
Controller Services
- ADLSCredentialsControllerService
- ADLSCredentialsControllerServiceLookup
- AmazonGlueSchemaRegistry
- ApicurioSchemaRegistry
- AvroReader
- AvroRecordSetWriter
- AvroSchemaRegistry
- AWSCredentialsProviderControllerService
- AzureBlobStorageFileResourceService
- AzureCosmosDBClientService
- AzureDataLakeStorageFileResourceService
- AzureEventHubRecordSink
- AzureStorageCredentialsControllerService_v12
- AzureStorageCredentialsControllerServiceLookup_v12
- CEFReader
- ConfluentEncodedSchemaReferenceReader
- ConfluentEncodedSchemaReferenceWriter
- ConfluentSchemaRegistry
- CSVReader
- CSVRecordLookupService
- CSVRecordSetWriter
- DatabaseRecordLookupService
- DatabaseRecordSink
- DatabaseTableSchemaRegistry
- DBCPConnectionPool
- DBCPConnectionPoolLookup
- DistributedMapCacheLookupService
- ElasticSearchClientServiceImpl
- ElasticSearchLookupService
- ElasticSearchStringLookupService
- EmailRecordSink
- EmbeddedHazelcastCacheManager
- ExcelReader
- ExternalHazelcastCacheManager
- FreeFormTextRecordSetWriter
- GCPCredentialsControllerService
- GCSFileResourceService
- GrokReader
- HazelcastMapCacheClient
- HikariCPConnectionPool
- HttpRecordSink
- IPLookupService
- JettyWebSocketClient
- JettyWebSocketServer
- JMSConnectionFactoryProvider
- JndiJmsConnectionFactoryProvider
- JsonConfigBasedBoxClientService
- JsonPathReader
- JsonRecordSetWriter
- JsonTreeReader
- Kafka3ConnectionService
- KerberosKeytabUserService
- KerberosPasswordUserService
- KerberosTicketCacheUserService
- LoggingRecordSink
- MapCacheClientService
- MapCacheServer
- MongoDBControllerService
- MongoDBLookupService
- PropertiesFileLookupService
- ProtobufReader
- ReaderLookup
- RecordSetWriterLookup
- RecordSinkServiceLookup
- RedisConnectionPoolService
- RedisDistributedMapCacheClientService
- RestLookupService
- S3FileResourceService
- ScriptedLookupService
- ScriptedReader
- ScriptedRecordSetWriter
- ScriptedRecordSink
- SetCacheClientService
- SetCacheServer
- SimpleCsvFileLookupService
- SimpleDatabaseLookupService
- SimpleKeyValueLookupService
- SimpleRedisDistributedMapCacheClientService
- SimpleScriptedLookupService
- SiteToSiteReportingRecordSink
- SlackRecordSink
- SmbjClientProviderService
- StandardAsanaClientProviderService
- StandardAzureCredentialsControllerService
- StandardDropboxCredentialService
- StandardFileResourceService
- StandardHashiCorpVaultClientService
- StandardHttpContextMap
- StandardJsonSchemaRegistry
- StandardKustoIngestService
- StandardKustoQueryService
- StandardOauth2AccessTokenProvider
- StandardPGPPrivateKeyService
- StandardPGPPublicKeyService
- StandardPrivateKeyService
- StandardProxyConfigurationService
- StandardRestrictedSSLContextService
- StandardS3EncryptionService
- StandardSSLContextService
- StandardWebClientServiceProvider
- Syslog5424Reader
- SyslogReader
- UDPEventRecordSink
- VolatileSchemaCache
- WindowsEventLogReader
- XMLFileLookupService
- XMLReader
- XMLRecordSetWriter
- YamlTreeReader
- ZendeskRecordSink
SiteToSiteStatusReportingTask 2.0.0
- Bundle
- org.apache.nifi | nifi-site-to-site-reporting-nar
- Description
- Publishes Status events using the Site To Site protocol. The component type and name filter regexes form a union: only components matching both regexes will be reported. However, all process groups are recursively searched for matching components, regardless of whether the process group matches the component filters.
- Tags
- history, metrics, site, site to site, status
- Input Requirement
- Supports Sensitive Dynamic Properties
- false
-
Additional Details for SiteToSiteStatusReportingTask 2.0.0
SiteToSiteStatusReportingTask
The Site-to-Site Status Reporting Task allows the user to publish Status events using the Site To Site protocol. The component type and name filter regexes form a union: only components matching both regexes will be reported. However, all process groups are recursively searched for matching components, regardless of whether the process group matches the component filters.
Record writer
The user can define a Record Writer and directly specify the output format and data with the assumption that the input schema is the following:
{ "type": "record", "name": "status", "namespace": "status", "fields": [ { "name": "statusId", "type": "string" }, { "name": "timestampMillis", "type": { "type": "long", "logicalType": "timestamp-millis" } }, { "name": "timestamp", "type": "string" }, { "name": "actorHostname", "type": "string" }, { "name": "componentType", "type": "string" }, { "name": "componentName", "type": "string" }, { "name": "parentId", "type": [ "string", "null" ] }, { "name": "parentName", "type": [ "string", "null" ] }, { "name": "parentPath", "type": [ "string", "null" ] }, { "name": "platform", "type": "string" }, { "name": "application", "type": "string" }, { "name": "componentId", "type": "string" }, { "name": "activeThreadCount", "type": [ "long", "null" ] }, { "name": "flowFilesReceived", "type": [ "long", "null" ] }, { "name": "flowFilesSent", "type": [ "long", "null" ] }, { "name": "bytesReceived", "type": [ "long", "null" ] }, { "name": "bytesSent", "type": [ "long", "null" ] }, { "name": "queuedCount", "type": [ "long", "null" ] }, { "name": "bytesRead", "type": [ "long", "null" ] }, { "name": "bytesWritten", "type": [ "long", "null" ] }, { "name": "terminatedThreadCount", "type": [ "long", "null" ] }, { "name": "runStatus", "type": [ "string", "null" ] }, { "name": "bytesTransferred", "type": [ "long", "null" ] }, { "name": "flowFilesTransferred", "type": [ "long", "null" ] }, { "name": "inputContentSize", "type": [ "long", "null" ] }, { "name": "outputContentSize", "type": [ "long", "null" ] }, { "name": "queuedContentSize", "type": [ "long", "null" ] }, { "name": "versionedFlowState", "type": [ "string", "null" ] }, { "name": "activeRemotePortCount", "type": [ "long", "null" ] }, { "name": "inactiveRemotePortCount", "type": [ "long", "null" ] }, { "name": "receivedContentSize", "type": [ "long", "null" ] }, { "name": "receivedCount", "type": [ "long", "null" ] }, { "name": "sentContentSize", "type": [ "long", "null" ] }, { "name": "sentCount", "type": [ "long", "null" ] }, { "name": "averageLineageDuration", "type": [ "long", "null" ] }, { "name": "transmissionStatus", "type": [ "string", "null" ] }, { "name": "targetURI", "type": [ "string", "null" ] }, { "name": "inputBytes", "type": [ "long", "null" ] }, { "name": "inputCount", "type": [ "long", "null" ] }, { "name": "outputBytes", "type": [ "long", "null" ] }, { "name": "outputCount", "type": [ "long", "null" ] }, { "name": "transmitting", "type": [ "boolean", "null" ] }, { "name": "sourceId", "type": [ "string", "null" ] }, { "name": "sourceName", "type": [ "string", "null" ] }, { "name": "destinationId", "type": [ "string", "null" ] }, { "name": "destinationName", "type": [ "string", "null" ] }, { "name": "maxQueuedBytes", "type": [ "long", "null" ] }, { "name": "maxQueuedCount", "type": [ "long", "null" ] }, { "name": "queuedBytes", "type": [ "long", "null" ] }, { "name": "backPressureBytesThreshold", "type": [ "long", "null" ] }, { "name": "backPressureObjectThreshold", "type": [ "long", "null" ] }, { "name": "backPressureDataSizeThreshold", "type": [ "string", "null" ] }, { "name": "isBackPressureEnabled", "type": [ "string", "null" ] }, { "name": "processorType", "type": [ "string", "null" ] }, { "name": "averageLineageDurationMS", "type": [ "long", "null" ] }, { "name": "flowFilesRemoved", "type": [ "long", "null" ] }, { "name": "invocations", "type": [ "long", "null" ] }, { "name": "processingNanos", "type": [ "long", "null" ] }, { "name": "executionNode", "type": [ "string", "null" ] }, { "name": "counters", "type": [ "null", { "type": "map", "values": "string" } ] } ] }
Properties
-
Batch Size
Specifies how many records to send in a single batch, at most.
- Display Name
- Batch Size
- Description
- Specifies how many records to send in a single batch, at most.
- API Name
- Batch Size
- Default Value
- 1000
- Expression Language Scope
- Not Supported
- Sensitive
- false
- Required
- true
-
Communications Timeout
Specifies how long to wait to a response from the destination before deciding that an error has occurred and canceling the transaction
- Display Name
- Communications Timeout
- Description
- Specifies how long to wait to a response from the destination before deciding that an error has occurred and canceling the transaction
- API Name
- Communications Timeout
- Default Value
- 30 secs
- Expression Language Scope
- Not Supported
- Sensitive
- false
- Required
- true
-
Component Name Filter Regex
A regex specifying which component names to report. Any component name matching this regex will be included.
- Display Name
- Component Name Filter Regex
- Description
- A regex specifying which component names to report. Any component name matching this regex will be included.
- API Name
- Component Name Filter Regex
- Default Value
- .*
- Expression Language Scope
- Environment variables defined at JVM level and system properties
- Sensitive
- false
- Required
- true
-
Component Type Filter Regex
A regex specifying which component types to report. Any component type matching this regex will be included. Component types are: Processor, RootProcessGroup, ProcessGroup, RemoteProcessGroup, Connection, InputPort, OutputPort
- Display Name
- Component Type Filter Regex
- Description
- A regex specifying which component types to report. Any component type matching this regex will be included. Component types are: Processor, RootProcessGroup, ProcessGroup, RemoteProcessGroup, Connection, InputPort, OutputPort
- API Name
- Component Type Filter Regex
- Default Value
- (Processor|ProcessGroup|RemoteProcessGroup|RootProcessGroup|Connection|InputPort|OutputPort)
- Expression Language Scope
- Environment variables defined at JVM level and system properties
- Sensitive
- false
- Required
- true
-
Compress Events
Indicates whether or not to compress the data being sent.
- Display Name
- Compress Events
- Description
- Indicates whether or not to compress the data being sent.
- API Name
- Compress Events
- Default Value
- true
- Allowable Values
-
- true
- false
- Expression Language Scope
- Not Supported
- Sensitive
- false
- Required
- true
-
Destination URL
The URL of the destination NiFi instance or, if clustered, a comma-separated list of address in the format of http(s)://host:port/nifi. This destination URL will only be used to initiate the Site-to-Site connection. The data sent by this reporting task will be load-balanced on all the nodes of the destination (if clustered).
- Display Name
- Destination URL
- Description
- The URL of the destination NiFi instance or, if clustered, a comma-separated list of address in the format of http(s)://host:port/nifi. This destination URL will only be used to initiate the Site-to-Site connection. The data sent by this reporting task will be load-balanced on all the nodes of the destination (if clustered).
- API Name
- Destination URL
- Expression Language Scope
- Environment variables defined at JVM level and system properties
- Sensitive
- false
- Required
- true
-
Include Null Values
Indicate if null values should be included in records. Default will be false
- Display Name
- Include Null Values
- Description
- Indicate if null values should be included in records. Default will be false
- API Name
- include-null-values
- Default Value
- false
- Allowable Values
-
- true
- false
- Expression Language Scope
- Not Supported
- Sensitive
- false
- Required
- true
-
Input Port Name
The name of the Input Port to deliver data to.
- Display Name
- Input Port Name
- Description
- The name of the Input Port to deliver data to.
- API Name
- Input Port Name
- Expression Language Scope
- Environment variables defined at JVM level and system properties
- Sensitive
- false
- Required
- true
-
Instance URL
The URL of this instance to use in the Content URI of each event.
- Display Name
- Instance URL
- Description
- The URL of this instance to use in the Content URI of each event.
- API Name
- Instance URL
- Default Value
- http://${hostname(true)}:8080/nifi
- Expression Language Scope
- Environment variables defined at JVM level and system properties
- Sensitive
- false
- Required
- true
-
Platform
The value to use for the platform field in each status record.
- Display Name
- Platform
- Description
- The value to use for the platform field in each status record.
- API Name
- Platform
- Default Value
- nifi
- Expression Language Scope
- Environment variables defined at JVM level and system properties
- Sensitive
- false
- Required
- true
-
Proxy Configuration Service
Specifies the Proxy Configuration Controller Service to proxy network requests. Supported proxies: HTTP + AuthN
- Display Name
- Proxy Configuration Service
- Description
- Specifies the Proxy Configuration Controller Service to proxy network requests. Supported proxies: HTTP + AuthN
- API Name
- proxy-configuration-service
- Service Interface
- org.apache.nifi.proxy.ProxyConfigurationService
- Service Implementations
- Expression Language Scope
- Not Supported
- Sensitive
- false
- Required
- false
- Dependencies
-
- Transport Protocol is set to any of [HTTP]
-
Record Writer
Specifies the Controller Service to use for writing out the records.
- Display Name
- Record Writer
- Description
- Specifies the Controller Service to use for writing out the records.
- API Name
- record-writer
- Service Interface
- org.apache.nifi.serialization.RecordSetWriterFactory
- Service Implementations
- Expression Language Scope
- Not Supported
- Sensitive
- false
- Required
- false
-
Transport Protocol
Specifies which transport protocol to use for Site-to-Site communication.
- Display Name
- Transport Protocol
- Description
- Specifies which transport protocol to use for Site-to-Site communication.
- API Name
- s2s-transport-protocol
- Default Value
- RAW
- Allowable Values
-
- RAW
- HTTP
- Expression Language Scope
- Not Supported
- Sensitive
- false
- Required
- true
-
SSL Context Service
The SSL Context Service to use when communicating with the destination. If not specified, communications will not be secure.
- Display Name
- SSL Context Service
- Description
- The SSL Context Service to use when communicating with the destination. If not specified, communications will not be secure.
- API Name
- SSL Context Service
- Service Interface
- org.apache.nifi.ssl.RestrictedSSLContextService
- Service Implementations
- Expression Language Scope
- Not Supported
- Sensitive
- false
- Required
- false