FetchAzureDataLakeStorage 2.0.0

Bundle
org.apache.nifi | nifi-azure-nar
Description
Fetch the specified file from Azure Data Lake Storage
Tags
adlsgen2, azure, cloud, datalake, microsoft, storage
Input Requirement
REQUIRED
Supports Sensitive Dynamic Properties
false
Properties
Relationships
Name Description
failure Files that could not be written to Azure storage for some reason are transferred to this relationship
success Files that have been successfully written to Azure storage are transferred to this relationship
Writes Attributes
Name Description
azure.datalake.storage.statusCode The HTTP error code (if available) from the failed operation
azure.datalake.storage.errorCode The Azure Data Lake Storage moniker of the failed operation
azure.datalake.storage.errorMessage The Azure Data Lake Storage error message from the failed operation
Use Cases Involving Other Components
  • Retrieve all files in an Azure DataLake Storage directory
    Description
    Retrieve all files in an Azure DataLake Storage directory
    Keywords
    azure, datalake, adls, state, retrieve, fetch, all, stream
    Processor Configurations
    org.apache.nifi.processors.azure.storage.ListAzureDataLakeStorage
    The "Filesystem Name" property should be set to the name of the Azure Filesystem (also known as a Container) that files reside in.     If the flow being built is to be reused elsewhere, it's a good idea to parameterize this property by setting it to something like `#{AZURE_FILESYSTEM}`.
Configure the "Directory Name" property to specify the name of the directory in the file system.     If the flow being built is to be reused elsewhere, it's a good idea to parameterize this property by setting it to something like `#{AZURE_DIRECTORY}`.

The "ADLS Credentials" property should specify an instance of the ADLSCredentialsService in order to provide credentials for accessing the filesystem.

The 'success' Relationship of this Processor is then connected to FetchAzureDataLakeStorage.
    org.apache.nifi.processors.azure.storage.FetchAzureDataLakeStorage
    "Filesystem Name" = "${azure.filesystem}"
"Directory Name" = "${azure.directory}"
"File Name" = "${azure.filename}"

The "ADLS Credentials" property should specify an instance of the ADLSCredentialsService in order to provide credentials for accessing the filesystem.
See Also