PutAzureDataLakeStorage

Description:

Writes the contents of a FlowFile as a file on Azure Data Lake Storage Gen 2

Additional Details...

Tags:

azure, microsoft, cloud, storage, adlsgen2, datalake

Properties:

In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.

Display NameAPI NameDefault ValueAllowable ValuesDescription
ADLS Credentialsadls-credentials-serviceController Service API:
ADLSCredentialsService
Implementations: ADLSCredentialsControllerServiceLookup
ADLSCredentialsControllerService
Controller Service used to obtain Azure Credentials.
Filesystem Namefilesystem-nameName of the Azure Storage File System (also called Container). It is assumed to be already existing.
Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)
Directory Namedirectory-nameName of the Azure Storage Directory. The Directory Name cannot contain a leading '/'. The root directory can be designated by the empty string value. In case of the PutAzureDataLakeStorage processor, the directory will be created if not already existing.
Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)
File Namefile-name${azure.filename}The filename
Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)
Writing Strategywriting-strategyWrite and Rename
  • Write and Rename The processor writes the Azure file into a temporary directory and then renames/moves it to the final destination. This prevents other processes from reading partially written files.
  • Simple Write The processor writes the Azure file directly to the destination. This might result in the reading of partially written files.
Defines the approach for writing the Azure file.
Base Temporary Pathbase-temporary-pathThe Path where the temporary directory will be created. The Path name cannot contain a leading '/'. The root directory can be designated by the empty string value. Non-existing directories will be created.The Temporary File Directory name is _nifitempdirectory
Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)

This Property is only considered if the [Writing Strategy] Property has a value of "Write and Rename".
Conflict Resolution Strategyconflict-resolution-strategyfail
  • fail
  • replace
  • ignore
Indicates what should happen when a file with the same name already exists in the output directory
Resource Transfer SourceResource Transfer SourceFlowFile Content
  • FlowFile Content The content of the incoming FlowFile provides the source for transfer
  • File Resource Service The File Resource Service provides the source for transfer
The source of the content to be transferred
File Resource ServiceFile Resource ServiceController Service API:
FileResourceService
Implementation: StandardFileResourceService
File Resource Service providing access to the local resource to be transferred

This Property is only considered if the [Resource Transfer Source] Property has a value of "File Resource Service".
Proxy Configuration Serviceproxy-configuration-serviceController Service API:
ProxyConfigurationService
Implementation: StandardProxyConfigurationService
Specifies the Proxy Configuration Controller Service to proxy network requests. Supported proxies: HTTP, SOCKS In case of SOCKS, it is not guaranteed that the selected SOCKS Version will be used by the processor.

Relationships:

NameDescription
successFiles that have been successfully written to Azure storage are transferred to this relationship
failureFiles that could not be written to Azure storage for some reason are transferred to this relationship

Reads Attributes:

None specified.

Writes Attributes:

NameDescription
azure.filesystemThe name of the Azure File System
azure.directoryThe name of the Azure Directory
azure.filenameThe name of the Azure File
azure.primaryUriPrimary location for file content
azure.lengthThe length of the Azure File

State management:

This component does not store state.

Restricted:

This component is not restricted.

Input requirement:

This component requires an incoming relationship.

System Resource Considerations:

None specified.

See Also:

DeleteAzureDataLakeStorage, FetchAzureDataLakeStorage, ListAzureDataLakeStorage