HadoopCatalogService

Description:

Catalog service that can use HDFS or similar file systems that support atomic rename.

Tags:

iceberg, catalog, service, hadoop, hdfs

Properties:

In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.

Display NameAPI NameDefault ValueAllowable ValuesDescription
Warehouse Pathwarehouse-pathPath to the location of the warehouse.
Supports Expression Language: true (will be evaluated using Environment variables only)
Hadoop Configuration Resourceshadoop-config-resourcesA file, or comma separated list of files, which contain the Hadoop configuration (core-site.xml, etc.). Without this, default configuration will be used.

This property expects a comma-separated list of file resources.

Supports Expression Language: true (will be evaluated using Environment variables only)

State management:

This component does not store state.

Restricted:

This component is not restricted.

System Resource Considerations:

None specified.