SimpleDatabaseLookupService

Description:

A relational-database-based lookup service. When the lookup key is found in the database, the specified lookup value column is returned. Only one value will be returned for each lookup, duplicate database entries are ignored.

Tags:

lookup, cache, enrich, join, rdbms, database, reloadable, key, value

Properties:

In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.

NameDefault ValueAllowable ValuesDescription
Database Connection Pooling ServiceController Service API:
DBCPService
Implementations: DBCPConnectionPool
HiveConnectionPool
DBCPConnectionPoolLookup
HadoopDBCPConnectionPool
The Controller Service that is used to obtain connection to database
Table NameThe name of the database table to be queried. Note that this may be case-sensitive depending on the database.
Supports Expression Language: true (will be evaluated using flow file attributes and variable registry)
Lookup Key ColumnThe column in the table that will serve as the lookup key. This is the column that will be matched against the property specified in the lookup processor. Note that this may be case-sensitive depending on the database.
Supports Expression Language: true (will be evaluated using variable registry only)
Lookup Value ColumnThe column whose value will be returned when the Lookup value is matched
Supports Expression Language: true (will be evaluated using variable registry only)
Cache Size0Specifies how many lookup values/records should be cached. The cache is shared for all tables and keeps a map of lookup values to records. Setting this property to zero means no caching will be done and the table will be queried for each lookup value in each record. If the lookup table changes often or the most recent data must be retrieved, do not use the cache.
Supports Expression Language: true (will be evaluated using variable registry only)
Clear Cache on Enabledtrue
  • true
  • false
Whether to clear the cache when this service is enabled. If the Cache Size is zero then this property is ignored. Clearing the cache when the service is enabled ensures that the service will first go to the database to get the most recent data.
Cache ExpirationTime interval to clear all cache entries. If the Cache Size is zero then this property is ignored.
Supports Expression Language: true (will be evaluated using variable registry only)

State management:

This component does not store state.

Restricted:

This component is not restricted.

System Resource Considerations:

None specified.