This processor is deprecated and may be removed in future releases.
Please consider using one the following alternatives: InvokeHTTP
Please be aware this processor is deprecated and may be removed in the near future. Use InvokeHTTP instead. Fetches data from an HTTP or HTTPS URL and writes the data to the content of a FlowFile. Once the content has been fetched, the ETag and Last Modified dates are remembered (if the web server supports these concepts). This allows the Processor to fetch new data only if the remote data has changed or until the state is cleared. That is, once the content has been fetched from the given URL, it will not be fetched again until the content on the remote server changes. Note that due to limitations on state management, stored "last modified" and etag fields never expire. If the URL in GetHttp uses Expression Language that is unbounded, there is the potential for Out of Memory Errors to occur.
get, fetch, poll, http, https, ingest, source, input
In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.
| Display Name | API Name | Default Value | Allowable Values | Description |
|---|---|---|---|---|
| URL | URL | The URL to pull from Supports Expression Language: true (will be evaluated using variable registry only) | ||
| Filename | Filename | The filename to assign to the file when pulled Supports Expression Language: true (will be evaluated using variable registry only) | ||
| SSL Context Service | SSL Context Service | Controller Service API: SSLContextService Implementations: StandardSSLContextService StandardRestrictedSSLContextService | The Controller Service to use in order to obtain an SSL Context | |
| Username | Username | Username required to access the URL | ||
| Password | Password | Password required to access the URL Sensitive Property: true | ||
| Connection Timeout | Connection Timeout | 30 sec | How long to wait when attempting to connect to the remote server before giving up | |
| Data Timeout | Data Timeout | 30 sec | How long to wait between receiving segments of data from the remote server before giving up and discarding the partial file | |
| User Agent | User Agent | What to report as the User Agent when we connect to the remote server | ||
| Accept Content-Type | Accept Content-Type | If specified, requests will only accept the provided Content-Type | ||
| Follow Redirects | Follow Redirects | false |
| If we receive a 3xx HTTP Status Code from the server, indicates whether or not we should follow the redirect that the server specifies |
| Redirect Cookie Policy | redirect-cookie-policy | default |
| When a HTTP server responds to a request with a redirect, this is the cookie policy used to copy cookies to the following request. |
| Proxy Configuration Service | proxy-configuration-service | Controller Service API: ProxyConfigurationService Implementation: StandardProxyConfigurationService | Specifies the Proxy Configuration Controller Service to proxy network requests. If set, it supersedes proxy settings configured per component. Supported proxies: HTTP + AuthN | |
| Proxy Host | Proxy Host | The fully qualified hostname or IP address of the proxy server | ||
| Proxy Port | Proxy Port | The port of the proxy server |
Supports Sensitive Dynamic Properties: No
Dynamic Properties allow the user to specify both the name and value of a property.
| Name | Value | Description |
|---|---|---|
| Header Name | The Expression Language to be used to populate the header value | The additional headers to be sent by the processor whenever making a new HTTP request.
Setting a dynamic property name to XYZ and value to ${attribute} will result in the header 'XYZ: attribute_value' being sent to the HTTP endpoint Supports Expression Language: true (will be evaluated using variable registry only) |
| Name | Description |
|---|---|
| success | All files are transferred to the success relationship |
| Name | Description |
|---|---|
| filename | The filename is set to the name of the file on the remote server |
| mime.type | The MIME Type of the FlowFile, as reported by the HTTP Content-Type header |
| Scope | Description |
|---|---|
| LOCAL | Stores Last Modified Time and ETag headers returned by server so that the same data will not be fetched multiple times. |
