Skip to main content

Get Page

Synopsis​

Gets a page via HTTP.

Description​

This operator sends a GET request via HTTP. The returned page is output as a document.

Output​

output​

The output port.

Parameters​

Url​

The URL from which should be read.

Random user agent​

Choose a user agent randomly from a set of 7000 user agents

User agent​

The user agent property.

Connection timeout​

The timeout (in ms) for the connection.

Read timeout​

The timeout (in ms) for reading from the URL.

Follow redirects​

Specifies, whether redirects should be followed.

Accept cookies​

Specifies, whether cookies should be accepted.

Specifies the scope of the cookies used

Request method​

Specifies the request method.

Query parameters​

The query parameters as key/value pairs.

Request properties​

With this parameter you can define all properties that are sent with the HTTP request to match the needs of your webservice.

Override encoding​

Normally, the encoding of the retrieved page is determined automatically. In some rare cases this does not work well or the server provides a wrong encoding string. In this case, you can enable this option to override the automatically detected encoding.

Encoding​

The encoding used for reading or writing files.

Keep sensitive headers​

Keep "Authorization" and "Cookie" header during a redirect to a different domain or subdomain.