Skip to main content

Generate n-Grams (Terms)

Synopsis​

Creates term n-Grams of tokens in a document.

Description​

This operator creates term n-Grams of tokens in a document. A term n-Gram is defined as a series of consecutive tokens of length n. The term n-Grams generated by this operator consist of all series of consecutive tokens of length n.

Input​

document​

The document port.

Output​

document​

The document port.

Parameters​

Max length​

The maximal length of the n-Grams.