n-gram phrase matching for many phrases

[andehr]

Create a document processor that can efficiently identify custom ngrams of any length for a possibly large number of custom ngrams.

Create a corresponding feature inferrer that can pick out and produce these custom ngrams as features.

These should be able to override the normal ngrams to avoid feature repetition, but also pay attention to other filtering.

There should be an option to include or remove overlapping matches.