summaryrefslogtreecommitdiff
path: root/docs/reference/analysis/tokenfilters/unique-tokenfilter.asciidoc
blob: 8b42f6b73b93462a2ee6526a708392c79fa47c76 (plain)
1
2
3
4
5
6
7
[[analysis-unique-tokenfilter]]
=== Unique Token Filter

The `unique` token filter can be used to only index unique tokens during
analysis. By default it is applied on all the token stream. If
`only_on_same_position` is set to `true`, it will only remove duplicate
tokens on the same position.