blob: 9ed28e60b91e0a615ebb886d779449b3e08a9387 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
|
[[analysis-uaxurlemail-tokenizer]]
=== UAX Email URL Tokenizer
A tokenizer of type `uax_url_email` which works exactly like the
`standard` tokenizer, but tokenizes emails and urls as single tokens.
The following are settings that can be set for a `uax_url_email`
tokenizer type:
[cols="<,<",options="header",]
|=======================================================================
|Setting |Description
|`max_token_length` |The maximum token length. If a token is seen that
exceeds this length then it is discarded. Defaults to `255`.
|=======================================================================
|
