| Plucene documentation | view source | Contained in the Plucene distribution. |
Plucene::Analysis::WhitespaceTokenizer - white space tokenizer
# isa Plucene::Analysis::CharTokenizer
A WhitespaceTokenizer is a tokenizer that divides text at whitespace. Adjacent sequences of non-Whitespace characters form tokens.
| Plucene documentation | view source | Contained in the Plucene distribution. |