Plucene::Analysis::WhitespaceTokenizer - white space tokenizer


Plucene documentation  | view source Contained in the Plucene distribution.

Index


NAME

Top

Plucene::Analysis::WhitespaceTokenizer - white space tokenizer

SYNOPSIS

Top

	# isa Plucene::Analysis::CharTokenizer

DESCRIPTION

Top

A WhitespaceTokenizer is a tokenizer that divides text at whitespace. Adjacent sequences of non-Whitespace characters form tokens.

METHODS

Top


Plucene documentation  | view source Contained in the Plucene distribution.