| Plucene documentation | Contained in the Plucene distribution. |
Plucene::Analysis::Analyzer - base class for Analyzers
my $analyzer = Plucene::Analysis::Analyzer::Subclass->new;
This is an abstract base class of Analyzers.
An Analyzer builds TokenStreams, which analyze text. It thus represents a policy for extracting index terms from text.
Typical implementations first build a Tokenizer, which breaks the stream of characters from the Reader into raw Tokens. One or more TokenFilters may then be applied to the output of the Tokenizer.
my $analyzer = Plucene::Analysis::Analyzer::Subclass->new;
This must be defined in a subclass
| Plucene documentation | Contained in the Plucene distribution. |
package Plucene::Analysis::Analyzer;
use strict; use warnings;
sub new { bless {}, shift }
sub tokenstream { die "tokenstream must be defined in a subclass" } 1;