org.apache.lucene.analysis

Class Tokenizer

public abstract class Tokenizer extends TokenStream

A Tokenizer is a TokenStream whose input is a Reader.

This is an abstract class.

Field Summary
protected Readerinput
The text source for this Tokenizer.
Constructor Summary
protected Tokenizer()
Construct a tokenizer with null input.
protected Tokenizer(Reader input)
Construct a token stream processing the given input.
Method Summary
voidclose()
By default, closes the input Reader.

Field Detail

input

protected Reader input
The text source for this Tokenizer.

Constructor Detail

Tokenizer

protected Tokenizer()
Construct a tokenizer with null input.

Tokenizer

protected Tokenizer(Reader input)
Construct a token stream processing the given input.

Method Detail

close

public void close()
By default, closes the input Reader.
Copyright © 2000-2008 Apache Software Foundation. All Rights Reserved.