org.sindice.siren.analysis

Class NumericTokenizer

java.lang.Object

org.apache.lucene.util.AttributeSource

org.apache.lucene.analysis.TokenStream

org.apache.lucene.analysis.Tokenizer

org.sindice.siren.analysis.NumericTokenizer

All Implemented Interfaces:

Closeable, AutoCloseable

public class NumericTokenizer
extends org.apache.lucene.analysis.Tokenizer

This class provides a TokenStream for indexing numeric values that is used in NumericAnalyzer.

This tokenizer expects to receive a string representation of a numeric value as input. It parses the input using NumericAnalyzer.NumericParser.parseAndConvert(Reader), and uses a NodeNumericTermAttribute to generate the numeric token.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.lucene.util.AttributeSource

org.apache.lucene.util.AttributeSource.AttributeFactory, org.apache.lucene.util.AttributeSource.State

Field Summary

Fields inherited from class org.apache.lucene.analysis.Tokenizer

input

Constructor Summary

Constructors

Constructor and Description
NumericTokenizer(Reader input, NumericAnalyzer.NumericParser<? extends Number> parser, int precisionStep) Creates a token stream for numeric values with the specified precisionStep.
NumericTokenizer(Reader input, NumericAnalyzer.NumericParser<? extends Number> parser, int precisionStep, org.apache.lucene.util.AttributeSource.AttributeFactory factory) Expert: Creates a token stream for numeric values with the specified precisionStep using the given AttributeSource.AttributeFactory.

Method Summary

Methods

Modifier and Type	Method and Description
boolean	incrementToken()
void	reset()

Methods inherited from class org.apache.lucene.analysis.Tokenizer

close, correctOffset, setReader

Methods inherited from class org.apache.lucene.analysis.TokenStream

end

Methods inherited from class org.apache.lucene.util.AttributeSource

addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, restoreState

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

NumericTokenizer

public NumericTokenizer(Reader input,
                NumericAnalyzer.NumericParser<? extends Number> parser,
                int precisionStep)

Creates a token stream for numeric values with the specified precisionStep.

NumericTokenizer

public NumericTokenizer(Reader input,
                NumericAnalyzer.NumericParser<? extends Number> parser,
                int precisionStep,
                org.apache.lucene.util.AttributeSource.AttributeFactory factory)

Expert: Creates a token stream for numeric values with the specified precisionStep using the given AttributeSource.AttributeFactory.

Method Detail

reset

public void reset()
           throws IOException

Overrides:

reset in class org.apache.lucene.analysis.TokenStream

Throws:

IOException

incrementToken

public final boolean incrementToken()
                             throws IOException

Specified by:

incrementToken in class org.apache.lucene.analysis.TokenStream

Throws:

IOException