org.sindice.siren.analysis

Class TupleTokenizer

java.lang.Object

org.apache.lucene.util.AttributeSource

org.apache.lucene.analysis.TokenStream

org.apache.lucene.analysis.Tokenizer

org.sindice.siren.analysis.TupleTokenizer

All Implemented Interfaces:

Closeable, AutoCloseable

Deprecated.

Use JsonTokenizer instead

@Deprecated
public class TupleTokenizer
extends org.apache.lucene.analysis.Tokenizer

A grammar-based tokenizer constructed with JFlex for N-Tuples. Splits a N-Tuple into BNode, URI, Literal and Dot tokens.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.lucene.util.AttributeSource

org.apache.lucene.util.AttributeSource.AttributeFactory, org.apache.lucene.util.AttributeSource.State

Field Summary

Fields

Modifier and Type	Field and Description
static int	BNODE Deprecated. Token definition
static int	DOT Deprecated.
static int	LITERAL Deprecated.
protected static String[]	TOKEN_TYPES Deprecated.
static int	URI Deprecated.

Fields inherited from class org.apache.lucene.analysis.Tokenizer

input

Constructor Summary

Constructors

Constructor and Description
TupleTokenizer(Reader input) Deprecated. Creates a new instance of the TupleTokenizer.

Method Summary

Methods

Modifier and Type	Method and Description
void	close() Deprecated.
static String[]	getTokenTypes() Deprecated.
boolean	incrementToken() Deprecated.
void	reset() Deprecated.

Methods inherited from class org.apache.lucene.analysis.Tokenizer

correctOffset, setReader

Methods inherited from class org.apache.lucene.analysis.TokenStream

end

Methods inherited from class org.apache.lucene.util.AttributeSource

addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, restoreState

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, toString, wait, wait, wait

Field Detail

BNODE

public static final int BNODE

Deprecated.

Token definition

See Also:

Constant Field Values

URI

public static final int URI

Deprecated.

See Also:

Constant Field Values

LITERAL

public static final int LITERAL

Deprecated.

See Also:

Constant Field Values

DOT

public static final int DOT

Deprecated.

See Also:

Constant Field Values

TOKEN_TYPES

protected static String[] TOKEN_TYPES

Deprecated.

Constructor Detail

TupleTokenizer

public TupleTokenizer(Reader input)

Deprecated.

Creates a new instance of the TupleTokenizer. Attaches the input to a newly created JFlex scanner.

Method Detail

getTokenTypes

public static String[] getTokenTypes()

Deprecated.

incrementToken

public final boolean incrementToken()
                             throws IOException

Deprecated.

Specified by:

incrementToken in class org.apache.lucene.analysis.TokenStream

Throws:

IOException

reset

public void reset()
           throws IOException

Deprecated.

Overrides:

reset in class org.apache.lucene.analysis.TokenStream

Throws:

IOException

close

public void close()
           throws IOException

Deprecated.

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Overrides:

close in class org.apache.lucene.analysis.Tokenizer

Throws:

IOException