fr.gouv.culture.sdx.search.lucene.analysis.tokenizer
Class ChineseTokenizer

java.lang.Object
  org.apache.lucene.analysis.TokenStream
      org.apache.lucene.analysis.Tokenizer
          fr.gouv.culture.sdx.search.lucene.analysis.tokenizer.ChineseTokenizer

public final class ChineseTokenizer
extends org.apache.lucene.analysis.Tokenizer

Title: ChineseTokenizer Description: Extract tokens from the Stream using Character.getType() Rule: A Chinese character as a single token Copyright: Copyright (c) 2001 Company:

Version:

1.0

Author:

Yiyi Sun

Field Summary

Fields inherited from class org.apache.lucene.analysis.Tokenizer

input

Constructor Summary

ChineseTokenizer(java.io.Reader in)

Method Summary

org.apache.lucene.analysis.Token

next()

Methods inherited from class org.apache.lucene.analysis.Tokenizer

close

Methods inherited from class org.apache.lucene.analysis.TokenStream

reset

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ChineseTokenizer

public ChineseTokenizer(java.io.Reader in)

Method Detail

next

public final org.apache.lucene.analysis.Token next()
                                            throws java.io.IOException

Specified by:

next in class org.apache.lucene.analysis.TokenStream

Throws:

java.io.IOException