help me about StringTokenizer in text mining

nguyenxuanhau

Hello
i want to modify class SimpleKokenizer to process tokenizer for fitness my language
so i found  operator  StringTokenizer in text plug had used class StringTokenizer of wvtool.jar
but i didn't found class StringTokenizer in source code wvtool 1.1
please help me what version source code of the wvtool had class java StringTokenizer
best regard
Hau

fischer

Hi,

the 5.x versions of the text extension does not use the wvtool anymore. Earlier versions of the text plugin use the wvtool version that is shipped with the source version of the plugin.

Cheers,
Simon