I recently downloaded LingPipe 3.6.0 and tried the ChineseToken tutorial sample. I always got NullPointerException. My environment is: - Window XP - Java...
... It sure does. Thanks for the detailed bug report. The culprit is the following file: $LINGPIPE/src/com/aliasi/spell/CompiledSpellChecker.java The method...
Hi Bob, I have a question on Model Quality. I used the ChineseToken sample to generated a words-zh-as.CompiledSpellChecker model, which has size 78,303KB. I...
... The other way to control model size is take longer n-grams and prune out low-count sequences. If you follow the tutorial, you'll see where we run standard...
Hi Bob, Thanks for replying. Does longer n-grams model mean more accuracy? How do I prune out low-count sequences from model using LingPipe? I have some...
... Usually longer n-grams means more accuracy up to a point at which accuracy plateaus. Longer n-grams can overfit in some situations compared to shorter...
Thanks, Bob. The goal of making English Chinese word alignment is to create some TMX files for "translation memory" tools used by translators. We have some MT...
LingPipe 3.7.0 is now available from: http://alias-i.com/lingpipe The only significant change is an update to the MEDLINE DTDs used by the MEDLINE parser....
LingPipe 3.7.0 will generate a warning when compiling all jars because of an issue with non-ASCII chars in one of our java files. It works with Windows...
Hello, I was looking at NGramBoundaryLM and wondering why exactly those begin and end characters are needed and when you'd use NGramBoundaryLM instead of...
... The spelling corrector and HMMs wrap this all up the right way by default. Classifiers require you to specify which to use, and the decision is based on...
A user reported a problem with HMM decoding on a specific hardware/software configuration: Athlon64/Ubuntu 8.1 64-bit/JDK 1.6 An exception is thrown in the...
Bob - I recently got burned by http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6196102 going from Java 1.5 to Java 1.6 (1.6.0_11-b03, 32-bit, Linux on Intel...
... Thanks for the tip. I should've tried forcing interpreted mode to help debug. My 64-bit java doesn't have a client JVM, only a server one. I ran into some...
Out of curiosity, what happens when you hit this bug? Does the JVM just die (HotSpot error), or? Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr -...
Yea, I guess they consider {@code <= Integer.MAX_VALUE} a rare case or something and its been fixed and regressed according to our cross JVM build experience....
... The problem was that a variable that's mathematically bounded to be between 0 and 1 with infinite precision wanders outside of that range with (some)...
Hi: I am a newbie of lingpipe. I read some tutorial on the langpipe website but many NLP terms frightened me. The classification samples included in the...
... There are also classifiers used in the language ID, word sense disambiguation, sentiment, and logistic regression tutorials. The word sense disambiguation...
... I am planning to crawl universities, research labs and job websites to get many researchers' profile information and then provide a search interface for...
... There's been some serious work on more or less exactly this problem of classifying university web pages into types. Mark Craven created a data set back in...
Hi: Many thanks for your help. Web-KB is a great corpus for me. As us said, logistic regression classifier is much harder to train. Maybe I have to dig into...
Hello I am trying out the Sentiment Analysis tutorial (PolarityHierarchical.java). I want to dump the classifier as a file, so that I donot have to run through...
... The answer is that the result is an LMClassifier, not a DynamicLMClassifier; the result of compilation is a more compact and efficient implementation, but...
Hi, bob: I am trying to use NaiveBayesClassifier to classify text documents. Here is my code: String regex = "[a-zA-Z]+"; RegExTokenizerFactory tf = new...
Thanks for the great bug report. Your diagnosis is sport on. Our RegExTokenizerFactory's serialization is broken, because I forgot the write-replace. I just...
Hi, bob: I have add the fix as u said, but it doesn't work for me now. And the same exception occurs. I have no idea about that. I dig into the code and find...