Thanks Bob. I have got NEEvaluateCommand to work with
-dictionary=DictionaryFilePath (the code of
NEEvaluateCommand needs to be modified first).
I wonder anyone has any experience specifying stopList
from a file when using NEEvaluateCommand.
--- Bob Carpenter <carp@...> wrote:
> I saw from your next message you found what you
> were looking for, but just to clarify for everyone
> else:
>
> > I wonder if I can find some examples that
> illustrate how to
> > use NEEvaluateCommand.
>
> We can't distribute examples because we don't
> own any of the annotated data. My suggestion
> is to use the CoNLL data if you want something
> simple or the GENIA data if you want something
> more complex XML data oriented. Both are free.
>
> > I'm also interested in using it for 10-fold cross
> validation...
>
> The current evaluation command does not do
> 10-fold x-validation. It does an evaluation
> of the last n% after training on the first
> (100-n)%.
>
> There are two options for x-validation:
>
> 1. Hack the current command by rearranging
> the corpus cyclicly. Down side is that you
> have to combine the results yourself somehow.
>
> 2. Rewrite your own command that does it right.
> There just needs to be a loop on top of what
> there's now and some way to combine the results.
>
> - Bob
>
>
__________________________________
Celebrate Yahoo!'s 10th Birthday!
Yahoo! Netrospective: 100 Moments of the Web
http://birthday.yahoo.com/netrospective/