Search the web
Sign In
New User? Sign Up
LingPipe
? Already a member? Sign in to Yahoo!

Yahoo! Groups Tips

Did you know...
Hear how Yahoo! Groups has changed the lives of others. Take me there.

Best of Y! Groups

   Check them out and nominate your group.
Having problems with message search? Fill out this form to ensure your group is one of the first to be migrated to the new message search system.

Messages

  Messages Help
Advanced
Persistent Classifier in RDBMS?   Message List  
Reply | Forward Message #700 of 777 |
Re: [LingPipe] Persistent Classifier in RDBMS?

your_69_guy wrote:
> I have a training set of 45K documents for 1000 categories and
> don't want users of my application to have to wait while the classifier is
trained every time the open the application. I would prefer to
> run the training once and distribute the trained classifier object via
> a database.
>
> I am using Daffodil db which is capable of storing blobs.
>
> Is it possible to serialize an instance of a classifier after it is trained
and persist the object in a relation database for later use?
>
I have no idea of how Daffodil will deal with java serialization but you
can serialize with
the AbstractExternalizable class for any of the classifiers that
implement Compilable

http://alias-i.com/lingpipe/docs/api/index.html

something along the lines of

AbstractExternalizable.compileTo(classifier,modelFile);

from our http://alias-i.com/lingpipe/demos/tutorial/langid/read-me.html

but with how ever Daffodil provides that capability.



best

Breck

> What types of modifications would need to be made to make this possible?
>
>
>
> ------------------------------------
>
> Yahoo! Groups Links
>
>
>
>


--
Breck Baldwin
Alias-i, Inc.
181 North 11th Street, Suite 401
Brooklyn, NY 11211
v:718.290.9170
f:718.290.9171
m:917.292.8845
breck@...






Tue Jun 9, 2009 10:31 pm

reckb
Offline Offline
Send Email Send Email

Forward
Message #700 of 777 |
Expand Messages Author Sort by Date

I have a training set of 45K documents for 1000 categories and don't want users of my application to have to wait while the classifier is trained every time...
your_69_guy
Offline Send Email
Jun 9, 2009
8:04 pm

... I have no idea of how Daffodil will deal with java serialization but you can serialize with the AbstractExternalizable class for any of the classifiers...
Breck Baldwin
reckb
Offline Send Email
Jun 9, 2009
10:32 pm

... This will depend on which classifier you use. All of them either implement java.io.Serializable, or they implement com.aliasi.util.Compilable. The...
Bob Carpenter
colloquialdo...
Offline Send Email
Jun 10, 2009
5:49 am

Thanks Bob, the storing of the classifier into a blob field works great. I am having a little trouble reading the object back out of the database though. I...
your_69_guy
Offline Send Email
Jun 12, 2009
2:43 pm

I fiddled with the code some more and got it to work. here is the working code... note : this is extremely fast especially since the blob created from the...
your_69_guy
Offline Send Email
Jun 12, 2009
3:13 pm

I love it when people solve their own problems before I wake up in the morning! A good way to figure out what you've got serialized is to do this: Object obj =...
Bob Carpenter
colloquialdo...
Offline Send Email
Jun 12, 2009
5:09 pm
Advanced

Copyright © 2009 Yahoo! Inc. All rights reserved.
Privacy Policy - Terms of Service - Guidelines - Help