Search the web
Sign In
New User? Sign Up
bixo-dev · Bixo Web Mining Toolkit

Group Information

  • Members: 79
  • Category: Open Source
  • Founded: May 17, 2009
  • Language: English
? Already a member? Sign in to Yahoo!

Yahoo! Groups Tips

Did you know...
Real people. Real stories. See how Yahoo! Groups impacts members worldwide.

Messages

  Messages Help
Advanced
JDBC Tap   Message List  
Reply Message #887 of 916 |
I am using my own database to load my crawl urls and the associated information.
I am using mysql and my data has a DateTime fields. I am getting the following
serialization error:

cascading.CascadingException: unable to load serializer for: java.sql.Timestamp
from: org.apache.hadoop.io.serializer.SerializationFactory
at
cascading.tuple.hadoop.TupleSerialization.getNewSerializer(TupleSerialization.ja\
va:309)
at
cascading.tuple.hadoop.SerializationElementWriter.write(SerializationElementWrit\
er.java:75)
at cascading.tuple.TupleOutputStream.write(TupleOutputStream.java:221)
at cascading.tuple.TupleOutputStream.writeTuple(TupleOutputStream.java:179)
at cascading.tuple.hadoop.TupleSerializer.serialize(TupleSerializer.java:37)
at cascading.tuple.hadoop.TupleSerializer.serialize(TupleSerializer.java:28)


Any workaround where I can use my original datatype and don't need to modify it?

Thanks.




Wed Jan 18, 2012 8:29 pm

crazytora
Offline Offline

Message #887 of 916 |
Expand Messages Author Sort by Date

I am using my own database to load my crawl urls and the associated information. I am using mysql and my data has a DateTime fields. I am getting the following...
crazytora Offline Jan 18, 2012
8:29 pm

... You'd need to specify a serialization class to use with Timestamp. See http://www.cascading.org/1.2/userguide/html/ch06s08.html for more details. -- Ken ...
Ken Krugler
kkrugler Offline Send Email
Jan 18, 2012
8:52 pm

Do I need to write my own implementation of Writable to serialize java.sql.Timestamp?...
crazytora Offline Jan 18, 2012
10:43 pm

... As per the Cascading page, you need to provide a class that implements the Hadoop Serialization<T> interface, and have it return a Serializer and...
Ken Krugler
kkrugler Offline Send Email
Jan 18, 2012
11:52 pm
Advanced

Copyright © 2010 Yahoo! Inc. All rights reserved.
Privacy Policy - Terms of Service - Guidelines NEW - Help