*** Very Urgent *** Hello, I am New to Bixo. I installed cygwin on windows so that i can run Bixo. When i tried to run "bin/bixo crawl", i got an error...
775
Vivek Magotra
vmagotra
Sep 22, 2011 6:56 am
Hi Nitin, I believe Ken's reference to not needing Hadoop applies to the case where one is working directly with the source. In that case the pom file has a...
776
Vivek Magotra
vmagotra
Sep 22, 2011 7:11 am
Hi Nitin, One more thing : If you are trying to work with the bixo-core jar in your code then the pom file will pull in the necessary dependencies. Please see...
777
Nitin Jain
intel_steel
Sep 22, 2011 10:33 am
Hello Vivek, Thanks for your reply. I downloaded Hadoop. I will surely ask you more questions. You are very helpful.I have lot of questions to ask, may be due...
778
Nitin Jain
intel_steel
Sep 23, 2011 1:10 am
Hello, I could not run Bixo through command line in cygwin.But, It runs successfully using Eclipse. Now, i need good Tutorials of Bixo. Can anyone send me the...
779
Vivek Magotra
vmagotra
Sep 23, 2011 2:40 am
Hi Nitin, As far as I am aware there is no "tutorial"; on Bixo - it would be nice to have one... To get started take a look at the examples -...
780
nitin
intel_steel
Sep 23, 2011 4:48 am
Hello Vivek, I run 'SimpleCrawltool.java' in eclispe successfully with arguments. 1. It created a 4 Directory e.g. 0-20110922T223738, 0-20110922T223739 etc.......
781
Vivek Magotra
vmagotra
Sep 23, 2011 5:14 am
Nitin, If you aren't already familiar with Cascading (and/or Hadoop) I would suggest you start there first. You could start reading the section on Source and...
782
anka.software
Sep 25, 2011 9:17 am
Hi, I have started with Bixo and created a new project (outside of Bixo build project / directory) and copied SimpleCrawlTool to my project and renamed it to...
783
Nitin Jain
intel_steel
Sep 25, 2011 1:03 pm
Have you built the baxo using ant?...
784
anka.software
Sep 25, 2011 1:32 pm
Yes bixo and bixo eclipse project were built using ant....
785
nitin
intel_steel
Sep 25, 2011 2:48 pm
Hello, I am also very new(3-4 days) to Bixo. I built the Bixo using ANT command: ANT Eclipse Then i opened the Bixo project in Eclipse & tested...
786
Ken Krugler
kkrugler
Sep 25, 2011 3:20 pm
... The above makes me thing you're not using a clean, recent (e.g. Hadoop 0.20.2) installation of Hadoop. What is your HADOOP_HOME set to? And what happens if...
787
anka.software
Sep 25, 2011 5:57 pm
Hi Ken, Installed latest build of Hadoop 0.20.203.0 and set HADOOP_HOME to the root of the install? No change in the errors....
788
Ken Krugler
kkrugler
Sep 25, 2011 6:56 pm
... Please figure out where hadoop-site.xml is coming from, as that's the older style of configuration file. -- Ken ... Ken Krugler +1 530-210-6378 ...
789
anka.software
Sep 25, 2011 8:44 pm
Did a file search, the only places hadoop-site.xml exist is in the new ly installed hadoop 0.20.203.0. Unless the file is embedded in a jar....
790
Ken Krugler
kkrugler
Sep 25, 2011 10:07 pm
... I just downloaded 0.20.203, and it does not contain a hadoop-site.xml -- Ken ... Ken Krugler +1 530-210-6378 http://bixolabs.com custom big data solutions...
791
nitin
intel_steel
Sep 26, 2011 1:24 am
Hello, I downloaded hadoop-0.20.203.0rc1.tar.gz . I found Hadoop-site.xml at 3 location: 1. d:/hadoop/src/test 2. d:/hadoop/src/contrib/test 3....
792
nitin
intel_steel
Sep 26, 2011 1:46 am
Hello Ken, I got this when i run SimpleTestTool.java: DEPRECATED: hadoop-site.xml found in the classpath. Usage of hadoop-site.xml is deprecated. Instead use...
793
nitin
intel_steel
Sep 26, 2011 1:41 pm
Hello Ken, I tried to run SimpleCrawlTools.java using 'urls' argument but its not working. I wanna use Text file with urls. Regards,...
794
Ken Krugler
kkrugler
Sep 26, 2011 1:49 pm
... Sorry, I should have been more clear - I didn't find it in any place that should be on your classpath, which is required for it to be found by Hadoop. Are...
795
Vivek Magotra
vmagotra
Sep 26, 2011 2:20 pm
Hi all, There have been a few posts regarding problems running Bixo with Hadoop 0.20.203.0. The reason for this is that the Hadoop jar naming scheme has...
796
anka.software
Sep 26, 2011 5:46 pm
Ken, I am running from within the IDE and have set HADOOP_HOME to the hadoop install directory....
800
ninoapps
Oct 29, 2011 8:56 pm
Hi, I am new to Bixo / Hadoop / cascading , I am trying to learn and run bixo since one week , My initial try with windows did not work , So I installed linux...
801
Ken Krugler
kkrugler
Oct 30, 2011 7:46 am
Hi Nino, The problems below are related to running Hadoop, not Bixo. Hadoop makes use of several shell commands, which initially request memory == the JVM...
802
camsalford
Nov 8, 2011 10:04 pm
Whether you are new to data mining or an expert, we'd like to invite you to the 2012 Salford Analytics and Data Mining Conference (ADMC)! You can expect to...
804
Michele C
michelecos
Nov 11, 2011 10:58 am
Thank you all, I am starting to work with Bixo, have passed the first step and now need pointers. I have installed hadoop, pulled the git archive, compiled and...
805
ninoapps
Nov 14, 2011 6:20 pm
Hi Ken, Thank you for your feedback. I have solved my problem. I am sharing my experience if it becomes useful for someone else. MY issue got resolved once...
806
Ken Krugler
kkrugler
Nov 14, 2011 9:26 pm
... Excellent, thanks for sharing. -- Ken ... Ken Krugler http://www.scaleunlimited.com custom big data solutions & training Hadoop, Cascading, Mahout & Solr...
807
Ken Krugler
kkrugler
Nov 14, 2011 10:37 pm
Hi Michele, ... You would need to write a Cascading job that takes an existing crawlDB as input, along with your (potentially) new URLs, as merge the two...
