Hi Nino,
The problems below are related to running Hadoop, not Bixo.
Hadoop makes use of several shell commands, which initially request memory == the JVM size.
So if you don't have swap space allocated, or overcommit on, then you can run into problems where Java's exec() call fails due to not enough memory.
I would suggest first making sure you can run commands as described by the Quick Start guide on the Hadoop site:
-- Ken
On Oct 29, 2011, at 9:56pm, ninoapps wrote:
Hi,
I am new to Bixo / Hadoop / cascading , I am trying to learn and run bixo since one week ,
My initial try with windows did not work ,
So I installed linux .
I am trying to run SimpleCrawlTool on my linux ubuntu.
I am getting following error.
java.io.IOException: Cannot run program "bash": java.io.IOException: error=12, Cannot allocate memory
at java.lang.ProcessBuilder.start(ProcessBuilder.java:475)
at org.apache.hadoop.util.Shell.runCommand(Shell.java:149)
at org.apache.hadoop.util.Shell.run(Shell.java:134)
at org.apache.hadoop.fs.DF.getAvailable(DF.java:73)
at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:329)
Caused by: java.io.IOException: java.io.IOException: error=12, Cannot allocate memory
I am using following command line arguments from eclipse
-domain cnn.com -outputdir /home/abc/work/scraping/bixo/output -agentname test -numloops 2
and -Xmx1024m as JVM argument.
I have also got same error but different command
can not run program "chmod" instead of "bash".
Thank you bixo group in advance.
-Nino
--------------------------
Ken Krugler
custom big data solutions & training
Hadoop, Cascading, Mahout & Solr
Offline 
Send Email