Hi Mohammad, The command I use to run my pig script successfully is: pig \ -param vehicleByStyle=/user/oozie/vehicle-recommender/vehicle-by-style \ -param ...
1374
Mohammad Islam
mislam77@...
May 2, 2011 7:29 pm
Hi Tim, Do you see any issue with memory for oozie launcher mapper? In general, the default memory is low. However I could see in CLI, it uses "-Xmx1000m". You...
1375
Tim Chan
zzztimbo
May 2, 2011 8:57 pm
Hi Mohammad, I tried using 2G for oozie.launcher.mapred.child.java.opts and it did not make a difference. If you look at the following snippet from the oozie...
1376
Tim Chan
zzztimbo
May 3, 2011 1:11 am
HI Mohammad, I'm looking at the TaskTracker logs and I find that it is continually attempting to run the final m/r job from my pig script: 2011-05-02...
1377
Mohammad Islam
mislam77
May 3, 2011 1:23 am
Hi Tim, I forgot to add more. For memory more than 1.5 G, you might need to don’t he followings. I think your use-case should be tried with 1G memory. ...
1378
Mohammad Islam
mislam77
May 3, 2011 7:29 pm
Thanks Tim for the extra information. Are you sure there are extra slots available in hadoop cluster? You know Oozie consume extra 1 map slot compared to pig...
1379
John Hui
lazyjohnmousey
May 4, 2011 5:26 pm
I am running about 15 schedule which create an oozie workflow once every hour. It uses the default derby database. The oozie is getting really slow, it is a...
1380
John Hui
lazyjohnmousey
May 4, 2011 6:40 pm
<prepare> <delete path="${nameNode}/tmp/${wf:user()}/hdfsdir1" /> </prepare> Is there a way to get oozie to delete the path only if it exist.. It return an...
1381
Mohammad Islam
mislam77
May 4, 2011 8:42 pm
Hi John, It is hard to know the root cause without looking further. We never use derby for production like system. However I will prefer to move to mysql. How...
1382
Alejandro Abdelnur
tucu0
May 4, 2011 8:48 pm
John, Following up on Mohammad's points: * What do you mean by slow? Slow how? * Have you looked at the instrumentation data to see any hints for the potential...
1383
Michelle Chiang
mchiang@...
May 4, 2011 8:52 pm
Usually (prepare & delete path) just remove the hdfs path when it exists. There is no error if the path does not exist before executing the workflow. Could you...
1384
chao wang
brook_wc
May 5, 2011 12:06 am
*I have the following predicate: ${fs:exists("hdfs://foo:9000/user/admin/pig-output")} This works fine. However, the following does not work: ...
1385
Mohammad Islam
mislam77
May 5, 2011 12:21 am
Hi Chao, You can’t use ${ ..${}} in EL functions. Rather use concat function. Here is a complex example from our QE setup: <case...
1386
chao wang
brook_wc
May 5, 2011 1:12 am
Hi Mohammad, Yea, that worked. Thanks! Chao ... Hi Mohammad , Yea, that worked. Thanks! Chao On Wed, May 4, 2011 at 5:21 PM, Mohammad Islam <...
1387
rajatcs20
May 5, 2011 7:21 am
Hello, Does Oozie work with new Map Reduce APIs? I tried but I observe that reducer is not working properly. Same issue was seen by someone else on one of the...
1388
rajatcs20
May 5, 2011 7:29 am
Hello, I have a use case where I want to send a property set in my coordinator.xml to my 'ssh' or 'Java' action in workflow.xml specification. How can this be...
1389
Jens Doerre
doerre@...
May 5, 2011 1:51 pm
... Hi, ... @Rajat I have provided an example for using the new Hadoop API and tested it succesfully with CDHB3 Hadoop. Mohammad has put it into the Wiki (and...
1390
Alejandro Abdelnur
tucu0
May 5, 2011 1:56 pm
Rajat, What you are doing is correct, can you please check in the Oozie webconsole, the corresponding workflow job, what are the values of the job properties? ...
1391
Tim Chan
zzztimbo
May 5, 2011 5:31 pm
Hi Mohammad, I don't seem to have this problem at all when I use Cloudera CDH3u0, which uses hadoop 0.20.2+923.21 and oozie 2.3.0+31.2. I seem to be having...
1392
Alejandro Abdelnur
tucu0
May 5, 2011 5:39 pm
Tim, As Mohammad pointed out in previous emails, the kind of issues you were experiencing was commonly related to either not enough memory in the launcher job...
1393
Mohammad Islam
mislam77
May 5, 2011 7:40 pm
Hi Jens, Thanks for your email and the proposal. So does the instruction work? If not, please let me know. Regards, Mohammad On 5/5/11 6:51 AM, "Jens Doerre"...
1394
Mohammad Islam
mislam77
May 5, 2011 7:46 pm
Hi Rajat, I believe the issue could be related to initial-instance ( initial-instance="${start}"). Because current(-2) will give empty directory for the first...
1395
rajatcs20
May 6, 2011 5:59 am
Hello Mohammad, Jens, Thanks for your quick response. I already tried the instructions posted on the wiki page and it didn't work for me. I tried them with...
1396
rajatcs20
May 6, 2011 7:24 am
Hello Mohammad,Alejandro My job properties just specify the HDFS location of coordinator.xml Mohammad, the directory for current(-2) was present in filesystem...
1397
rajatcs20
May 6, 2011 10:05 am
Alejandro, I checked the job properties from web console and I don't see the property 'wInput' there. Thanks, Rajat...
1398
Jens Doerre
doerre@...
May 6, 2011 12:49 pm
... Hi Mohammad, ... For me, it has worked with the final CDH3 versions of Hadoop and Oozie. ... BTW: I find the HTML messages hard to read. Maybe we should...
1399
Alejandro Abdelnur
tucu0
May 6, 2011 1:27 pm
Jens, AFAIK, Oozie has not been tested/run with Hadoop 0.21 Also, mixing and matching versions of Hadoop/Pig/Streaming/Oozie other than the combinations that...
1400
Alejandro Abdelnur
tucu0
May 6, 2011 1:29 pm
Rajat, Can you please check the oozie.log file for entries of the coordinator action submitting the workflow job? Thanks. Alejandro...
1401
Tim Chan
zzztimbo
May 6, 2011 6:34 pm
Hi Alejandro, It turned out my issue was related to pig. Pig for Cloudera release CDH3u0 allows for hdfs://namenode:8020/path/to/blah notation for STORE and...
1402
Mohammad Islam
mislam77
May 6, 2011 7:40 pm
Rajat, Thanks for the info. I suspect the issue is not whether current(-2) is there or not. It is oozie coordinator that doesn’t check for directory before...
