... For non-secure hadoop, this is not required. Regards, Mohammad On 5/5/11 10:59 PM, "rajatcs20" <rajatcs20@...> wrote: Hello Mohammad, Jens, Thanks...
1404
rajatcs20
May 9, 2011 11:07 am
Hello Mohammad, I tried with data set initial instance < {start-3} but it didn't work. With this change, workflow stays in WAITING state only. It doesn't run...
1405
Mohammad Islam
mislam77
May 9, 2011 5:28 pm
Hi Rajat, I think we are getting in right direction. Do you think, you have the data directory that has _SUCCESS file? Run “oozie job –info <ID>...
1406
Angel
agarciaz
May 10, 2011 12:26 am
Hi, I have problems installing oozie, when start tomcat a have the error: The web application [/oozie] registered the JBDC driver...
1407
chao wang
brook_wc
May 10, 2011 12:34 am
What version of Oozie are you installing? Also, for 2.3+, are you using embedded tomcat? I installed 2.3 and 3.0 using embedded tomcat with no problem at all. ...
1408
Angel
agarciaz
May 10, 2011 1:08 am
I'm using oozie 3.0.0, Hadoop 0.20.0 and pig 0.8.1, openjdk 6 and ubuntu 11.04, tomcat 6.0.29. I try with the file yahoo-oozie-3.0.0-0-g1c5d9b1.tar.gz made...
1409
Angelo Kaichen Huang
angelokh...
May 10, 2011 1:27 am
What is the error message you got? What do you mean by registered or unregistered? Thanks, Angelo On 5/9/11 6:08 PM, "Angel" <agarciaz@...> wrote: I'm...
1410
rajatcs20
May 10, 2011 6:57 am
Thanks a lot Mohammad. Its working now :)...
1411
Angel Garcia
agarciaz
May 10, 2011 4:06 pm
The error is from tomcat, in the log it write "The web application [/oozie] registered the JBDC driver [org.apache.derby.jdbc.AutoloadedDriver] but failed to...
1412
Alejandro Abdelnur
tucu0
May 10, 2011 4:14 pm
Angel, JDBC drivers are registered before usage, that makes the JDBC layer aware of their presence. What you are be seeing could be due to how Tomcat finalizes...
1413
Alejandro Abdelnur
tucu0
May 10, 2011 4:52 pm
Rajat, Keep in mind that if you use <done-flag></done-flag> Oozie will assume the data in the directory is ready for consumption as soon as the directory ...
1414
Angel Garcia
agarciaz
May 10, 2011 6:19 pm
Alejandro, The problem is that tomcat don't start the oozie server, and only show the error in the jdbc driver in the log. I check the war file and is present...
1415
harshal
harshal_022
May 10, 2011 6:57 pm
Hey, We have a lot of source code already written in cascading. We would like to use oozie as a workflow engine using which we want to run various tasks...
1416
Alejandro Abdelnur
tucu0
May 10, 2011 7:04 pm
Harshal, You could have an Oozie Java action calling the cascading Main class. You'll have to have all Cascading JARs in the WF lib/ directory. Hope this...
1417
harshal
harshal_022
May 10, 2011 7:10 pm
Hey, Thanks for the quick reply. If I am not mistaken, I read somewhere that the java action gets executed on any one random machine on the cluster. How will...
1418
Alejandro Abdelnur
tucu0
May 10, 2011 7:32 pm
Harshal, If you put all cascading JARs in the WF lib/ directory Oozie will add them to the distributed cache classpath and it will just work. Thanks. Alejandro...
1419
Tim Chan
zzztimbo
May 10, 2011 8:30 pm
Hi Harshal, Think of that java action as what you would run from your local machine. That random machine in the cluster will talk to the name node to start...
1420
Mohammad Islam
mislam77
May 11, 2011 7:39 pm
Hi Angel, Could you try the following setting into oozie-site.xml? You need to do/verify these too: * Remove/replace existing properties * Put your own...
1421
Angelo Kaichen Huang
angelokh...
May 11, 2011 8:58 pm
Please use this one instead in oozie-site.xml if you are running Oozie 3.0. <property> <name>oozie.service.JPAService.jdbc.driver</name> ...
1422
jaydeep vishwakarma
jaydeep.vishwakarma@...
May 12, 2011 1:03 pm
Hi, I am facing an issue while running hourly (coordinator) jobs. I had a backlog of 12 hours. After I ran the coordinator what I see is that each job is...
1423
Mohammad Islam
mislam77
May 12, 2011 5:43 pm
Hi Jaydeep, What version of oozie? How many coordinator actions are in WAITING state? SQL like “Select count(*) from COORD_ACTIONS where status =...
1424
Shuja Rehman
shujamughal
May 12, 2011 5:46 pm
HI All oozie starts generated log files in Gb's within few hours. I am not running a single job. I checked the log files and it has these line in it. ...
1425
Mohammad Islam
mislam77
May 12, 2011 6:18 pm
Hi Shuja, Do you have any active job in the system? I’m sure you have some jobs and that are filling up the oozie queue. You could kill those jobs and...
1426
Shuja Rehman
shujamughal
May 12, 2011 6:30 pm
no, i do not have any active job in the system. i had killed all the active jobs. Also i had restart the oozie many times and eveny restart the system also....
1427
jaydeep vishwakarma
jaydeep.vishwakarma@...
May 12, 2011 6:32 pm
Hi Mohammad, Here are the requested details. 1. oozie version : 2.3.0-cdh3uO 1. There were no coordinators in waiting state. 2. All Input dependency were...
1428
Mohammad Islam
mislam77
May 12, 2011 8:05 pm
What version of oozie? Can you run this command “oozie admin -queuedump” ? It will give you the internal commands that is filling up the queue. There could...
1429
Mohammad Islam
mislam77
May 12, 2011 8:47 pm
Hi Jaydeep, I’m little confused that there is no coordinator action (not job!) in either ready or waiting state. Looks like they are in RUNNING state. Is it...
1430
Angelo Kaichen Huang
angelokh...
May 13, 2011 1:53 am
... This is expected behavior. Oozie default materializes (creates) the actions for next hour of coordinator job. If you have 5 minutes frequency in...
1431
jaydeep vishwakarma
jaydeep.vishwakarma@...
May 13, 2011 6:38 am
Mohammad, Here is the current status of hourly coordinator job. mysql> SELECT COUNT( * ), STATUS from COORD_ACTIONS where job_id =...
1432
Mohammad Islam
mislam77
May 13, 2011 7:04 am
Jaydeep, Angelo’s assessment is correct. Those properties are per oozie instance (not per job). This is independent of job’s frequency. Specially you could...
