Skip to search.

Breaking News Visit Yahoo! News for the latest.

×Close this window

Oozie-users · Please go to Apache Incubator Oozie

The Yahoo! Groups Product Blog

Check it out!

Group Information

  • Members: 191
  • Category: Open Source
  • Founded: Jun 24, 2010
  • Language: English
? Already a member? Sign in to Yahoo!

Yahoo! Groups Tips

Did you know...
Hear how Yahoo! Groups has changed the lives of others. Take me there.

Messages

Advanced
Messages Help
Messages 1547 - 1576 of 2051   Oldest  |  < Older  |  Newer >  |  Newest
Messages: Simplify | Expand Author Sort by Date ^
1547 Alejandro Abdelnur
tucu0 Send Email
Jun 7, 2011
7:51 pm
Jon, I'm not sure I'm understanding how/where you are looking for the launcher jobs logs. The launcher job is a Hadoop MR job. its name starts with ...
1548 Jonathan Holloway
jonathan.hol... Send Email
Jun 7, 2011
8:04 pm
It's ok, I think there's some confusion, most prob my fault : ) I don't have that MR job in the jobtracker interface. I am only running this on a single...
1549 Alejandro Abdelnur
tucu0 Send Email
Jun 7, 2011
8:13 pm
No worries, just trying to figure it out. Even if you are running everything in one machine you still have a 'cluster&#39;. Does the JT webconsole show any job...
1550 Jonathan Holloway
jonathan.hol... Send Email
Jun 7, 2011
8:21 pm
Sure, Pastebin log is up here: http://pastebin.com/jvdNDve8 Cheers, Jon....
1551 Alejandro Abdelnur
tucu0 Send Email
Jun 7, 2011
8:27 pm
Jon, From the logs it seems Oozie is not starting properly. Could you please try the following: * Stop Oozie * delete all Oozie logs * Start Oozie * See if you...
1552 Jonathan Holloway
jonathan.hol... Send Email
Jun 7, 2011
8:47 pm
Same thing again, I'm running under OSX and using hadoop 0.20.2 by the way. I downloaded a fresh distro from: ...
1553 Alejandro Abdelnur
tucu0 Send Email
Jun 7, 2011
9:02 pm
Jon, Your Oozie server is not starting. You have to do the following (this is a known problem in your setup): Copy, from the conf/oozie-default.xml the...
1554 Jonathan Holloway
jonathan.hol... Send Email
Jun 7, 2011
9:21 pm
Yep sorry, I had been through this issue previously. It would be nice to mention this one in the docs: ...
1555 Alejandro Abdelnur
tucu0 Send Email
Jun 7, 2011
9:31 pm
Jon, What is the job.properties you are submitting to Oozie? The logs show you are using setting the library path in the job.properties to...
1556 Jonathan Holloway
jonathan.hol... Send Email
Jun 7, 2011
9:43 pm
Isn't that the standard namenode port? I followed this: http://www.cloudera.com/blog/2009/08/hadoop-default-ports-quick-reference/ For the libpath, I have all...
1557 Alejandro Abdelnur
tucu0 Send Email
Jun 7, 2011
9:48 pm
Jon, I think you have your ports wrong, Hadoop default settings are: 50070 is the NN webUI port 50030 is the JT webUI port 8020 is the NN RPC port 8021 is the...
1558 Jonathan Holloway
jonathan.hol... Send Email
Jun 7, 2011
10:21 pm
Awesome, ok, so just to confirm what should the settings be: oozie.wf.application.path=hdfs://localhost:8020/workflow ...
1559 Alejandro Abdelnur
tucu0 Send Email
Jun 7, 2011
10:30 pm
If you are using default settings of Hadoop looks alright. Thxs. Alejandro On Tue, Jun 7, 2011 at 3:21 PM, Jonathan Holloway <...
1560 Jonathan Holloway
jonathan.hol... Send Email
Jun 7, 2011
11:34 pm
Ok : ) ports changed : ) submitted with: oozie.wf.application.path=hdfs://localhost:8020/workflow/reportworkflow.xml ...
1561 Alejandro Abdelnur
tucu0 Send Email
Jun 7, 2011
11:48 pm
Jon, What is what you get in Oozie's log now? Thxs. Alejandro On Tue, Jun 7, 2011 at 4:33 PM, Jonathan Holloway <...
1562 Jonathan Holloway
jonathan.hol... Send Email
Jun 7, 2011
11:55 pm
Hey Alejandro, the oozie,log output is here: http://pastebin.com/c5pvrZXg...
1563 Angelo Kaichen Huang
angelokh... Send Email
Jun 8, 2011
12:12 am
Do you see any hadoop job being submitted this time? -Angelo On 6/7/11 4:55 PM, "Jonathan Holloway" <jonathan.holloway@...> wrote: Hey Alejandro, the...
1564 Alejandro Abdelnur
tucu0 Send Email
Jun 8, 2011
12:28 am
Jon, I'm sorry, but from your logs it is not clear if Oozie is able to submit jobs to Hadoop or not. Would you mind posting your WF XML? Thxs. Alejandro On...
1565 Jonathan Holloway
jonathan.hol... Send Email
Jun 8, 2011
12:35 am
Yep, it's here: http://pastebin.com/NAzdPj1H I don't see the job being submitted. Let me know if you need anything else. Many thanks, Jon....
1566 Jonathan Holloway
jonathan.hol... Send Email
Jun 9, 2011
4:21 pm
Hi all, Is it possible to define parallel pig actions using the fork, join block at all using Oozie. The first step in the process is a specified action which...
1567 Alejandro Abdelnur
tucu0 Send Email
Jun 9, 2011
4:24 pm
Jon, It works as you indicate and you can do that for any Oozie action (MR/Pig/Java/fs/sub-wf/..) Thanks. Alejandro On Thu, Jun 9, 2011 at 9:20 AM, Jonathan...
1568 Jonathan Holloway
jonathan.hol... Send Email
Jun 9, 2011
4:54 pm
Hmm, Oozie appears to submit the jobs fine, all are in a RUNNING state, but they never complete, I get the following in each tasktracker log: *3611 [main] INFO...
1569 Alejandro Abdelnur
tucu0 Send Email
Jun 9, 2011
5:02 pm
Jon, Your are maxing out your cluster. Alejandro On Thu, Jun 9, 2011 at 9:53 AM, Jonathan Holloway <...
1570 Jonathan Holloway
jonathan.hol... Send Email
Jun 9, 2011
5:13 pm
Awesome : ) I guessed so, just needed confirmation... It would be good if Oozie errored because of this though or timed out after a while... it's been running...
1571 Alejandro Abdelnur
tucu0 Send Email
Jun 9, 2011
5:21 pm
Jon, Oozie has not way to know the reason an MR/Pig job is taking to long (slow cluster, lots of data, clustered maxed out). You have to ensure your cluster...
1572 Jonathan Holloway
jonathan.hol... Send Email
Jun 9, 2011
5:25 pm
Ok, I understand, it's down to the external system... thanks......
1573 tgraboski@...
tgraboski... Send Email
Jun 10, 2011
5:55 pm
Hi. I'm trying to get a basic workflow working on Oozie. It's a java action with a main method that takes in some arguments, one of which being a filename for...
1574 Alejandro Abdelnur
tucu0 Send Email
Jun 10, 2011
6:00 pm
The Java action runs in any node in the cluster. The files you put in the WF directory are in the HDFS, not in the local filesystem where the Java action runs....
1575 tgraboski@...
tgraboski... Send Email
Jun 10, 2011
6:23 pm
Thanks, that clears up some things. Unfortunately, the null exception error still gets thrown. My workflow for this action looks something like this: <action...
1576 Alejandro Abdelnur
tucu0 Send Email
Jun 10, 2011
6:26 pm
you have a cut&paste error in the second <file>, the symlink name is the same as for the first file. Thxs. Alejandro On Fri, Jun 10, 2011 at 11:23 AM,...
Messages 1547 - 1576 of 2051   Oldest  |  < Older  |  Newer >  |  Newest
Add to My Yahoo!      XML What's This?

Copyright © 2010 Yahoo! Inc. All rights reserved.
Privacy Policy - Terms of Service - Guidelines NEW - Help