How do you go about writing tests for Oozie workflows? It seems that even if I use LocalOozie, I still need a running Hadoop cluster to launch a workflow,...
306
Alejandro Abdelnur
tucu0
Nov 1, 2010 2:47 pm
Hi Andy, You are right, even with LocalOozie you need Hadoop cluster. But a small extension to it would be possible, actually it is already being done for...
307
Roman Shaposhnik
roman.shapos...
Nov 1, 2010 5:14 pm
... Better yet, look at this patch: https://issues.apache.org/jira/browse/MAPREDUCE-987 We're toying with an idea of ressurecting this particular JIRA for the ...
308
Roman Shaposhnik
roman.shapos...
Nov 1, 2010 5:20 pm
... Simple would be the best, I think. ... This is an OK model, but I still don't understand why bullet #1 is required if we rely on release manager getting...
309
Mayank Bansal
bansalm@...
Nov 1, 2010 9:28 pm
I agree with Alejandro. Git logs will be having to much of noise which will not be needed and release log will have just the issue specific issues. And RM will...
310
Roman Shaposhnik
roman.shapos...
Nov 1, 2010 9:40 pm
... I that case I don't think I quite follow the proposal here. Here's my fundamental question: IF we decide to make every developer/commiter update a...
311
Mayank Bansal
bansalm@...
Nov 1, 2010 9:48 pm
We can have multiple commits for a single issue, but we need one entry in release log per issue. So that's the reason I think it would be a good idea to have...
312
Alejandro Abdelnur
tucu0
Nov 2, 2010 2:51 am
GH-0035, Kerberos authentication on Oozie HTTP REST API, is one of the key features planned for 2.3 release as it closes the fence from a security stand point....
313
Alejandro Abdelnur
tucu0
Nov 2, 2010 2:53 am
I have not seen any further follow up on the issues we want for 2.3. Are we in agreement with the list sent previously? If so I'd like to tag the issues in GH...
314
Shrijeet Paliwal
shrijeetp
Nov 2, 2010 4:36 pm
Hi Ooozie Users, If the workflow has three map reduce jobs: mr1, mr2 & mr3. And all three need to be configured with a value for property ...
315
Alejandro Abdelnur
tucu0
Nov 2, 2010 11:20 pm
Shrijeet, Currently there are 2 ways of doing this: * Repeat the values as you suggest * Create a configuration file (XML) in the workflow app directory and in...
316
Mohammad Islam
mislam77
Nov 2, 2010 11:25 pm
Comments inline. ... Yes on 112 and 110. However 141 could be a bug fix . Currently we are working on other 110. If you prefer we can skip this for 2.3. ... ...
317
Shrijeet Paliwal
shrijeetp
Nov 2, 2010 11:35 pm
Hi Alejandro, Thanks for clarifying. For the example I gave job.xml is elegant way. But if three hive actions are lined up, and one wants to specify some MR ...
318
Alejandro Abdelnur
tucu0
Nov 2, 2010 11:40 pm
<job-xlm> works for all actions (except FS) On Wed, Nov 3, 2010 at 7:34 AM, Shrijeet Paliwal <shrijeet.paliwal@......
319
Alejandro Abdelnur
tucu0
Nov 3, 2010 3:51 am
Sure, we can try getting in 141. And again if 110/112 fixes are stable we could try getting them in. So, should we proceed to tag the issues with 2.3? ... ...
320
Alejandro Abdelnur
tucu0
Nov 3, 2010 2:19 pm
I have almost ready a patch for a Hive action based on the implementation of CDH3b3 Hive action. Please read the details below, if all this is acceptable I'll...
321
Roman Shaposhnik
roman.shapos...
Nov 3, 2010 7:29 pm
... That's very good news. Btw, does it mean that there's a chance for it to be in 2.3? ... I think it is quite acceptable. Please go ahead with the pull...
322
Roman Shaposhnik
roman.shapos...
Nov 3, 2010 7:34 pm
... Yahoo is working on making the code available. We're currently blocked on getting legal export certification in place, but that should be resolved sometime...
323
Roman Shaposhnik
roman.shapos...
Nov 3, 2010 7:47 pm
... Guys it looks like we have a consensus on 2.3 scope. Right? If so, I would really want to start tagging issues. The current list looks really short to me: ...
324
Angelo Kaichen Huang
angelokh...
Nov 3, 2010 10:26 pm
I just tagged mine. --Angelo On 11/3/10 12:46 PM, "Roman Shaposhnik" <rvs@...> wrote: ... Guys it looks like we have a consensus on 2.3 scope. Right?...
325
Alejandro Abdelnur
tucu0
Nov 3, 2010 11:15 pm
Thanks Angelo, I've just when through and I've tagged all the issues we've talking about. Alejandro On Thu, Nov 4, 2010 at 6:25 AM, Angelo Kaichen Huang...
326
Roman Shaposhnik
roman.shapos...
Nov 3, 2010 11:25 pm
... Makes sense. Now, what makes me worried is that for 70% of them we don't have an owner tag. Could, owners, please tag their stuff? Thanks, Roman....
327
Alejandro Abdelnur
tucu0
Nov 3, 2010 11:29 pm
I have 8 outstanding pull requests. It is becoming a bit difficult for me to continue working on new issues. I've done a combo pull request with all of them...
328
Alejandro Abdelnur
tucu0
Nov 3, 2010 11:48 pm
This is great, thanks Roman, thanks Yahoo. Alejandro...
329
Alejandro Abdelnur
tucu0
Nov 3, 2010 11:50 pm
did mines, removed myself from 35 as Roman indicated Yahoo is working on it. Thxs. Alejandro...
330
Alejandro Abdelnur
tucu0
Nov 3, 2010 11:54 pm
Yes, we could get it in for 2.3. Regarding the MVN artifacts for Hive, I'm saying we should have them hosted in a MVN repo or we have to bundle them with Oozie...
331
Alejandro Abdelnur
tucu0
Nov 3, 2010 11:56 pm
[insisting on this one] This is a big feature, if we want to get in for the MAR2011 release (3.0) we should start open discussions soon and for this a list of...
332
Mohammad Islam
mislam77
Nov 3, 2010 11:58 pm
Hi Alejandro, Summary: Looks like we agreed on most of the items. Roman might know better about the issue GH0035. We can close this after your comments. My...
333
Mohammad Islam
mislam77
Nov 4, 2010 12:08 am
I think we already have an issue #49 on this. https://github.com/yahoo/oozie/issues/issue/49/ You have commented on something and some replies are there too. ...
334
Mohammad Islam
mislam77
Nov 4, 2010 12:10 am
Review process has been started for the combo pull. Mayank is doing the review and I will do the final review and push. Regards, Mohammad On 11/3/10 4:28 PM,...
