I don't think any types of file copy is supported now. As you mentioned, Java Action is the way. On 9/2/10 5:01 PM, "Dmitriy Ryaboy" <dvryaboy@...>...
79
Dmitriy Ryaboy
dvryaboy
Sep 3, 2010 12:01 am
I would like to copy a file (either local, produced by a java action, or an hdfs file, produced by an mr, pig, or a java action) to some remote server, as the...
78
Mohammad Islam
mislam77
Aug 30, 2010 9:15 pm
Hi Todd, Putting the lib directory is a convenient way for some application. There is an alternate way by which you can get the flavor of classpath. Add your...
77
Todd Deshane
deshantm
Aug 30, 2010 8:27 pm
Hi Mohammad, ... Exactly that. Is there an easy way to pass a classpath instead of having keep a big lib directory of jars within a workflow? Thanks, Todd...
76
Mohammad Islam
mislam77
Aug 30, 2010 8:19 pm
Todd, What is the "lib problem"? Is it you have to provide a lib directory in hdfs with your workflow.xml? Or you want to give the same classpath for multiple...
75
Todd Deshane
deshantm
Aug 30, 2010 2:36 pm
Hi, ... Yes, I do need the upload/download functionality. So you are suggesting that this is not possible to do with oozie? Is it not common enough that users...
74
Todd Deshane
deshantm
Aug 30, 2010 1:34 pm
Re-asking one part, since it probably was lost in the long email. ... Is there an option to set the classpath to save on this lib problem? Thanks, Todd...
73
Alejandro Abdelnur
tucu0
Aug 30, 2010 4:13 am
Todd, Even if FS actions are done as Java action it will not work as the local FS in the operation will be the one of the cluster node where the Java action...
72
Todd Deshane
deshantm
Aug 30, 2010 3:07 am
... In other words, if it can be done with Java action, why not incorporate a "localFS" action type into oozie to support these types of cases? Thanks, Todd --...
71
arvind@...
arvind_prabh...
Aug 28, 2010 5:53 pm
Todd, We are very close to the next beta drop of CDH3 which will include bug-fixes and other enhancements. The Oozie bundled with this release will be based ...
70
Todd Deshane
deshantm
Aug 28, 2010 1:48 am
Hi, On Fri, Aug 27, 2010 at 3:28 PM, arvind@... ... Do you have an estimate on when the next drop/release will be? We'd really like to have something...
69
arvind@...
arvind_prabh...
Aug 27, 2010 7:28 pm
Hi Todd, ... We are aware of this issue and will be providing a fix for this with our next drop/release for Oozie. If you need it urgently, pleas contact our ...
68
Todd Deshane
deshantm
Aug 27, 2010 4:22 pm
Hi, ... What about on the oozie client, the client, for example can run on the name node (or even another system), which has access to HDFS, thus it could call...
67
Alejandro Abdelnur
tucu0
Aug 27, 2010 3:23 pm
Hi Todd, Glad to hear Oozie is working for you. I'll let the Cloudera folks answer on the hive thing. Regarding FS actions, those actions are executed in the...
66
Todd Deshane
deshantm
Aug 27, 2010 1:27 pm
Hi All, We've been working with oozie for the last couple weeks and have been able to get it to do most of what we need it to do. There are some limitations...
65
茅æ—å³°
m9suns@...
Aug 27, 2010 7:20 am
Hi, I'm trying oozie now. The specification 'Workflow Action Nodes' part indicates that == If a computation/processing task exits in error, there ...
64
m9suns@...
Aug 27, 2010 7:08 am
Anyway, thanks Arvind for your reply. I've posted a topic as you suggested. Best regards, Mao Xu-Feng 2010/8/27 arvind@... <arvind@...> ... ...
63
arvind@...
arvind_prabh...
Aug 27, 2010 6:47 am
Sorry you are having this problem. I think it is a bug. Can you please file a report on our community support site - ...
You are right. I just wanted to make sure that there was no other ssh related issue that was possibly resulting in unexpected behavior. Can you also try...
60
茅æ—å³°
m9suns@...
Aug 27, 2010 6:09 am
Arvind, thanks for your reply. I put a line 'exit -1' at the beginning of the checkdone.sh script. 'echo $?' shows 255 in bash. The status is ERROR for the...
59
arvind@...
arvind_prabh...
Aug 27, 2010 5:49 am
This seems to be a bug. Can you try manually running the command to make sure that when you ssh localhost checkdone.sh, the return value $? is actually...
58
茅æ—å³°
m9suns@...
Aug 27, 2010 5:40 am
Hi, I'm using oozie oozie-1.6.2-57 from cloudera distribution for workflow management currently. I'm running into a issue. The workflow xml I write is like...
57
tommy chheng
tommy.chheng
Aug 27, 2010 12:58 am
I pulled the latest copy from github and followed the instructions in the readme: build-setup/setup-maven.sh bin/mkdistro.sh -DskipTests -dmysql -uroot...
56
Alejandro Abdelnur
tucu0
Aug 26, 2010 4:50 am
it should just work (testcases run using embedded Jetty)...
55
tommy chheng
tommy.chheng
Aug 26, 2010 4:23 am
Is Oozie deployable to any servlet container like jetty? We already have jetty running on our servers and it would be nice to just drop it in....
54
Mohammad Islam
mislam77
Aug 7, 2010 8:09 am
No documentations that I know of. However I go to Hadoop code and look for the method implementation. For example, I got yours from this location: ...
53
Rakesh Davanum
rakesh_davanum
Aug 7, 2010 7:43 am
Hi Mohammad, It worked. Thanks a lot! :)) Is there any documentation where I can get the complete list of keys that I can use in Oozie workflow. Thanks &...
52
Mohammad Islam
mislam77
Aug 7, 2010 6:16 am
Hi Rakesh, Did you try with this property "mapred.output.value.groupfn.class"? Thanks, Mohammad On 8/6/10 9:33 AM, "Rakesh Davanum" <rakeshdav@...>...
51
Rakesh Davanum
rakesh_davanum
Aug 6, 2010 4:34 pm
Hi, I have an MR in which I have provided a class to specify the grouping to used by the reducer. I used the API JobConf.setOutputValueGroupingComparator(...)...
