NN is running on a different box and so is JT. I do have access to NN and JT
from localhost, the box that is used for oozie used to be the launchpad for all
of our pig jobs.  When I do hadoop fs I will be able to view the HDFS for which
ever user that I am logged in with.

For my test pig I only have the following in the HDFS
hadoop fs -ls /user/felix/oozie/workflows/test_pig
Found 2 items
-rw-r--r--   2 felix supergroup        367 2011-08-23 14:28
/user/felix/oozie/workflows/test_pig/config-default.xml
drwxr-xr-x   - felix supergroup          0 2011-08-23 14:08
/user/felix/oozie/workflows/test_pig/lib


The lib is empty right now.
In my local directory I have
ls -al
total 28
drwxrwxr-x 2 felix felix 4096 Aug 23 16:14 .
drwxrwxr-x 3 felix felix 4096 Aug 23 13:07 ..
-rw-rw-r-- 1 felix felix  367 Aug 23 14:28 config-default.xml
-rw-rw-r-- 1 felix felix  486 Aug 23 15:56 job.properties
-rw-rw-r-- 1 felix felix  309 Aug 23 15:02 pigexample.pig
-rw-rw-r-- 1 felix felix 1190 Aug 23 15:41 pig-wf.xml
-rwxrwxrwx 1 felix felix  929 Aug 23 16:09 submit.sh

  cat job.properties
#The following attributes must be set
fs.default.name=hdfs://namenode.xxx.xxx:50001
mapred.job.tracker=jobtracker.xxx.xxx:50002
oozie.use.system.libpath=true
oozie.libpath=hdfs://namenode.xxx.xxx:50001/user/oozie/share/pig/lib/
queueName=default
#additional
oozie.wf.application.path=hdfs://namenode.xxx.xxx:50001/user/felix/oozie/workflo\
ws/test_pig
inputDir=/user/felix/test_input.data
outputDir=/user/felix/oozie_output/pig_test

I submitted the job to Oozie using
oozie pig -oozie http://localhost:11000/oozie -file pigexample.pig -config
job.properties

hadoop we are using is 0.20.2 and oozie we are using is 2.3.0. Both are from
cloudera's RPM.

I hope this is clear enough.

--- In Oozie-users@yahoogroups.com, Mohammad Islam <mislam77@...> wrote:
>
> Do you have the NN running on the same box?
>
> If not,  do you have the access from the localhost to NN? Did you able to run
"haddop fs ..." command from the localhost?
>
>
> Which version of hadoop and what version of oozie you are using?
> What is the wf apppath in job.properties?
>
> Regards,
> Mohammad
>
>
>
>
> ________________________________
> From: Felix <felixgao@...>
> To: Oozie-users@yahoogroups.com
> Sent: Tuesday, August 23, 2011 3:28 PM
> Subject: [Oozie-users] Oozie error when submitting jobs
>
>
>  
> Hi all I have a simple pig job for testing that I would like to use oozie to
manage.  When I do the following I got
>
> oozie pig -oozie http://localhost:11000/oozie -file pigexample.pig -config
job.properties
> Error: E0902 : E0902: Exception occured: [java.io.IOException: Call to
namenode/69.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException]
>
> 2011-08-23 17:18:11,861  WARN V1JobsServlet:528 - USER[felix] GROUP[users]
TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST
http://localhost:11000/oozie/v1/jobs?jobtype=pig] error[E0902], E0902: Exception
occured: [java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001 failed on
local exception: java.io.EOFException]
> org.apache.oozie.servlet.XServletException: E0902: Exception occured:
[java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001 failed on local
exception: java.io.EOFException]
> at
org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.\
java:179)
> at org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
> at org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
> at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt\
erChain.java:290)
> at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.\
java:206)
> at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
> at
com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.j\
ava:371)
> at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
> at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt\
erChain.java:235)
> at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.\
java:206)
> at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:2\
33)
> at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:1\
91)
> at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
> at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
> at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109\
)
> at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
> at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
> at
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Pr\
otocol.java:588)
> at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
> at java.lang.Thread.run(Thread.java:619)
> Caused by: org.apache.oozie.service.AuthorizationException: E0902: Exception
occured: [java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001 failed on
local exception: java.io.EOFException]
> at
org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationServi\
ce.java:318)
> at
org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.\
java:171)
> ... 21 more
> Caused by: org.apache.oozie.service.HadoopAccessorException: E0902: Exception
occured: [java.io.IOException: Call to
namenode.chi.bluekai.com/69.170.130.176:50001 failed on local exception:
java.io.EOFException]
> at
org.apache.oozie.service.HadoopAccessorService.createFileSystem(HadoopAccessorSe\
rvice.java:144)
> at
org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationServi\
ce.java:283)
> ... 22 more
> Caused by: java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001 failed
on local exception: java.io.EOFException
> at org.apache.hadoop.ipc.Client.wrapException(Client.java:1142)
> at org.apache.hadoop.ipc.Client.call(Client.java:1110)
> at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
> at $Proxy22.getProtocolVersion(Unknown Source)
> at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
> at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
> at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:111)
> at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
> at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:180)
> at
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.ja\
va:89)
> at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1514)
> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
> at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1548)
> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1530)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:228)
> at
org.apache.oozie.service.HadoopAccessorService.createFileSystem(HadoopAccessorSe\
rvice.java:141)
> ... 23 more
> Caused by: java.io.EOFException
> at java.io.DataInputStream.readInt(DataInputStream.java:375)
> at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:815)
> at org.apache.hadoop.ipc.Client$Connection.run(Client.java:724)
>
> in my oozie-site.xml I have the following services
> <property>
> <name>oozie.services</name>
> <value>
> org.apache.oozie.service.SchedulerService,
> org.apache.oozie.service.InstrumentationService,
> org.apache.oozie.service.CallableQueueService,
> org.apache.oozie.service.UUIDService,
> org.apache.oozie.service.ELService,
> org.apache.oozie.service.AuthorizationService,
> org.apache.oozie.service.MemoryLocksService,
> org.apache.oozie.service.DagXLogInfoService,
> org.apache.oozie.service.SchemaService,
> org.apache.oozie.service.LiteWorkflowAppService,
> org.apache.oozie.service.StoreService,
> org.apache.oozie.service.CoordinatorStoreService,
> org.apache.oozie.service.SLAStoreService,
> org.apache.oozie.service.DBLiteWorkflowStoreService,
> org.apache.oozie.service.CallbackService,
> org.apache.oozie.service.ActionService,
> org.apache.oozie.service.ActionCheckerService,
> org.apache.oozie.service.RecoveryService,
> org.apache.oozie.service.PurgeService,
> org.apache.oozie.service.CoordinatorEngineService,
> org.apache.oozie.service.DagEngineService,
> org.apache.oozie.service.CoordJobMatLookupTriggerService,
> org.apache.oozie.service.HadoopAccessorService
> </value>
> <description>
> All services to be created and managed by Oozie Services singleton.
> Class names must be separated by commas.
> </description>
> </property>
>
> if I take out org.apache.oozie.service.HadoopAccessorService, then I will get
> 2011-08-23 16:09:45,587 ERROR V1JobsServlet:522 - USER[felix] GROUP[users]
TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST
http://localhost:11000/oozie/v1/jobs?jobtype=pig] error, null
> java.lang.NullPointerException
> at
org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationServi\
ce.java:283)
> at
org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.\
java:171)
> at org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
> at org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
> at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt\
erChain.java:290)
> at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.\
java:206)
> at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
> at
com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.j\
ava:371)
> at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
> at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt\
erChain.java:235)
> at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.\
java:206)
> at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:2\
33)
> at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:1\
91)
> at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
> at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
> at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109\
)
> at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
> at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
> at
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Pr\
otocol.java:588)
> at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
> at java.lang.Thread.run(Thread.java:619)
>
> your help is appreciated.
>
> Felix
>

Alejandro,

I am modifying the oozie.services to
<property>
         <name>oozie.services</name>
         <value>
             org.apache.oozie.service.SchedulerService,
             org.apache.oozie.service.InstrumentationService,
             org.apache.oozie.service.CallableQueueService,
             org.apache.oozie.service.UUIDService,
             org.apache.oozie.service.ELService,
             org.apache.oozie.service.AuthorizationService,
             org.apache.oozie.service.MemoryLocksService,
             org.apache.oozie.service.DagXLogInfoService,
             org.apache.oozie.service.SchemaService,
             org.apache.oozie.service.LiteWorkflowAppService,
             org.apache.oozie.service.StoreService,
             org.apache.oozie.service.CoordinatorStoreService,
             org.apache.oozie.service.SLAStoreService,
             org.apache.oozie.service.DBLiteWorkflowStoreService,
             org.apache.oozie.service.CallbackService,
             org.apache.oozie.service.ActionService,
             org.apache.oozie.service.ActionCheckerService,
             org.apache.oozie.service.RecoveryService,
             org.apache.oozie.service.PurgeService,
             org.apache.oozie.service.CoordinatorEngineService,
             org.apache.oozie.service.DagEngineService,
             org.apache.oozie.service.CoordJobMatLookupTriggerService,
             org.apache.oozie.service.HadoopAccessorService
         </value>
         <description>
             All services to be created and managed by Oozie Services singleton.
             Class names must be separated by commas.
         </description>
     </property>

because I am seeing E0902: Exception occured:  so
https://github.com/yahoo/oozie/wiki/FAQ told me to add those to the xml file.

--- In Oozie-users@yahoogroups.com, Alejandro Abdelnur <tucu@...> wrote:
>
> Felix,
>
> What are doing that you need to modify the service classes?
>
> Thanks.
>
> Alejandro
>
> On Wed, Aug 24, 2011 at 9:53 AM, Felix <felixgao@...> wrote:
>
> > NN is running on a different box and so is JT. I do have access to NN and
> > JT from localhost, the box that is used for oozie used to be the launchpad
> > for all of our pig jobs.  When I do hadoop fs I will be able to view the
> > HDFS for which ever user that I am logged in with.
> >
> > For my test pig I only have the following in the HDFS
> > hadoop fs -ls /user/felix/oozie/workflows/test_pig
> > Found 2 items
> > -rw-r--r--   2 felix supergroup        367 2011-08-23 14:28
> > /user/felix/oozie/workflows/test_pig/config-default.xml
> > drwxr-xr-x   - felix supergroup          0 2011-08-23 14:08
> > /user/felix/oozie/workflows/test_pig/lib
> >
> >
> > The lib is empty right now.
> > In my local directory I have
> > ls -al
> > total 28
> > drwxrwxr-x 2 felix felix 4096 Aug 23 16:14 .
> > drwxrwxr-x 3 felix felix 4096 Aug 23 13:07 ..
> > -rw-rw-r-- 1 felix felix  367 Aug 23 14:28 config-default.xml
> > -rw-rw-r-- 1 felix felix  486 Aug 23 15:56 job.properties
> > -rw-rw-r-- 1 felix felix  309 Aug 23 15:02 pigexample.pig
> > -rw-rw-r-- 1 felix felix 1190 Aug 23 15:41 pig-wf.xml
> > -rwxrwxrwx 1 felix felix  929 Aug 23 16:09 submit.sh
> >
> >  cat job.properties
> > #The following attributes must be set
> > fs.default.name=hdfs://namenode.xxx.xxx:50001
> > mapred.job.tracker=jobtracker.xxx.xxx:50002
> > oozie.use.system.libpath=true
> > oozie.libpath=hdfs://namenode.xxx.xxx:50001/user/oozie/share/pig/lib/
> > queueName=default
> > #additional
> >
> >
oozie.wf.application.path=hdfs://namenode.xxx.xxx:50001/user/felix/oozie/workflo\
ws/test_pig
> > inputDir=/user/felix/test_input.data
> > outputDir=/user/felix/oozie_output/pig_test
> >
> > I submitted the job to Oozie using
> > oozie pig -oozie http://localhost:11000/oozie -file pigexample.pig -config
> > job.properties
> >
> > hadoop we are using is 0.20.2 and oozie we are using is 2.3.0. Both are
> > from cloudera's RPM.
> >
> > I hope this is clear enough.
> >
> > --- In Oozie-users@yahoogroups.com, Mohammad Islam <mislam77@> wrote:
> > >
> > > Do you have the NN running on the same box?
> > >
> > > If not,  do you have the access from the localhost to NN? Did you able
> > to run "haddop fs ..." command from the localhost?
> > >
> > >
> > > Which version of hadoop and what version of oozie you are using?
> > > What is the wf apppath in job.properties?
> > >
> > > Regards,
> > > Mohammad
> > >
> > >
> > >
> > >
> > > ________________________________
> > > From: Felix <felixgao@>
> > > To: Oozie-users@yahoogroups.com
> > > Sent: Tuesday, August 23, 2011 3:28 PM
> > > Subject: [Oozie-users] Oozie error when submitting jobs
> > >
> > >
> > > Â
> > > Hi all I have a simple pig job for testing that I would like to use oozie
> > to manage.  When I do the following I got
> > >
> > > oozie pig -oozie http://localhost:11000/oozie -file pigexample.pig
> > -config job.properties
> > > Error: E0902 : E0902: Exception occured: [java.io.IOException: Call to
> > namenode/69.xxx.xxx.xxx:50001 failed on local exception:
> > java.io.EOFException]
> > >
> > > 2011-08-23 17:18:11,861  WARN V1JobsServlet:528 - USER[felix]
> > GROUP[users] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST
> > http://localhost:11000/oozie/v1/jobs?jobtype=pig] error[E0902], E0902:
> > Exception occured: [java.io.IOException: Call to
> > namenode/69.xxx.xxx.xxx:50001 failed on local exception:
> > java.io.EOFException]
> > > org.apache.oozie.servlet.XServletException: E0902: Exception occured:
> > [java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001 failed on local
> > exception: java.io.EOFException]
> > > at
> >
org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.\
java:179)
> > > at
> > org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
> > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
> > > at
> > org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
> > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
> > > at
> >
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt\
erChain.java:290)
> > > at
> >
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.\
java:206)
> > > at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
> > > at
> >
com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.j\
ava:371)
> > > at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
> > > at
> >
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt\
erChain.java:235)
> > > at
> >
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.\
java:206)
> > > at
> >
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:2\
33)
> > > at
> >
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:1\
91)
> > > at
> >
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
> > > at
> >
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
> > > at
> >
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109\
)
> > > at
> > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
> > > at
> > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
> > > at
> >
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Pr\
otocol.java:588)
> > > at
> > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
> > > at java.lang.Thread.run(Thread.java:619)
> > > Caused by: org.apache.oozie.service.AuthorizationException: E0902:
> > Exception occured: [java.io.IOException: Call to
> > namenode/69.xxx.xxx.xxx:50001 failed on local exception:
> > java.io.EOFException]
> > > at
> >
org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationServi\
ce.java:318)
> > > at
> >
org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.\
java:171)
> > > ... 21 more
> > > Caused by: org.apache.oozie.service.HadoopAccessorException: E0902:
> > Exception occured: [java.io.IOException: Call to
> > namenode.chi.bluekai.com/69.170.130.176:50001 failed on local exception:
> > java.io.EOFException]
> > > at
> >
org.apache.oozie.service.HadoopAccessorService.createFileSystem(HadoopAccessorSe\
rvice.java:144)
> > > at
> >
org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationServi\
ce.java:283)
> > > ... 22 more
> > > Caused by: java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001
> > failed on local exception: java.io.EOFException
> > > at org.apache.hadoop.ipc.Client.wrapException(Client.java:1142)
> > > at org.apache.hadoop.ipc.Client.call(Client.java:1110)
> > > at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
> > > at $Proxy22.getProtocolVersion(Unknown Source)
> > > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
> > > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
> > > at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:111)
> > > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
> > > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:180)
> > > at
> >
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.ja\
va:89)
> > > at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1514)
> > > at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
> > > at
> > org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1548)
> > > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1530)
> > > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:228)
> > > at
> >
org.apache.oozie.service.HadoopAccessorService.createFileSystem(HadoopAccessorSe\
rvice.java:141)
> > > ... 23 more
> > > Caused by: java.io.EOFException
> > > at java.io.DataInputStream.readInt(DataInputStream.java:375)
> > > at
> > org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:815)
> > > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:724)
> > >
> > > in my oozie-site.xml I have the following services
> > > <property>
> > > <name>oozie.services</name>
> > > <value>
> > > org.apache.oozie.service.SchedulerService,
> > > org.apache.oozie.service.InstrumentationService,
> > > org.apache.oozie.service.CallableQueueService,
> > > org.apache.oozie.service.UUIDService,
> > > org.apache.oozie.service.ELService,
> > > org.apache.oozie.service.AuthorizationService,
> > > org.apache.oozie.service.MemoryLocksService,
> > > org.apache.oozie.service.DagXLogInfoService,
> > > org.apache.oozie.service.SchemaService,
> > > org.apache.oozie.service.LiteWorkflowAppService,
> > > org.apache.oozie.service.StoreService,
> > > org.apache.oozie.service.CoordinatorStoreService,
> > > org.apache.oozie.service.SLAStoreService,
> > > org.apache.oozie.service.DBLiteWorkflowStoreService,
> > > org.apache.oozie.service.CallbackService,
> > > org.apache.oozie.service.ActionService,
> > > org.apache.oozie.service.ActionCheckerService,
> > > org.apache.oozie.service.RecoveryService,
> > > org.apache.oozie.service.PurgeService,
> > > org.apache.oozie.service.CoordinatorEngineService,
> > > org.apache.oozie.service.DagEngineService,
> > > org.apache.oozie.service.CoordJobMatLookupTriggerService,
> > > org.apache.oozie.service.HadoopAccessorService
> > > </value>
> > > <description>
> > > All services to be created and managed by Oozie Services singleton.
> > > Class names must be separated by commas.
> > > </description>
> > > </property>
> > >
> > > if I take out org.apache.oozie.service.HadoopAccessorService, then I will
> > get
> > > 2011-08-23 16:09:45,587 ERROR V1JobsServlet:522 - USER[felix]
> > GROUP[users] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST
> > http://localhost:11000/oozie/v1/jobs?jobtype=pig] error, null
> > > java.lang.NullPointerException
> > > at
> >
org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationServi\
ce.java:283)
> > > at
> >
org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.\
java:171)
> > > at
> > org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
> > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
> > > at
> > org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
> > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
> > > at
> >
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt\
erChain.java:290)
> > > at
> >
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.\
java:206)
> > > at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
> > > at
> >
com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.j\
ava:371)
> > > at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
> > > at
> >
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt\
erChain.java:235)
> > > at
> >
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.\
java:206)
> > > at
> >
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:2\
33)
> > > at
> >
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:1\
91)
> > > at
> >
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
> > > at
> >
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
> > > at
> >
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109\
)
> > > at
> > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
> > > at
> > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
> > > at
> >
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Pr\
otocol.java:588)
> > > at
> > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
> > > at java.lang.Thread.run(Thread.java:619)
> > >
> > > your help is appreciated.
> > >
> > > Felix
> > >
> >
> >
> >
> >
> > ------------------------------------
> >
> > Yahoo! Groups Links
> >
> >
> >
> >
>

When reverted to the stock oozie-site.xml except I have changed the database to
use mysql instead of derby. I still have the exception below.

2011-08-24 13:58:40,107  WARN V1JobsServlet:528 - USER[felix] GROUP[users]
TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST
http://localhost:11000/oozie/v1/jobs?jobtype=pig] error[E0902], E0902: Exception
occured: [java.io.IOException: Call to namenode.xxx/69.xxx.xxx.xxx:50001 failed
on local exception: java.io.EOFException]
org.apache.oozie.servlet.XServletException: E0902: Exception occured:
[java.io.IOException: Call to namenode.xxx/69.xxx.xxx.xxx:50001 failed on local
exception: java.io.EOFException]
	 at
org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.\
java:179)
	 at org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
	 at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
	 at org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
	 at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
	 at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt\
erChain.java:290)
	 at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.\
java:206)
	 at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
	 at
com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.j\
ava:371)
	 at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
	 at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt\
erChain.java:235)
	 at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.\
java:206)
	 at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:2\
33)
	 at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:1\
91)
	 at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
	 at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
	 at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109\
)
	 at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
	 at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
	 at
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Pr\
otocol.java:588)
	 at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
	 at java.lang.Thread.run(Thread.java:619)
Caused by: org.apache.oozie.service.AuthorizationException: E0902: Exception
occured: [java.io.IOException: Call to namenode.xxx/69.xxx.xxx.xxx:50001 failed
on local exception: java.io.EOFException]
	 at
org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationServi\
ce.java:318)
	 at
org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.\
java:171)
	 ... 21 more
Caused by: org.apache.oozie.service.HadoopAccessorException: E0902: Exception
occured: [java.io.IOException: Call to
namenode.chi.bluekai.com/69.170.130.176:50001 failed on local exception:
java.io.EOFException]
	 at
org.apache.oozie.service.KerberosHadoopAccessorService.createFileSystem(Kerberos\
HadoopAccessorService.java:211)
	 at
org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationServi\
ce.java:283)
	 ... 22 more
Caused by: java.io.IOException: Call to namenode.xxx/69.xxx.xxx.xxx:50001 failed
on local exception: java.io.EOFException
	 at org.apache.hadoop.ipc.Client.wrapException(Client.java:1142)
	 at org.apache.hadoop.ipc.Client.call(Client.java:1110)
	 at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
	 at $Proxy22.getProtocolVersion(Unknown Source)
	 at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
	 at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
	 at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:111)
	 at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
	 at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:180)
	 at
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.ja\
va:89)
	 at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1514)
	 at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
	 at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1548)
	 at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1530)
	 at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:228)
	 at
org.apache.oozie.service.KerberosHadoopAccessorService$3.run(KerberosHadoopAcces\
sorService.java:203)
	 at
org.apache.oozie.service.KerberosHadoopAccessorService$3.run(KerberosHadoopAcces\
sorService.java:194)
	 at java.security.AccessController.doPrivileged(Native Method)
	 at javax.security.auth.Subject.doAs(Subject.java:396)
	 at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1\
127)
	 at
org.apache.oozie.service.KerberosHadoopAccessorService.createFileSystem(Kerberos\
HadoopAccessorService.java:194)
	 ... 23 more
Caused by: java.io.EOFException
	 at java.io.DataInputStream.readInt(DataInputStream.java:375)
	 at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:815)
	 at org.apache.hadoop.ipc.Client$Connection.run(Client.java:724)



--- In Oozie-users@yahoogroups.com, Alejandro Abdelnur <tucu@...> wrote:
>
> Felix,
>
> [moving from oozie-users@  (in BCC) to cdh-user@ alias as this seems a CDH
> setup  problem]
>
> If you are using RPM CDH Hadoop and Oozie, you don't have to modify the
> HadoopAccessorService.
>
> Everything should work out of the box with zero configuration.
>
> Would you try to revert to a clean install and see if you have issues there?
>
> Thxs.
>
> Alejandro
>
>
>
> On Wed, Aug 24, 2011 at 11:15 AM, Felix <felixgao@...> wrote:
>
> > Alejandro,
> >
> > I am modifying the oozie.services to
> > <property>
> >        <name>oozie.services</name>
> >        <value>
> >            org.apache.oozie.service.SchedulerService,
> >            org.apache.oozie.service.InstrumentationService,
> >            org.apache.oozie.service.CallableQueueService,
> >            org.apache.oozie.service.UUIDService,
> >            org.apache.oozie.service.ELService,
> >            org.apache.oozie.service.AuthorizationService,
> >            org.apache.oozie.service.MemoryLocksService,
> >            org.apache.oozie.service.DagXLogInfoService,
> >            org.apache.oozie.service.SchemaService,
> >            org.apache.oozie.service.LiteWorkflowAppService,
> >            org.apache.oozie.service.StoreService,
> >            org.apache.oozie.service.CoordinatorStoreService,
> >            org.apache.oozie.service.SLAStoreService,
> >            org.apache.oozie.service.DBLiteWorkflowStoreService,
> >            org.apache.oozie.service.CallbackService,
> >            org.apache.oozie.service.ActionService,
> >            org.apache.oozie.service.ActionCheckerService,
> >            org.apache.oozie.service.RecoveryService,
> >            org.apache.oozie.service.PurgeService,
> >            org.apache.oozie.service.CoordinatorEngineService,
> >            org.apache.oozie.service.DagEngineService,
> >            org.apache.oozie.service.CoordJobMatLookupTriggerService,
> >            org.apache.oozie.service.HadoopAccessorService
> >        </value>
> >        <description>
> >            All services to be created and managed by Oozie Services
> > singleton.
> >            Class names must be separated by commas.
> >        </description>
> >    </property>
> >
> > because I am seeing E0902: Exception occured:  so
> > https://github.com/yahoo/oozie/wiki/FAQ told me to add those to the xml
> > file.
> >
> > --- In Oozie-users@yahoogroups.com, Alejandro Abdelnur <tucu@> wrote:
> > >
> > > Felix,
> > >
> > > What are doing that you need to modify the service classes?
> > >
> > > Thanks.
> > >
> > > Alejandro
> > >
> > > On Wed, Aug 24, 2011 at 9:53 AM, Felix <felixgao@> wrote:
> > >
> > > > NN is running on a different box and so is JT. I do have access to NN
> > and
> > > > JT from localhost, the box that is used for oozie used to be the
> > launchpad
> > > > for all of our pig jobs.  When I do hadoop fs I will be able to view
> > the
> > > > HDFS for which ever user that I am logged in with.
> > > >
> > > > For my test pig I only have the following in the HDFS
> > > > hadoop fs -ls /user/felix/oozie/workflows/test_pig
> > > > Found 2 items
> > > > -rw-r--r--   2 felix supergroup        367 2011-08-23 14:28
> > > > /user/felix/oozie/workflows/test_pig/config-default.xml
> > > > drwxr-xr-x   - felix supergroup          0 2011-08-23 14:08
> > > > /user/felix/oozie/workflows/test_pig/lib
> > > >
> > > >
> > > > The lib is empty right now.
> > > > In my local directory I have
> > > > ls -al
> > > > total 28
> > > > drwxrwxr-x 2 felix felix 4096 Aug 23 16:14 .
> > > > drwxrwxr-x 3 felix felix 4096 Aug 23 13:07 ..
> > > > -rw-rw-r-- 1 felix felix  367 Aug 23 14:28 config-default.xml
> > > > -rw-rw-r-- 1 felix felix  486 Aug 23 15:56 job.properties
> > > > -rw-rw-r-- 1 felix felix  309 Aug 23 15:02 pigexample.pig
> > > > -rw-rw-r-- 1 felix felix 1190 Aug 23 15:41 pig-wf.xml
> > > > -rwxrwxrwx 1 felix felix  929 Aug 23 16:09 submit.sh
> > > >
> > > >  cat job.properties
> > > > #The following attributes must be set
> > > > fs.default.name=hdfs://namenode.xxx.xxx:50001
> > > > mapred.job.tracker=jobtracker.xxx.xxx:50002
> > > > oozie.use.system.libpath=true
> > > > oozie.libpath=hdfs://namenode.xxx.xxx:50001/user/oozie/share/pig/lib/
> > > > queueName=default
> > > > #additional
> > > >
> > > >
> >
oozie.wf.application.path=hdfs://namenode.xxx.xxx:50001/user/felix/oozie/workflo\
ws/test_pig
> > > > inputDir=/user/felix/test_input.data
> > > > outputDir=/user/felix/oozie_output/pig_test
> > > >
> > > > I submitted the job to Oozie using
> > > > oozie pig -oozie http://localhost:11000/oozie -file pigexample.pig
> > -config
> > > > job.properties
> > > >
> > > > hadoop we are using is 0.20.2 and oozie we are using is 2.3.0. Both are
> > > > from cloudera's RPM.
> > > >
> > > > I hope this is clear enough.
> > > >
> > > > --- In Oozie-users@yahoogroups.com, Mohammad Islam <mislam77@> wrote:
> > > > >
> > > > > Do you have the NN running on the same box?
> > > > >
> > > > > If not,  do you have the access from the localhost to NN? Did you
> > able
> > > > to run "haddop fs ..." command from the localhost?
> > > > >
> > > > >
> > > > > Which version of hadoop and what version of oozie you are using?
> > > > > What is the wf apppath in job.properties?
> > > > >
> > > > > Regards,
> > > > > Mohammad
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > ________________________________
> > > > > From: Felix <felixgao@>
> > > > > To: Oozie-users@yahoogroups.com
> > > > > Sent: Tuesday, August 23, 2011 3:28 PM
> > > > > Subject: [Oozie-users] Oozie error when submitting jobs
> > > > >
> > > > >
> > > > > Â
> > > > > Hi all I have a simple pig job for testing that I would like to use
> > oozie
> > > > to manage.  When I do the following I got
> > > > >
> > > > > oozie pig -oozie http://localhost:11000/oozie -file pigexample.pig
> > > > -config job.properties
> > > > > Error: E0902 : E0902: Exception occured: [java.io.IOException: Call
> > to
> > > > namenode/69.xxx.xxx.xxx:50001 failed on local exception:
> > > > java.io.EOFException]
> > > > >
> > > > > 2011-08-23 17:18:11,861  WARN V1JobsServlet:528 - USER[felix]
> > > > GROUP[users] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST
> > > > http://localhost:11000/oozie/v1/jobs?jobtype=pig] error[E0902], E0902:
> > > > Exception occured: [java.io.IOException: Call to
> > > > namenode/69.xxx.xxx.xxx:50001 failed on local exception:
> > > > java.io.EOFException]
> > > > > org.apache.oozie.servlet.XServletException: E0902: Exception occured:
> > > > [java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001 failed on
> > local
> > > > exception: java.io.EOFException]
> > > > > at
> > > >
> >
org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.\
java:179)
> > > > > at
> > > >
> > org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
> > > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
> > > > > at
> > > >
> > org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
> > > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
> > > > > at
> > > >
> >
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt\
erChain.java:290)
> > > > > at
> > > >
> >
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.\
java:206)
> > > > > at
> > org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
> > > > > at
> > > >
> >
com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.j\
ava:371)
> > > > > at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
> > > > > at
> > > >
> >
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt\
erChain.java:235)
> > > > > at
> > > >
> >
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.\
java:206)
> > > > > at
> > > >
> >
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:2\
33)
> > > > > at
> > > >
> >
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:1\
91)
> > > > > at
> > > >
> >
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
> > > > > at
> > > >
> >
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
> > > > > at
> > > >
> >
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109\
)
> > > > > at
> > > >
> > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
> > > > > at
> > > >
> > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
> > > > > at
> > > >
> >
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Pr\
otocol.java:588)
> > > > > at
> > > > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
> > > > > at java.lang.Thread.run(Thread.java:619)
> > > > > Caused by: org.apache.oozie.service.AuthorizationException: E0902:
> > > > Exception occured: [java.io.IOException: Call to
> > > > namenode/69.xxx.xxx.xxx:50001 failed on local exception:
> > > > java.io.EOFException]
> > > > > at
> > > >
> >
org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationServi\
ce.java:318)
> > > > > at
> > > >
> >
org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.\
java:171)
> > > > > ... 21 more
> > > > > Caused by: org.apache.oozie.service.HadoopAccessorException: E0902:
> > > > Exception occured: [java.io.IOException: Call to
> > > > namenode.chi.bluekai.com/69.170.130.176:50001 failed on local
> > exception:
> > > > java.io.EOFException]
> > > > > at
> > > >
> >
org.apache.oozie.service.HadoopAccessorService.createFileSystem(HadoopAccessorSe\
rvice.java:144)
> > > > > at
> > > >
> >
org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationServi\
ce.java:283)
> > > > > ... 22 more
> > > > > Caused by: java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001
> > > > failed on local exception: java.io.EOFException
> > > > > at org.apache.hadoop.ipc.Client.wrapException(Client.java:1142)
> > > > > at org.apache.hadoop.ipc.Client.call(Client.java:1110)
> > > > > at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
> > > > > at $Proxy22.getProtocolVersion(Unknown Source)
> > > > > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
> > > > > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
> > > > > at
> > org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:111)
> > > > > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
> > > > > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:180)
> > > > > at
> > > >
> >
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.ja\
va:89)
> > > > > at
> > org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1514)
> > > > > at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
> > > > > at
> > > > org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1548)
> > > > > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1530)
> > > > > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:228)
> > > > > at
> > > >
> >
org.apache.oozie.service.HadoopAccessorService.createFileSystem(HadoopAccessorSe\
rvice.java:141)
> > > > > ... 23 more
> > > > > Caused by: java.io.EOFException
> > > > > at java.io.DataInputStream.readInt(DataInputStream.java:375)
> > > > > at
> > > >
> > org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:815)
> > > > > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:724)
> > > > >
> > > > > in my oozie-site.xml I have the following services
> > > > > <property>
> > > > > <name>oozie.services</name>
> > > > > <value>
> > > > > org.apache.oozie.service.SchedulerService,
> > > > > org.apache.oozie.service.InstrumentationService,
> > > > > org.apache.oozie.service.CallableQueueService,
> > > > > org.apache.oozie.service.UUIDService,
> > > > > org.apache.oozie.service.ELService,
> > > > > org.apache.oozie.service.AuthorizationService,
> > > > > org.apache.oozie.service.MemoryLocksService,
> > > > > org.apache.oozie.service.DagXLogInfoService,
> > > > > org.apache.oozie.service.SchemaService,
> > > > > org.apache.oozie.service.LiteWorkflowAppService,
> > > > > org.apache.oozie.service.StoreService,
> > > > > org.apache.oozie.service.CoordinatorStoreService,
> > > > > org.apache.oozie.service.SLAStoreService,
> > > > > org.apache.oozie.service.DBLiteWorkflowStoreService,
> > > > > org.apache.oozie.service.CallbackService,
> > > > > org.apache.oozie.service.ActionService,
> > > > > org.apache.oozie.service.ActionCheckerService,
> > > > > org.apache.oozie.service.RecoveryService,
> > > > > org.apache.oozie.service.PurgeService,
> > > > > org.apache.oozie.service.CoordinatorEngineService,
> > > > > org.apache.oozie.service.DagEngineService,
> > > > > org.apache.oozie.service.CoordJobMatLookupTriggerService,
> > > > > org.apache.oozie.service.HadoopAccessorService
> > > > > </value>
> > > > > <description>
> > > > > All services to be created and managed by Oozie Services singleton.
> > > > > Class names must be separated by commas.
> > > > > </description>
> > > > > </property>
> > > > >
> > > > > if I take out org.apache.oozie.service.HadoopAccessorService, then I
> > will
> > > > get
> > > > > 2011-08-23 16:09:45,587 ERROR V1JobsServlet:522 - USER[felix]
> > > > GROUP[users] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST
> > > > http://localhost:11000/oozie/v1/jobs?jobtype=pig] error, null
> > > > > java.lang.NullPointerException
> > > > > at
> > > >
> >
org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationServi\
ce.java:283)
> > > > > at
> > > >
> >
org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.\
java:171)
> > > > > at
> > > >
> > org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
> > > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
> > > > > at
> > > >
> > org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
> > > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
> > > > > at
> > > >
> >
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt\
erChain.java:290)
> > > > > at
> > > >
> >
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.\
java:206)
> > > > > at
> > org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
> > > > > at
> > > >
> >
com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.j\
ava:371)
> > > > > at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
> > > > > at
> > > >
> >
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt\
erChain.java:235)
> > > > > at
> > > >
> >
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.\
java:206)
> > > > > at
> > > >
> >
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:2\
33)
> > > > > at
> > > >
> >
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:1\
91)
> > > > > at
> > > >
> >
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
> > > > > at
> > > >
> >
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
> > > > > at
> > > >
> >
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109\
)
> > > > > at
> > > >
> > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
> > > > > at
> > > >
> > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
> > > > > at
> > > >
> >
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Pr\
otocol.java:588)
> > > > > at
> > > > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
> > > > > at java.lang.Thread.run(Thread.java:619)
> > > > >
> > > > > your help is appreciated.
> > > > >
> > > > > Felix
> > > > >
> > > >
> > > >
> > > >
> > > >
> > > > ------------------------------------
> > > >
> > > > Yahoo! Groups Links
> > > >
> > > >
> > > >
> > > >
> > >
> >
> >
> >
> >
> > ------------------------------------
> >
> > Yahoo! Groups Links
> >
> >
> >
> >
>

hadoop version
Hadoop 0.20.2+228
Subversion  -r cfc3233ece0769b11af9add328261295aaf4d1ad
Compiled by root on Mon Mar 22 03:11:39 EDT 2010

oozie version
Oozie client build version: 2.3.0-cdh3u1

oozie is running as oozie
oozie    26991     1  0 13:57 ?        00:00:07 /usr/bin/java
-Djava.util.logging.config.file=/var/lib/oozie/oozie-server/conf/logging.propert\
ies -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
-Dderby.stream.error.file=/var/log/oozie/derby.log
-Doozie.home.dir=/usr/lib/oozie -Doozie.config.dir=/etc/oozie
-Doozie.log.dir=/var/log/oozie -Doozie.data.dir=/var/lib/oozie
-Doozie.config.file=oozie-site.xml -Doozie.log4j.file=oozie-log4j.properties
-Doozie.log4j.reload=10 -Doozie.http.hostname=sumo.chi.bluekai.com
-Doozie.http.port=11000 -Doozie.base.url=http://localhost:11000/oozie
-Djava.endorsed.dirs=/usr/lib/oozie/oozie-server/endorsed -classpath
/usr/lib/oozie/oozie-server/bin/bootstrap.jar
-Dcatalina.base=/var/lib/oozie/oozie-server
-Dcatalina.home=/usr/lib/oozie/oozie-server -Djava.io.tmpdir=/var/tmp/oozie
org.apache.catalina.startup.Bootstrap start

OS is centos 5.5 2.6.18-164.15.1.el5 #1 SMP Wed Mar 17 11:30:06 EDT 2010 x86_64
x86_64 x86_64 GNU/Linux

There isn't any entry in proxyuser at the core-site.xml

Felix



--- In Oozie-users@yahoogroups.com, Alejandro Abdelnur <tucu@...> wrote:
>
> Felix,
>
> [Again, moving to the cdh-user@ alias, BCCing oozie-users]
>
> What are the exact versions of Hadoop and Oozie you are using?
>
> What unix user is running Oozie server?
>
> How are you starting Oozier server?
>
> Can you send the configuration of your Hadoop core-site.xml? I just care
> about the properties that have 'proxyuser' in their name.
>
> Thanks.
>
> Alejandro
>
> On Wed, Aug 24, 2011 at 12:01 PM, Felix <felixgao@...> wrote:
>
> > When reverted to the stock oozie-site.xml except I have changed the
> > database to use mysql instead of derby. I still have the exception below.
> >
> > 2011-08-24 13:58:40,107  WARN V1JobsServlet:528 - USER[felix] GROUP[users]
> > TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST
> > http://localhost:11000/oozie/v1/jobs?jobtype=pig] error[E0902], E0902:
> > Exception occured: [java.io.IOException: Call to
> > namenode.xxx/69.xxx.xxx.xxx:50001 failed on local exception:
> > java.io.EOFException]
> > org.apache.oozie.servlet.XServletException: E0902: Exception occured:
> > [java.io.IOException: Call to namenode.xxx/69.xxx.xxx.xxx:50001 failed on
> > local exception: java.io.EOFException]
> >         at
> >
org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.\
java:179)
> >        at
> > org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
> >        at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
> >        at
> > org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
> >        at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
> >        at
> >
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt\
erChain.java:290)
> >        at
> >
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.\
java:206)
> >        at
> > org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
> >        at
> >
com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.j\
ava:371)
> >        at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
> >        at
> >
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt\
erChain.java:235)
> >        at
> >
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.\
java:206)
> >        at
> >
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:2\
33)
> >        at
> >
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:1\
91)
> >        at
> >
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
> >        at
> >
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
> >        at
> >
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109\
)
> >        at
> > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
> >        at
> > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
> >        at
> >
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Pr\
otocol.java:588)
> >        at
> > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
> >        at java.lang.Thread.run(Thread.java:619)
> > Caused by: org.apache.oozie.service.AuthorizationException: E0902:
> > Exception occured: [java.io.IOException: Call to
> > namenode.xxx/69.xxx.xxx.xxx:50001 failed on local exception:
> > java.io.EOFException]
> >         at
> >
org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationServi\
ce.java:318)
> >        at
> >
org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.\
java:171)
> >        ... 21 more
> > Caused by: org.apache.oozie.service.HadoopAccessorException: E0902:
> > Exception occured: [java.io.IOException: Call to
> > namenode.chi.bluekai.com/69.170.130.176:50001 failed on local exception:
> > java.io.EOFException]
> >         at
> >
org.apache.oozie.service.KerberosHadoopAccessorService.createFileSystem(Kerberos\
HadoopAccessorService.java:211)
> >         at
> >
org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationServi\
ce.java:283)
> >        ... 22 more
> > Caused by: java.io.IOException: Call to namenode.xxx/69.xxx.xxx.xxx:50001
> > failed on local exception: java.io.EOFException
> >         at org.apache.hadoop.ipc.Client.wrapException(Client.java:1142)
> >        at org.apache.hadoop.ipc.Client.call(Client.java:1110)
> >        at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
> >        at $Proxy22.getProtocolVersion(Unknown Source)
> >        at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
> >        at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
> >        at
> > org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:111)
> >        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
> >        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:180)
> >        at
> >
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.ja\
va:89)
> >        at
> > org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1514)
> >        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
> >        at
> > org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1548)
> >        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1530)
> >        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:228)
> >         at
> >
org.apache.oozie.service.KerberosHadoopAccessorService$3.run(KerberosHadoopAcces\
sorService.java:203)
> >        at
> >
org.apache.oozie.service.KerberosHadoopAccessorService$3.run(KerberosHadoopAcces\
sorService.java:194)
> >        at java.security.AccessController.doPrivileged(Native Method)
> >        at javax.security.auth.Subject.doAs(Subject.java:396)
> >        at
> >
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1\
127)
> >        at
> >
org.apache.oozie.service.KerberosHadoopAccessorService.createFileSystem(Kerberos\
HadoopAccessorService.java:194)
> >         ... 23 more
> > Caused by: java.io.EOFException
> >        at java.io.DataInputStream.readInt(DataInputStream.java:375)
> >        at
> > org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:815)
> >        at org.apache.hadoop.ipc.Client$Connection.run(Client.java:724)
> >
> >
> >
> > --- In Oozie-users@yahoogroups.com, Alejandro Abdelnur <tucu@> wrote:
> > >
> > > Felix,
> > >
> > > [moving from oozie-users@  (in BCC) to cdh-user@ alias as this seems a
> > CDH
> > > setup  problem]
> > >
> > > If you are using RPM CDH Hadoop and Oozie, you don't have to modify the
> > > HadoopAccessorService.
> > >
> > > Everything should work out of the box with zero configuration.
> > >
> > > Would you try to revert to a clean install and see if you have issues
> > there?
> > >
> > > Thxs.
> > >
> > > Alejandro
> > >
> > >
> > >
> > > On Wed, Aug 24, 2011 at 11:15 AM, Felix <felixgao@> wrote:
> > >
> > > > Alejandro,
> > > >
> > > > I am modifying the oozie.services to
> > > > <property>
> > > >        <name>oozie.services</name>
> > > >        <value>
> > > >            org.apache.oozie.service.SchedulerService,
> > > >            org.apache.oozie.service.InstrumentationService,
> > > >            org.apache.oozie.service.CallableQueueService,
> > > >            org.apache.oozie.service.UUIDService,
> > > >            org.apache.oozie.service.ELService,
> > > >            org.apache.oozie.service.AuthorizationService,
> > > >            org.apache.oozie.service.MemoryLocksService,
> > > >            org.apache.oozie.service.DagXLogInfoService,
> > > >            org.apache.oozie.service.SchemaService,
> > > >            org.apache.oozie.service.LiteWorkflowAppService,
> > > >            org.apache.oozie.service.StoreService,
> > > >            org.apache.oozie.service.CoordinatorStoreService,
> > > >            org.apache.oozie.service.SLAStoreService,
> > > >            org.apache.oozie.service.DBLiteWorkflowStoreService,
> > > >            org.apache.oozie.service.CallbackService,
> > > >            org.apache.oozie.service.ActionService,
> > > >            org.apache.oozie.service.ActionCheckerService,
> > > >            org.apache.oozie.service.RecoveryService,
> > > >            org.apache.oozie.service.PurgeService,
> > > >            org.apache.oozie.service.CoordinatorEngineService,
> > > >            org.apache.oozie.service.DagEngineService,
> > > >            org.apache.oozie.service.CoordJobMatLookupTriggerService,
> > > >            org.apache.oozie.service.HadoopAccessorService
> > > >        </value>
> > > >        <description>
> > > >            All services to be created and managed by Oozie Services
> > > > singleton.
> > > >            Class names must be separated by commas.
> > > >        </description>
> > > >    </property>
> > > >
> > > > because I am seeing E0902: Exception occured:  so
> > > > https://github.com/yahoo/oozie/wiki/FAQ told me to add those to the
> > xml
> > > > file.
> > > >
> > > > --- In Oozie-users@yahoogroups.com, Alejandro Abdelnur <tucu@> wrote:
> > > > >
> > > > > Felix,
> > > > >
> > > > > What are doing that you need to modify the service classes?
> > > > >
> > > > > Thanks.
> > > > >
> > > > > Alejandro
> > > > >
> > > > > On Wed, Aug 24, 2011 at 9:53 AM, Felix <felixgao@> wrote:
> > > > >
> > > > > > NN is running on a different box and so is JT. I do have access to
> > NN
> > > > and
> > > > > > JT from localhost, the box that is used for oozie used to be the
> > > > launchpad
> > > > > > for all of our pig jobs.  When I do hadoop fs I will be able to
> > view
> > > > the
> > > > > > HDFS for which ever user that I am logged in with.
> > > > > >
> > > > > > For my test pig I only have the following in the HDFS
> > > > > > hadoop fs -ls /user/felix/oozie/workflows/test_pig
> > > > > > Found 2 items
> > > > > > -rw-r--r--   2 felix supergroup        367 2011-08-23 14:28
> > > > > > /user/felix/oozie/workflows/test_pig/config-default.xml
> > > > > > drwxr-xr-x   - felix supergroup          0 2011-08-23 14:08
> > > > > > /user/felix/oozie/workflows/test_pig/lib
> > > > > >
> > > > > >
> > > > > > The lib is empty right now.
> > > > > > In my local directory I have
> > > > > > ls -al
> > > > > > total 28
> > > > > > drwxrwxr-x 2 felix felix 4096 Aug 23 16:14 .
> > > > > > drwxrwxr-x 3 felix felix 4096 Aug 23 13:07 ..
> > > > > > -rw-rw-r-- 1 felix felix  367 Aug 23 14:28 config-default.xml
> > > > > > -rw-rw-r-- 1 felix felix  486 Aug 23 15:56 job.properties
> > > > > > -rw-rw-r-- 1 felix felix  309 Aug 23 15:02 pigexample.pig
> > > > > > -rw-rw-r-- 1 felix felix 1190 Aug 23 15:41 pig-wf.xml
> > > > > > -rwxrwxrwx 1 felix felix  929 Aug 23 16:09 submit.sh
> > > > > >
> > > > > >  cat job.properties
> > > > > > #The following attributes must be set
> > > > > > fs.default.name=hdfs://namenode.xxx.xxx:50001
> > > > > > mapred.job.tracker=jobtracker.xxx.xxx:50002
> > > > > > oozie.use.system.libpath=true
> > > > > >
> > oozie.libpath=hdfs://namenode.xxx.xxx:50001/user/oozie/share/pig/lib/
> > > > > > queueName=default
> > > > > > #additional
> > > > > >
> > > > > >
> > > >
> >
oozie.wf.application.path=hdfs://namenode.xxx.xxx:50001/user/felix/oozie/workflo\
ws/test_pig
> > > > > > inputDir=/user/felix/test_input.data
> > > > > > outputDir=/user/felix/oozie_output/pig_test
> > > > > >
> > > > > > I submitted the job to Oozie using
> > > > > > oozie pig -oozie http://localhost:11000/oozie -file pigexample.pig
> > > > -config
> > > > > > job.properties
> > > > > >
> > > > > > hadoop we are using is 0.20.2 and oozie we are using is 2.3.0. Both
> > are
> > > > > > from cloudera's RPM.
> > > > > >
> > > > > > I hope this is clear enough.
> > > > > >
> > > > > > --- In Oozie-users@yahoogroups.com, Mohammad Islam <mislam77@>
> > wrote:
> > > > > > >
> > > > > > > Do you have the NN running on the same box?
> > > > > > >
> > > > > > > If not,  do you have the access from the localhost to NN? Did
> > you
> > > > able
> > > > > > to run "haddop fs ..." command from the localhost?
> > > > > > >
> > > > > > >
> > > > > > > Which version of hadoop and what version of oozie you are using?
> > > > > > > What is the wf apppath in job.properties?
> > > > > > >
> > > > > > > Regards,
> > > > > > > Mohammad
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > ________________________________
> > > > > > > From: Felix <felixgao@>
> > > > > > > To: Oozie-users@yahoogroups.com
> > > > > > > Sent: Tuesday, August 23, 2011 3:28 PM
> > > > > > > Subject: [Oozie-users] Oozie error when submitting jobs
> > > > > > >
> > > > > > >
> > > > > > > Â
> > > > > > > Hi all I have a simple pig job for testing that I would like to
> > use
> > > > oozie
> > > > > > to manage.  When I do the following I got
> > > > > > >
> > > > > > > oozie pig -oozie http://localhost:11000/oozie -file
> > pigexample.pig
> > > > > > -config job.properties
> > > > > > > Error: E0902 : E0902: Exception occured: [java.io.IOException:
> > Call
> > > > to
> > > > > > namenode/69.xxx.xxx.xxx:50001 failed on local exception:
> > > > > > java.io.EOFException]
> > > > > > >
> > > > > > > 2011-08-23 17:18:11,861  WARN V1JobsServlet:528 - USER[felix]
> > > > > > GROUP[users] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST
> > > > > > http://localhost:11000/oozie/v1/jobs?jobtype=pig] error[E0902],
> > E0902:
> > > > > > Exception occured: [java.io.IOException: Call to
> > > > > > namenode/69.xxx.xxx.xxx:50001 failed on local exception:
> > > > > > java.io.EOFException]
> > > > > > > org.apache.oozie.servlet.XServletException: E0902: Exception
> > occured:
> > > > > > [java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001 failed
> > on
> > > > local
> > > > > > exception: java.io.EOFException]
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.\
java:179)
> > > > > > > at
> > > > > >
> > > >
> > org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
> > > > > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
> > > > > > > at
> > > > > >
> > > >
> > org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
> > > > > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt\
erChain.java:290)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.\
java:206)
> > > > > > > at
> > > > org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
> > > > > > > at
> > > > > >
> > > >
> >
com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.j\
ava:371)
> > > > > > > at
> > org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt\
erChain.java:235)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.\
java:206)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:2\
33)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:1\
91)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109\
)
> > > > > > > at
> > > > > >
> > > >
> > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
> > > > > > > at
> > > > > >
> > > >
> > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Pr\
otocol.java:588)
> > > > > > > at
> > > > > >
> > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
> > > > > > > at java.lang.Thread.run(Thread.java:619)
> > > > > > > Caused by: org.apache.oozie.service.AuthorizationException:
> > E0902:
> > > > > > Exception occured: [java.io.IOException: Call to
> > > > > > namenode/69.xxx.xxx.xxx:50001 failed on local exception:
> > > > > > java.io.EOFException]
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationServi\
ce.java:318)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.\
java:171)
> > > > > > > ... 21 more
> > > > > > > Caused by: org.apache.oozie.service.HadoopAccessorException:
> > E0902:
> > > > > > Exception occured: [java.io.IOException: Call to
> > > > > > namenode.chi.bluekai.com/69.170.130.176:50001 failed on local
> > > > exception:
> > > > > > java.io.EOFException]
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.oozie.service.HadoopAccessorService.createFileSystem(HadoopAccessorSe\
rvice.java:144)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationServi\
ce.java:283)
> > > > > > > ... 22 more
> > > > > > > Caused by: java.io.IOException: Call to
> > namenode/69.xxx.xxx.xxx:50001
> > > > > > failed on local exception: java.io.EOFException
> > > > > > > at org.apache.hadoop.ipc.Client.wrapException(Client.java:1142)
> > > > > > > at org.apache.hadoop.ipc.Client.call(Client.java:1110)
> > > > > > > at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
> > > > > > > at $Proxy22.getProtocolVersion(Unknown Source)
> > > > > > > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
> > > > > > > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
> > > > > > > at
> > > > org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:111)
> > > > > > > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
> > > > > > > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:180)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.ja\
va:89)
> > > > > > > at
> > > > org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1514)
> > > > > > > at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
> > > > > > > at
> > > > > >
> > org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1548)
> > > > > > > at
> > org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1530)
> > > > > > > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:228)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.oozie.service.HadoopAccessorService.createFileSystem(HadoopAccessorSe\
rvice.java:141)
> > > > > > > ... 23 more
> > > > > > > Caused by: java.io.EOFException
> > > > > > > at java.io.DataInputStream.readInt(DataInputStream.java:375)
> > > > > > > at
> > > > > >
> > > >
> > org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:815)
> > > > > > > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:724)
> > > > > > >
> > > > > > > in my oozie-site.xml I have the following services
> > > > > > > <property>
> > > > > > > <name>oozie.services</name>
> > > > > > > <value>
> > > > > > > org.apache.oozie.service.SchedulerService,
> > > > > > > org.apache.oozie.service.InstrumentationService,
> > > > > > > org.apache.oozie.service.CallableQueueService,
> > > > > > > org.apache.oozie.service.UUIDService,
> > > > > > > org.apache.oozie.service.ELService,
> > > > > > > org.apache.oozie.service.AuthorizationService,
> > > > > > > org.apache.oozie.service.MemoryLocksService,
> > > > > > > org.apache.oozie.service.DagXLogInfoService,
> > > > > > > org.apache.oozie.service.SchemaService,
> > > > > > > org.apache.oozie.service.LiteWorkflowAppService,
> > > > > > > org.apache.oozie.service.StoreService,
> > > > > > > org.apache.oozie.service.CoordinatorStoreService,
> > > > > > > org.apache.oozie.service.SLAStoreService,
> > > > > > > org.apache.oozie.service.DBLiteWorkflowStoreService,
> > > > > > > org.apache.oozie.service.CallbackService,
> > > > > > > org.apache.oozie.service.ActionService,
> > > > > > > org.apache.oozie.service.ActionCheckerService,
> > > > > > > org.apache.oozie.service.RecoveryService,
> > > > > > > org.apache.oozie.service.PurgeService,
> > > > > > > org.apache.oozie.service.CoordinatorEngineService,
> > > > > > > org.apache.oozie.service.DagEngineService,
> > > > > > > org.apache.oozie.service.CoordJobMatLookupTriggerService,
> > > > > > > org.apache.oozie.service.HadoopAccessorService
> > > > > > > </value>
> > > > > > > <description>
> > > > > > > All services to be created and managed by Oozie Services
> > singleton.
> > > > > > > Class names must be separated by commas.
> > > > > > > </description>
> > > > > > > </property>
> > > > > > >
> > > > > > > if I take out org.apache.oozie.service.HadoopAccessorService,
> > then I
> > > > will
> > > > > > get
> > > > > > > 2011-08-23 16:09:45,587 ERROR V1JobsServlet:522 - USER[felix]
> > > > > > GROUP[users] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST
> > > > > > http://localhost:11000/oozie/v1/jobs?jobtype=pig] error, null
> > > > > > > java.lang.NullPointerException
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationServi\
ce.java:283)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.\
java:171)
> > > > > > > at
> > > > > >
> > > >
> > org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
> > > > > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
> > > > > > > at
> > > > > >
> > > >
> > org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
> > > > > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt\
erChain.java:290)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.\
java:206)
> > > > > > > at
> > > > org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
> > > > > > > at
> > > > > >
> > > >
> >
com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.j\
ava:371)
> > > > > > > at
> > org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt\
erChain.java:235)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.\
java:206)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:2\
33)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:1\
91)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109\
)
> > > > > > > at
> > > > > >
> > > >
> > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
> > > > > > > at
> > > > > >
> > > >
> > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
> > > > > > > at
> > > > > >
> > > >
> >
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Pr\
otocol.java:588)
> > > > > > > at
> > > > > >
> > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
> > > > > > > at java.lang.Thread.run(Thread.java:619)
> > > > > > >
> > > > > > > your help is appreciated.
> > > > > > >
> > > > > > > Felix
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > ------------------------------------
> > > > > >
> > > > > > Yahoo! Groups Links
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > >
> > > >
> > > >
> > > >
> > > > ------------------------------------
> > > >
> > > > Yahoo! Groups Links
> > > >
> > > >
> > > >
> > > >
> > >
> >
> >
> >
> >
> > ------------------------------------
> >
> > Yahoo! Groups Links
> >
> >
> >
> >
>

Hi -

Is there a way to include a dependency on a repository for oozie 3.0.2? It looks
like the project on github doesn't have a "version" that maven dependency is
expecting. I need to compile a project using maven and oozie/client.

PS: I'm pretty new at maven.

Frank
Frank
fastier@...

 

Hi -

Is there a way to include a dependency on a repository for oozie 3.0.2? It looks like the project on github doesn't have a "version" that maven dependency is expecting. I need to compile a project using maven and oozie/client.

PS: I'm pretty new at maven.

Frank
Frank
fastier@...

According to Coordinator specification timeout's default value is -1

timeout: The maximum time, in minutes, that a materialized action will be
waiting for the additional conditions to be satisfied before being discarded. A
timeout of 0 indicates that at the time of materialization all the other
conditions must be satisfied, else the action will be discarded. A timeout of 0
indicates that if all the input events are not satisfied at the time of action
materizlization, the action should timeout immediately. A timeout of -1
indicates no timeout, the materialized action will wait forever for the other
conditions to be satisfied. The default value is -1 .




I have a


  <controls>
         <concurrency>1</concurrency>
         <execution>FIFO</execution>
  </controls>


And thus would assume no timepout. It has to wait indefinitely for data in 's to
appear.

Is there any other reason my job is TIMEDOUT ? Note that it does execute when
all data is available.

Regards.

I have added
  <property>
    	 <name>hadoop.proxyuser.oozie.hosts</name>
   	  <value>*</value>
      </property>
      <property>
     	 <name>hadoop.proxyuser.oozie.groups</name>
     	 <value>*</value>
      </property>

to the core-site.xml on namenode.   After restart namenode,  I still see the
following exceptions.

2011-08-25 11:46:09,477  WARN V1JobsServlet:528 - USER[felix] GROUP[users]
TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST
http://localhost:11000/oozie/v1/jobs?jobtype=pig] error[E0902], E0902: Exception
occured: [java.io.IOException: Call to
namenode.xxx.xxx.com/xxx.xxx.xxx.xxx:50001 failed on local exception:
java.io.EOFException]
org.apache.oozie.servlet.XServletException: E0902: Exception occured:
[java.io.IOException: Call to namenode.xxx.xxx.com/xxx.xxx.xxx.xxx:50001 failed
on local exception: java.io.EOFException]
	 at
org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.\
java:179)
	 at org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
	 at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
	 at org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
	 at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
	 at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt\
erChain.java:290)
	 at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.\
java:206)
	 at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
	 at
com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.j\
ava:371)
	 at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
	 at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt\
erChain.java:235)
	 at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.\
java:206)
	 at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:2\
33)
	 at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:1\
91)
	 at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
	 at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
	 at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109\
)
	 at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
	 at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
	 at
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Pr\
otocol.java:588)
	 at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
	 at java.lang.Thread.run(Thread.java:619)
Caused by: org.apache.oozie.service.AuthorizationException: E0902: Exception
occured: [java.io.IOException: Call to
namenode.chi.bluekai.com/69.170.130.176:50001 failed on local exception:
java.io.EOFException]
	 at
org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationServi\
ce.java:318)
	 at
org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.\
java:171)
	 ... 21 more
Caused by: org.apache.oozie.service.HadoopAccessorException: E0902: Exception
occured: [java.io.IOException: Call to
namenode.chi.bluekai.com/69.170.130.176:50001 failed on local exception:
java.io.EOFException]
	 at
org.apache.oozie.service.KerberosHadoopAccessorService.createFileSystem(Kerberos\
HadoopAccessorService.java:211)
	 at
org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationServi\
ce.java:283)
	 ... 22 more
Caused by: java.io.IOException: Call to
namenode.xxx.xxx.com/xxx.xxx.xxx.xxx:50001 failed on local exception:
java.io.EOFException
	 at org.apache.hadoop.ipc.Client.wrapException(Client.java:1142)
	 at org.apache.hadoop.ipc.Client.call(Client.java:1110)
	 at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
	 at $Proxy22.getProtocolVersion(Unknown Source)
	 at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
	 at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
	 at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:111)
	 at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
	 at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:180)
	 at
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.ja\
va:89)
	 at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1514)
	 at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
	 at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1548)
	 at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1530)
	 at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:228)
	 at
org.apache.oozie.service.KerberosHadoopAccessorService$3.run(KerberosHadoopAcces\
sorService.java:203)
	 at
org.apache.oozie.service.KerberosHadoopAccessorService$3.run(KerberosHadoopAcces\
sorService.java:194)
	 at java.security.AccessController.doPrivileged(Native Method)
	 at javax.security.auth.Subject.doAs(Subject.java:396)
	 at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1\
127)
	 at
org.apache.oozie.service.KerberosHadoopAccessorService.createFileSystem(Kerberos\
HadoopAccessorService.java:194)
	 ... 23 more
Caused by: java.io.EOFException
	 at java.io.DataInputStream.readInt(DataInputStream.java:375)
	 at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:815)
	 at org.apache.hadoop.ipc.Client$Connection.run(Client.java:724)

I've just posted the above PRs (they should be applied in that order),
they fix the postgres config file for testing, set the 2.3.2 release
version in the POMs and set the new devel version 2.3.3-SNAPSHOT.

It would be great if we can push this PRs today, so they are part of
the original Apache import.

Thanks.

Alejandro

It seems to be the version. In oozie-2.3.0-cdh3u0 , timeout is not even a valid
schema element.

Any ideas  what the timeout is hardcoded as in oozie-2.3.0-cdh3u0 ?



--- In Oozie-users@yahoogroups.com, Mohammad Islam <mislam77@...> wrote:
>
> which version of oozie you are using?
>
>
>
> ________________________________
> From: vishal.santoshi <vishal.santoshi@...>
> To: Oozie-users@yahoogroups.com
> Sent: Thursday, August 25, 2011 6:51 AM
> Subject: [Oozie-users] timeout in controls
>
>
>  
> According to Coordinator specification timeout's default value is -1
>
> timeout: The maximum time, in minutes, that a materialized action will be
waiting for the additional conditions to be satisfied before being discarded. A
timeout of 0 indicates that at the time of materialization all the other
conditions must be satisfied, else the action will be discarded. A timeout of 0
indicates that if all the input events are not satisfied at the time of action
materizlization, the action should timeout immediately. A timeout of -1
indicates no timeout, the materialized action will wait forever for the other
conditions to be satisfied. The default value is -1 .
>
> I have a
>
> <controls>
> <concurrency>1</concurrency>
> <execution>FIFO</execution>
> </controls>
>
> And thus would assume no timepout. It has to wait indefinitely for data in 's
to appear.
>
> Is there any other reason my job is TIMEDOUT ? Note that it does execute when
all data is available.
>
> Regards.
>

Cool!  On both counts - a 3.1 release and the move to apache infrastructure. 
Hopefully it will mean greater exposure, adoption, and community involvement.

On Aug 17, 2011, at 3:05 PM, Mohammad Islam wrote:

>
> Hi Alejandro,
> We are working on the last touches of 3.1 release. It should be done in couple
of days.
>
> I will look into those issue after that.
> Btw, we started using Apache JIRA.
>
> Regards,
> Mohammad
>
> From: Alejandro Abdelnur <tucu@...>
> To: oozie-users <Oozie-users@yahoogroups.com>
> Sent: Wednesday, August 17, 2011 12:19 PM
> Subject: [Oozie-users] status of Apache Incubator?
>
>
> What is the status of Oozie incubation?
>
> * When do we switch to Apache Oozie SVN?
> * When do we switch to Apache Oozie email aliases?
> * When do we switch to Apache Oozie JIRA?
> * When do we switch to Apache Oozie Jenkins?
> * How/when are we pushing all GH Issues and Oozie JIRA issues to Apache Oozie
JIRA?
>
> Thanks.
>
> Alejandro
>
>
>
>