TEZ Job Failure: Given folder to zip plugin-tez-<ver>/classes/datameer does not exist!

Problem

When attempting to run jobs from Datameer, we receive the following stack: 

ERROR [2015-12-14 14:17:57.647] [MrPlanRunnerV2] (ClusterSession.java:185) - Failed to run cluster job 'Workbook job (2068): Workbook Imps V2#IMPRESSIONS(Identity)#IMPRESSIONS(Identit\
y)' [0 sec]
java.lang.IllegalArgumentException: Given folder to zip '/opt/datameer/Datameer-5.8.2-hdp-2.2.0/tmp/das-plugins4335432988903992221.folder/plugin-tez-5.8.2.zip/plugin-tez-5.8.2/classes\
/datameer' does not exist!
datameer.plugin.tez.session.TezSessionFactory$AlwaysNewSessionFactory.get(TezSessionFactory.java:50)
datameer.plugin.tez.session.TezSessionFactory$ReuseSessionFactory.createNewSession(TezSessionFactory.java:104)
datameer.dap.common.graphv2.mixedframework.MixedClusterSession.execute(MixedClusterSession.java:49)
at datameer.com.google.common.base.Preconditions.checkArgument(Preconditions.java:145)
at datameer.dap.sdk.util.ZipUtil.compress(ZipUtil.java:81)
at datameer.plugin.tez.TezClientFacade.createTezPluginJar(TezClientFacade.java:241)
at datameer.plugin.tez.TezClientFacade.createTaskLocalResourceMap(TezClientFacade.java:198)
at datameer.plugin.tez.session.TezSessionImpl.(TezSessionImpl.java:39)
at
at
at datameer.plugin.tez.session.PoolingTezSessionFactory.get(PoolingTezSessionFactory.java:105)
at datameer.plugin.tez.session.TrackRunningSessionFactory.get(TrackRunningSessionFactory.java:50)
at datameer.plugin.tez.session.TrackRunningSessionFactory.get(TrackRunningSessionFactory.java:50)
at datameer.plugin.tez.DagRunner.submit(DagRunner.java:69)
at datameer.plugin.tez.TezJob.runTezDag(TezJob.java:161)
at datameer.plugin.tez.TezJob.runImpl(TezJob.java:139)
at datameer.dap.common.graphv2.ClusterJob.run(ClusterJob.java:129)
at datameer.dap.common.graphv2.ClusterSession.execute(ClusterSession.java:180)
at
at datameer.dap.common.graphv2.ClusterSession.runAllClusterJobs(ClusterSession.java:331)
at datameer.dap.common.graphv2.MrPlanRunnerV2.run(MrPlanRunnerV2.java:103)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at datameer.dap.common.security.DatameerSecurityService.runAsUser(DatameerSecurityService.java:96)
at datameer.dap.common.security.DatameerSecurityService.runAsUser(DatameerSecurityService.java:173)
at datameer.dap.common.security.RunAsThread.run(RunAsThread.java:22)

Note /tmp/ in the Given folder to zip error message.  

Cause

At this time we do not have enough information to point to a root cause for this issue. 

Solution

To resolve this issue 

  • Stop Datameer service
  • Clean up <datameer-install-path/tmp>
  • Start Datameer service

Further Information

ClassNotFoundException for One or More Datameer Core Class Files