Import jobs fail with ClassNotFountException while using MapR v5.0

Problem

Users using MapR 5.0 Hadoop distribution who are importing from S3 or Azure (possibly other sources), the import jobs fail with a ClassNotFountException.

 

Cause

The required libraries are separated from the correct class path of YARN.

 

Solution

Copy over the needed libraries to the Hadoop common folder so they would be available for YARN.

  1. Open the Hadoop tools library folder <mapr-home>/share/hadoop/tools/lib
  2. Copy the following jar files:

    S3 Users: 

    aws-java-sdk-1.7.4.jar 

    hadoop-aws-2.7.0-mapr-1506.jar

     

    Azure Users:

    hadoop-azure-2.7.0-mapr-1506.jar

     

  3. Add the files to the Hadoop common library folder <mapr-home>/share/hadoop/common/lib

 

Note: This action must be completed on each node.