Error Repository


In this post we will discuss about one of common/frequent error message faced by many oozie beginners due to incorrect/incomplete oozie setup. Oozie Share Lib does not exist error is received if oozie sharelib is not installed properly. Error Scenario: java.io.FileNotFoundException: File /user/user/share/lib does not exist This error message we will […]

Oozie Share Lib does not exist error


In this post we will discuss about common problem in installing cloudera manager 5.3.2 on Ubuntu 14.04 machine and solution for the root cause. Problem: When installing Cloudera Manager 5.3.2 on Ubuntu 14.04.2 Machine getting below error messages after giving root privileges on ssh configuration page. Exhausted available authentication methods […]

Exhausted available authentication methods


Error Scenario: java.io.IOException: Cannot create an instance of InputFormat class We will get this error message when we try to execute simple hadoop fs commands or running any hive queries. Below is the complete error message. [crayon-58acec331c24b659620298/] Root Cause: This error message will be received when there are any spaces […]

Cannot create an instance of InputFormat




In this post we will discuss about most frequent error messages NoClassDefFoundError or ClassNotFoundException in hadoop mapreduce jobs execution and possible solutions for them. Error Scenario: java.lang.ClassNotFoundException       or java.lang.NoClassDefFoundError Error starting MRAppMaster   &  Container exited with a non-zero exit code 1 When we encounter a situation of […]

NoClassDefFoundError or ClassNotFoundException


1
In this post we will discuss about some of the errors or exceptions that can occur when there is mismatch in the integration of Avro and Hadoop distributions. When we do not use the correct version of avro release then we will run into so many errors or exceptions. In […]

Hadoop Integration – Avro Errors



1
Error Scenario: Expected timestamp in the Flume event headers, but it was null – NullPointerException This error message is received in ~/logs/flume.log file when starting a flume agent with HDFS sink with format escape sequences.(%Y, %M, %D, %H, %M, %S). [crayon-58acec331d5cb034728860/] If a sink expects a header but does not […]

Expected timestamp in the Flume event headers, but it was ...


Error Scenario: channel has been removed due to an error during configuration. This error message is received in ~/logs/flume.log file when starting a flume agent with missing or wrong configuration with JDBC channel setup. [crayon-58acec331da10997332973/] Root Cause: DerbySchemaHandler.schemaExists error message is received when a flume agent’s sink is not able […]

channel has been removed due to an error


Error Scenario: Mapreduce job stuck at map 0% reduce 0%. : Could not resolve hostname [crayon-58acec331dd3c232473213/] Mapreduce jobs are not running. And the below error message is coming when starting HDFS daemons. [crayon-58acec331dd44429189262/] Resolution: These above error messages are received when there is some issue with ssh communication. So, in these […]

Mapreduce job stuck at map 0% reduce 0%



Error Scenario: org.apache.flume.EventDeliveryException: Failed to open file  We will receive this error message when a flume agent is started and it is trying to start FILE_ROLL sink with a given target sink directory. Below are the error messages sequence from ~/logs/flume.log file. [crayon-58acec331e02d791358226/] Root Cause: When a flume agent is […]

org.apache.flume.EventDeliveryException: Failed to open file


Error Scenario: java.lang.UnsatisfiedLinkError: org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z We will receive this error message if we try to read snappy files without having snappy compression/decompression codec installed properly.  [crayon-58acec331e2e3222889955/] Or [crayon-58acec331e2eb738575162/] Resolution: We should install snappy compression/decompression codec to resolve this error message and its corresponding .so files should be available (copied from /usr/local/bin) […]

UnsatisfiedLinkError


1
Error Scenario 1: In this post, we will discuss about a few varieties of error message Unable to open a test connection to the given database and their resolutions. Unable to open a test connection to the given database / Communications link failure Below is the error message for this communications link failure: […]

Unable to open a test connection to the given database



hive-site
Error Scenario: Unable to open a test connection to the given database  or Access denied for user ‘APP’@’localhost’ (using password: YES) This error message (Access denied for user ‘APP’@’localhost’) will be received while trying to connect hive service through MySQL local metastore. [crayon-58acec331ec74695910602/] Root Cause: When we don’t provide username (javax.jdo.option.ConnectionUserName) […]

Access denied for user ‘APP’@’localhost’ (using password: YES)


mysql tarball
Error Scenario: The specified datastore driver (“com.mysql.jdbc.Driver”) was not found in the CLASSPATH We usually get this error message while configuring Hive Local Metastore through MySQL database. [crayon-58acec331ef9e491742691/] Root Cause: If the JDBC driver JAR file for MySQL (Connector/J) is not on Hive’s classpath, ( in Hive’s lib directory – $HIVE_HOME/lib), we […]

datastore driver was not found in the CLASSPATH


Error Scenario: Datanode denied communication with namenode: We usually get this error message while adding a data node to an existing HDFS cluster or at the time of cluster setup. Below is the snapshot of this error message from log file in data node. [crayon-58acec331f28a032294366/] Root Cause: This error message is […]

Datanode denied communication with namenode