storage directory does not exist 1

Error Scenario:  

storage directory does not exist or is not accessible / Exception in namenode join

When we receive the error messages in name node log or data node logs similar to below then it belongs to this error scenario.

Root Cause:

This kind of error messages are received, when we are configuring hadoop without creating source directories for saving namenode or datanode meta data files in local file system.

These are the directories defined in <> & <> environment variables in hdfs-site.xml file.

For example in the below settings,

We should have already created below two directories



though it is not mandatory to create name or data sub directories under these.

In our error scenario case,

We have directory level created only up to /usr/lib/hadoop/hadoop-2.3.0 but hdfs/namenode or hdfs/datanode directories are not created.

So, we have received error messages, stating that hdfs/namenode or hdfs/datanode storage directories doesn’t exist.


To resolve this kind of error messages,
  1. We need to make sure that entire source directory level is created before starting namenode or datanode daemons.
  2. Also we need to give full (r+w+x) permissions on these storage directories to hadoop user account (say hduser for example).

Profile photo of Siva

About Siva

Senior Hadoop developer with 4 years of experience in designing and architecture solutions for the Big Data domain and has been involved with several complex engagements. Technical strengths include Hadoop, YARN, Mapreduce, Hive, Sqoop, Flume, Pig, HBase, Phoenix, Oozie, Falcon, Kafka, Storm, Spark, MySQL and Java.

Leave a comment

Your email address will not be published. Required fields are marked *

One thought on “storage directory does not exist