hadoop - Failed to set permissions of path: mp

Question

Failed to set permissions of path: mphadoop-MayPaynemapredstagingMayPayne2016979439.staging to 0700 

I'm getting this error when the MapReduce job executing, I was using hadoop 1.0.4, then I got to know it's a known issue and I tried this with the 1.2.0 but the issue still exists. Can I know a hadoop version that they have resolved this issue.

Thank you all in advance

Answer 1

I was getting the same exception while runing nutch-1.7 on windows 7.

bin/nutch crawl urls -dir crawl11 -depth 1 -topN 5

The following steps worked for me

1. Download the pre-built JAR, patch-hadoop_7682-1.0.x-win.jar, from theDownload section. You may get the steps for hadoop.
2. Copy patch-hadoop_7682-1.0.x-win.jar to the ${NUTCH_HOME}/lib directory

3. Modify ${NUTCH_HOME}/conf/nutch-site.xml to enable the overriden implementation as shown below:

   <?xml version="1.0"?>
   <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
   <!-- Put site-specific property overrides in this file. -->
   <configuration>
       <property>
           <name>fs.file.impl</name>
           <value>com.conga.services.hadoop.patch.HADOOP_7682.WinLocalFileSystem</value>
           <description>Enables patch for issue HADOOP-7682 on Windows</description>
       </property>
    </configuration>
   

4. Run your job as usual (using Cygwin).