2010-07-24 73 views
7

我使用Hadoop在Windows和我已经配置好的一切(安装了cygwin,密码的ssh等)Hadoop的Windows中:文件中未发现异常

我编译在WC.jar的单词计数程序并试图跑步。它在独立模式下完美运行..但在完全分布模式下,它给出FileNotFoundException

请查看日志并告诉我它有什么问题。 我已经开始了MACH1中的dfs和mapreduce。 (那是我的主人)

$ bin/hadoop jar WC.jar WordCount words result 

10/07/24 16:57:38 INFO input.FileInputFormat: Total input paths to process : 2 
10/07/24 16:57:39 INFO mapred.JobClient: Running job: job_201007241657_0001 
10/07/24 16:57:40 INFO mapred.JobClient: map 0% reduce 0% 
10/07/24 16:57:50 INFO mapred.JobClient: Task Id : attempt_201007241657_0001_m_0 
00003_0, Status : FAILED 
java.io.FileNotFoundException: File C:/tmp/hadoop-328510/mapred/local/taskTracke 
r/jobcache/job_201007241657_0001/attempt_201007241657_0001_m_000003_0/work/tmp d 
oes not exist. 
     at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSys 
tem.java:361) 
     at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem. 
java:245) 
     at org.apache.hadoop.mapred.TaskRunner.setupWorkDir(TaskRunner.java:519) 

     at org.apache.hadoop.mapred.Child.main(Child.java:155) 

10/07/24 16:57:55 INFO mapred.JobClient: Task Id : attempt_201007241657_0001_r_0 
00002_0, Status : FAILED 
java.io.FileNotFoundException: File C:/tmp/hadoop-328510/mapred/local/taskTracke 
r/jobcache/job_201007241657_0001/attempt_201007241657_0001_r_000002_0/work/tmp d 
oes not exist. 
     at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSys 
tem.java:361) 
     at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem. 
java:245) 
     at org.apache.hadoop.mapred.TaskRunner.setupWorkDir(TaskRunner.java:519) 

     at org.apache.hadoop.mapred.Child.main(Child.java:155) 

10/07/24 16:58:07 INFO mapred.JobClient: Task Id : attempt_201007241657_0001_m_0 
00003_1, Status : FAILED 
java.io.FileNotFoundException: File C:/tmp/hadoop-SYSTEM/mapred/local/taskTracke 
r/jobcache/job_201007241657_0001/attempt_201007241657_0001_m_000003_1/work/tmp d 
oes not exist. 
     at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSys 
tem.java:361) 
     at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem. 
java:245) 
     at org.apache.hadoop.mapred.TaskRunner.setupWorkDir(TaskRunner.java:519) 

     at org.apache.hadoop.mapred.Child.main(Child.java:155) 

10/07/24 16:58:14 INFO mapred.JobClient: Task Id : attempt_201007241657_0001_m_0 
00003_2, Status : FAILED 
java.io.FileNotFoundException: File C:/tmp/hadoop-SYSTEM/mapred/local/taskTracke 
r/jobcache/job_201007241657_0001/attempt_201007241657_0001_m_000003_2/work/tmp d 
oes not exist. 
     at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSys 
tem.java:361) 
     at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem. 
java:245) 
     at org.apache.hadoop.mapred.TaskRunner.setupWorkDir(TaskRunner.java:519) 

     at org.apache.hadoop.mapred.Child.main(Child.java:155) 

10/07/24 16:58:26 INFO mapred.JobClient: Task Id : attempt_201007241657_0001_m_0 
00002_0, Status : FAILED 
java.io.FileNotFoundException: File C:/tmp/hadoop-SYSTEM/mapred/local/taskTracke 
r/jobcache/job_201007241657_0001/attempt_201007241657_0001_m_000002_0/work/tmp d 
oes not exist. 
     at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSys 
tem.java:361) 
     at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem. 
java:245) 
     at org.apache.hadoop.mapred.TaskRunner.setupWorkDir(TaskRunner.java:519) 

     at org.apache.hadoop.mapred.Child.main(Child.java:155) 

10/07/24 16:58:34 INFO mapred.JobClient: Task Id : attempt_201007241657_0001_r_0 
00001_0, Status : FAILED 
java.io.FileNotFoundException: File C:/tmp/hadoop-SYSTEM/mapred/local/taskTracke 
r/jobcache/job_201007241657_0001/attempt_201007241657_0001_r_000001_0/work/tmp d 
oes not exist. 
     at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSys 
tem.java:361) 
     at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem. 
java:245) 
     at org.apache.hadoop.mapred.TaskRunner.setupWorkDir(TaskRunner.java:519) 

     at org.apache.hadoop.mapred.Child.main(Child.java:155) 

10/07/24 16:58:41 INFO mapred.JobClient: Task Id : attempt_201007241657_0001_m_0 
00002_1, Status : FAILED 
java.io.FileNotFoundException: File C:/tmp/hadoop-328510/mapred/local/taskTracke 
r/jobcache/job_201007241657_0001/attempt_201007241657_0001_m_000002_1/work/tmp d 
oes not exist. 
     at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSys 
tem.java:361) 
     at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem. 
java:245) 
     at org.apache.hadoop.mapred.TaskRunner.setupWorkDir(TaskRunner.java:519) 

     at org.apache.hadoop.mapred.Child.main(Child.java:155) 

10/07/24 16:58:47 INFO mapred.JobClient: Task Id : attempt_201007241657_0001_m_0 
00002_2, Status : FAILED 
java.io.FileNotFoundException: File C:/tmp/hadoop-328510/mapred/local/taskTracke 
r/jobcache/job_201007241657_0001/attempt_201007241657_0001_m_000002_2/work/tmp d 
oes not exist. 
     at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSys 
tem.java:361) 
     at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem. 
java:245) 
     at org.apache.hadoop.mapred.TaskRunner.setupWorkDir(TaskRunner.java:519) 

     at org.apache.hadoop.mapred.Child.main(Child.java:155) 

10/07/24 16:58:53 INFO mapred.JobClient: Job complete: job_201007241657_0001 
10/07/24 16:58:53 INFO mapred.JobClient: Counters: 0 

[email protected] /usr/local/hadoop-0.20.2 
$` 

谢谢。

+0

向我们展示[SSCCE](http://sscce.org/)代码,您可以在其中调用'DistributedCache.addCacheFile'。请参阅[这里](http://stackoverflow.com/questions/3219012/filenotfoundexception-when-using-hadoop-distributed-cache)以获得可能的答案。 – opyate 2011-06-30 22:42:35

回答

1

我想我可能以前见过这个例外,但我没有访问我的旧日志来确认它。我通过解决了我的FileNotFoundException异常,重新命名了名称节点。您可能需要检查名称节点日志中的“不一致状态”以在重新格式化之前确认原因。

+0

hi @wei,我也有同样的问题,我也尝试过重新格式化,但问题仍然存在 – jerith 2013-04-11 06:21:10

+0

你在日志中看到“不一致的状态”吗? – Wei 2013-04-14 11:37:09