Windows 7中的Hadoop安装

我正在研究Windows 7中的hadoop安装。Windows 7中的Hadoop安装

试图从apache站点解压tarfiles，但它不成功。

我已经在互联网搜索和找到下面的链接。

http://toodey.com/2015/08/10/hadoop-installation-on-windows-without-cygwin-in-10-mints/

我能够安装。但是当我试图执行这些例子时，我遇到了以下错误。执行

命令：

C:\Users\hadoop\hadoop-2.7.1\bin\hadoop.cmd jar C:\Users\hadoop\hadoop-2.7.1\share\hadoop\mapreduce\hadoop-mapreduce-examples-2.7.1.jar wordcount /hadoop/input /hadoop/output

错误：

C:\Users\hadoop\hadoop-2.7.1>C:\Users\hadoop\hadoop-2.7.1\bin\hadoop.cmd jar C:\Users\hadoop\hadoop-2.7.1\share\hadoop\mapreduce\hadoop-mapreduce-examples-2.7.1.jar wordcount /hadoop/input /hadoop/output 
16/11/14 17:05:28 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:0000 
16/11/14 17:05:30 INFO input.FileInputFormat: Total input paths to process : 3 
16/11/14 17:05:30 INFO mapreduce.JobSubmitter: number of splits:3 
16/11/14 17:05:30 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1479122512555_0003 
16/11/14 17:05:31 INFO impl.YarnClientImpl: Submitted application application_1479122512555_0003 
16/11/14 17:05:32 INFO mapreduce.Job: The url to track the job: http://MachineName:8088/proxy/application_1479122512555_0003/ 
16/11/14 17:05:32 INFO mapreduce.Job: Running job: job_1479122512555_0003 
16/11/14 17:05:36 INFO mapreduce.Job: Job job_1479122512555_0003 running in uber mode : false 
16/11/14 17:05:36 INFO mapreduce.Job: map 0% reduce 0% 
16/11/14 17:05:36 INFO mapreduce.Job: Job job_1479122512555_0003 failed with state FAILED due to: Application application_1479122512555_0003 failed 2 times due to AM Container for appattempt_1479122512555_0003_000002 exited with exitCode: -1000 
For more detailed output, check application tracking page:http://MachineName:8088/cluster/app/application_1479122512555_0003Then, click on links to logs of each attempt. 
Diagnostics: null 
Failing this attempt. Failing the application. 
16/11/14 17:05:36 INFO mapreduce.Job: Counters: 0

在此先感谢...

来源

2016-11-14 VinayS

其实这是由于一些纱线本地目录的权限问题。因此，这里的解决方案

确定纱线目录使用参数yarn.nodemanager.local - 迪尔斯指定从纱节点管理器/etc/gphd/hadoop/conf/yarn-site.xml。
从yarn-site.xml中列出的所有目录和所有节点管理器中删除usercache下的文件/文件夹。

e.g

rmdir path/to/yarn/nm/usercache/*

来源

2016-11-14 12:03:09 Mahek

以下是消息我可以看到.. 可供容器container_1479122512555_0003_02_000001没有日志让我知道，如果我错了指向日志。 – VinayS

始终为输入提供特定的文件名 – Mahek

现在我已经在下面执行了。 C：\ Users \ hadoop \ hadoop-2.7.1 \ bin \ hadoop.cmd jar C：\ Users \ hadoop \ hadoop-2.7.1 \ share \ hadoop \ mapreduce \ hadoop-mapreduce-examples-2.7.1。 jar wordcount /hadoop/input/LICENSE.txt/hadoop/output 但错误是颤音一样的。我可以知道安装是否有问题吗？ – VinayS

Windows 7中的Hadoop安装

回答

相关问题