2014-09-06 86 views
0

您好目前我正在运行hadoop 2.4.1。我创建使用eclipse一个简单的Java程序DefaultMapperClass.java并打包成ex1.jarHadoop不与资源管理器通信

当我尝试使用该命令将通过Hadoop的外壳来调用这个程序,

**hadoop jar /home/Maddy/ex1.jar DefaultMapperClass hdfs://localhost/users/root/input/Hadoop.txt hdfs://localhost/users/root/output** 

我得到下面的输出Hadoop的外壳

**[[email protected] Maddy]# hadoop jar /home/Maddy/ex1.jar DefaultMapperClass hdfs://localhost/users/root/input/Hadoop.txt hdfs://localhost/users/root/output 
14/09/05 19:26:35 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 
Job started: Fri Sep 05 19:26:35 CDT 2014 
14/09/05 19:26:35 INFO client.RMProxy: Connecting to ResourceManager at localhost/127.0.0.1:8032 
[[email protected] Maddy]#** 

看起来像Hadoop的外壳试图连接到资源管理器,但不成功,但没有错误消息

MAPR ED-site.xml文件:

**<configuration> 
    <property> 
     <name>mapreduce.framework.name</name> 
     <value>yarn</value> 
    </property> 
</configuration>** 

纱-site.xml中:

**<configuration> 
    <property> 
     <name>yarn.nodemanager.aux-services</name> 
     <value>mapreduce_shuffle</value> 
    </property> 
<property> 
    <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name> 
    <value>org.apache.hadoop.mapred.ShuffleHandler</value> 
</property> 
<property> 
<name>yarn.resourcemanager.address</name> 
<value>localhost:8032</value> 
</property> 
<property> 
<name>yarn.resourcemanager.scheduler.address</name> 
<value>localhost:8030</value> 
</property> 
<property> 
<name>yarn.resourcemanager.resource-tracker.address</name> 
<value>localhost:8031</value> 
</property> 
</configuration>** 

缺少什么吗?为什么在尝试连接资源管理器后终止执行?

回答

0

我会建议取消从yarnsite.xml以下配置,因为它们是不必要的:8088

<property> 
<name>yarn.resourcemanager.address</name> 
<value>localhost:8032</value> 
</property> 
<property> 
<name>yarn.resourcemanager.scheduler.address</name> 
<value>localhost:8030</value> 
</property> 
<property> 
<name>yarn.resourcemanager.resource-tracker.address</name> 
<value>localhost:8031</value> 
</property> 

您可以在本地主机访问的资源管理器