2017-08-25 63 views
0

数据节点和节点管理器未以伪集群模式(Apache Hadoop)启动。数据节点和节点管理器未以伪集群模式启动(Apache Hadoop)

在日志文件中看到这样的错误:当在其上启动节点管理器节点没有足够的资源w.r.t yarn.scheduler.minimum-allocation-vcoresyarn.scheduler.minimum-allocation-mb配置

***2017-08-22 17:15:08,403 ERROR org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Unexpected error starting NodeStatusUpdater 
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN signal from Resourcemanager ,Registration of NodeManager failed, Message from ResourceManager: NodeManager from archit doesn't satisfy minimum allocations, Sending SHUTDOWN signal to the NodeManager.*** 

    at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:278) 
    at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:197) 
    at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) 
    at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) 
    at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:272) 
    at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) 
    at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:496) 
    at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:543) 
2017-08-22 17:15:08,404 INFO org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl failed in state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: 

回答

0

的“ResourceManager: NodeManager from archit doesn't satisfy minimum allocations”的错误能够被看见。

减小值yarn.scheduler.minimum-allocation-vcoresyarn.scheduler.minimum-allocation-mb然后重新启动纱线。

+0

如何降低yarn.scheduler.minimum-allocation-vcores和yarn.scheduler.minimum-allocation-mb的值你可以请指导我我开始hadoop –

+0

什么是当前的参数值,什么是容量集群节点? – Shubhangi

+0

请参阅https://issues.apache.org/jira/browse/YARN-7283 – Giorgio