2016-11-04 80 views
1

中退出,非零退出代码1个错误在Hadoop中执行的罐子,我得到以下错误:集装箱MapReduce任务的

16/11/04 18:32:59 INFO mapreduce.Job: Task Id : attempt_1478261728730_0005_m_000000_2, Status : FAILED 
Exception from container-launch. 
Container id: container_1478261728730_0005_01_000004 
Exit code: 1 
Stack trace: ExitCodeException exitCode=1: 
    at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) 
    at org.apache.hadoop.util.Shell.run(Shell.java:455) 
    at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) 
    at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211) 
    at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302) 
    at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82) 
    at java.util.concurrent.FutureTask.run(FutureTask.java:262) 
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) 
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) 
    at java.lang.Thread.run(Thread.java:745) 


Container exited with a non-zero exit code 1 

16/11/04 18:33:09 INFO mapreduce.Job: map 100% reduce 0% 

这是应用程序日志:

Native code library failed to load. 
java.lang.UnsatisfiedLinkError: no opencv_java2411 in java.library.pathopencv_java2411 

我不不知道这是什么意思,有人可以帮忙吗?

+0

更新您的文章与应用程序日志 – BruceWayne

+0

我已经更新了帖子.. @ KrishnaChaitanyaReddy – Mahek

回答

1

您缺少集群节点上的opencv。 有关如何处理此问题的所有详细信息,请参阅here。虽然长话短说,但你需要在你的执行者上安装opencv。你不能以便携的方式将它编译到你的作业的.jar中,因为它是C而不是Java代码。

更新: 请注意,Hadoop执行程序的环境由hadoop-env.sh设置。因此,它需要包含这样一行:

JAVA_LIBRARY_PATH=${JAVA_LIBRARY_PATH}:/etc/opencv/lib

+0

是的,我知道,我已经加载OpenCV的本地路径,但不知何故,它无法加载它。 @Armin Braun – Mahek

+0

@Mahek 3 questions then :) 1.你安装了什么版本的OpenCV? 2.您是否也对所有执行人员这样做? 3.你是如何安装/确保它已加载的? –

+0

OpenCV-2.4.11和我已经发布了关于在这里加载库的问题http://stackoverflow.com/questions/40435812/how-to-set-native-library-path-for-opencv-in-ubuntu?noredirect = 1#comment68119207_40435812 @Armin Braun – Mahek