Apache Storm未正常运行，worker.log生成异常

我正在使用Apache Kafka的Apache风暴。使用的喷嘴是卡夫卡喷嘴，但它不会读取卡夫卡主题中的任何内容。我不知道这是否与我在风暴工作人员面临的问题有关。如果您知道任何相关解决方案，请告诉我并通知我。Apache Storm未正常运行，worker.log生成异常

风暴拓扑成功上传到Storm。我拿来的日志和这里是工人们在他们的worker.log文件写着：

java.lang.ExceptionInInitializerError 
    at java.nio.file.FileSystems.getDefault(FileSystems.java:176) ~[?:1.8.0_91] 
    at java.nio.file.Paths.get(Paths.java:84) ~[?:1.8.0_91] 
    at org.apache.storm.util$is_absolute_path_QMARK_.invoke(util.clj:68) ~[storm-core-1.0.1.jar:1.0.1] 
    at org.apache.storm.config$absolute_storm_local_dir.invoke(config.clj:94) ~[storm-core-1.0.1.jar:1.0.1] 
    at org.apache.storm.config$worker_root.invoke(config.clj:290) ~[storm-core-1.0.1.jar:1.0.1] 
    at org.apache.storm.config$worker_root.invoke(config.clj:292) ~[storm-core-1.0.1.jar:1.0.1] 
    at org.apache.storm.config$worker_pids_root.invoke(config.clj:296) ~[storm-core-1.0.1.jar:1.0.1] 
    at org.apache.storm.config$worker_pid_path.invoke(config.clj:304) ~[storm-core-1.0.1.jar:1.0.1] 
    at org.apache.storm.daemon.worker$fn__8450$exec_fn__2461__auto____8451.invoke(worker.clj:592) ~[storm-core-1.0.1.jar:1.0.1] 
    at clojure.lang.AFn.applyToHelper(AFn.java:178) ~[clojure-1.7.0.jar:?] 
    at clojure.lang.AFn.applyTo(AFn.java:144) ~[clojure-1.7.0.jar:?] 
    at clojure.core$apply.invoke(core.clj:630) ~[clojure-1.7.0.jar:?] 
    at org.apache.storm.daemon.worker$fn__8450$mk_worker__8545.doInvoke(worker.clj:583) [storm-core-1.0.1.jar:1.0.1] 
    at clojure.lang.RestFn.invoke(RestFn.java:512) [clojure-1.7.0.jar:?] 
    at org.apache.storm.daemon.worker$_main.invoke(worker.clj:771) [storm-core-1.0.1.jar:1.0.1] 
    at clojure.lang.AFn.applyToHelper(AFn.java:165) [clojure-1.7.0.jar:?] 
    at clojure.lang.AFn.applyTo(AFn.java:144) [clojure-1.7.0.jar:?] 
    at org.apache.storm.daemon.worker.main(Unknown Source) [storm-core-1.0.1.jar:1.0.1] 

Caused by: java.security.PrivilegedActionException 
    at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_91] 
    at java.nio.file.FileSystems$DefaultFileSystemHolder.defaultFileSystem(FileSystems.java:96) ~[?:1.8.0_91] 
    at java.nio.file.FileSystems$DefaultFileSystemHolder.<clinit>(FileSystems.java:90) ~[?:1.8.0_91] 
    ... 18 more 

Caused by: sun.nio.fs.UnixException: No such file or directory 
    at sun.nio.fs.UnixNativeDispatcher.getcwd(Native Method) ~[?:1.8.0_91] 
    at sun.nio.fs.UnixFileSystem.<init>(UnixFileSystem.java:67) ~[?:1.8.0_91] 
    at sun.nio.fs.LinuxFileSystem.<init>(LinuxFileSystem.java:39) ~[?:1.8.0_91] 
    at sun.nio.fs.LinuxFileSystemProvider.newFileSystem(LinuxFileSystemProvider.java:46) ~[?:1.8.0_91] 
    at sun.nio.fs.LinuxFileSystemProvider.newFileSystem(LinuxFileSystemProvider.java:39) ~[?:1.8.0_91] 
    at sun.nio.fs.UnixFileSystemProvider.<init>(UnixFileSystemProvider.java:56) ~[?:1.8.0_91] 
    at sun.nio.fs.LinuxFileSystemProvider.<init>(LinuxFileSystemProvider.java:41) ~[?:1.8.0_91] 
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:1.8.0_91] 
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[?:1.8.0_91] 
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[?:1.8.0_91] 
    at java.lang.reflect.Constructor.newInstance(Constructor.java:423) ~[?:1.8.0_91] 
    at java.lang.Class.newInstance(Class.java:442) ~[?:1.8.0_91] 
    at sun.nio.fs.DefaultFileSystemProvider.createProvider(DefaultFileSystemProvider.java:48) ~[?:1.8.0_91] 
    at sun.nio.fs.DefaultFileSystemProvider.create(DefaultFileSystemProvider.java:63) ~[?:1.8.0_91] 
    at java.nio.file.FileSystems$DefaultFileSystemHolder.getDefaultProvider(FileSystems.java:108) ~[?:1.8.0_91] 
    at java.nio.file.FileSystems$DefaultFileSystemHolder.access$000(FileSystems.java:89) ~[?:1.8.0_91] 
    at java.nio.file.FileSystems$DefaultFileSystemHolder$1.run(FileSystems.java:98) ~[?:1.8.0_91] 
    at java.nio.file.FileSystems$DefaultFileSystemHolder$1.run(FileSystems.java:96) ~[?:1.8.0_91] 
    at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_91] 
    at java.nio.file.FileSystems$DefaultFileSystemHolder.defaultFileSystem(FileSystems.java:96) ~[?:1.8.0_91] 
    at java.nio.file.FileSystems$DefaultFileSystemHolder.<clinit>(FileSystems.java:90) ~[?:1.8.0_91] 
    ... 18 more 

2016-07-24 13:14:33.154 o.a.s.util [ERROR] Halting process: ("Error on initialization") 
java.lang.RuntimeException: ("Error on initialization") 
    at org.apache.storm.util$exit_process_BANG_.doInvoke(util.clj:341) [storm-core-1.0.1.jar:1.0.1] 
    at clojure.lang.RestFn.invoke(RestFn.java:423) [clojure-1.7.0.jar:?] 
    at org.apache.storm.daemon.worker$fn__8450$mk_worker__8545.doInvoke(worker.clj:583) [storm-core-1.0.1.jar:1.0.1] 
    at clojure.lang.RestFn.invoke(RestFn.java:512) [clojure-1.7.0.jar:?] 
    at org.apache.storm.daemon.worker$_main.invoke(worker.clj:771) [storm-core-1.0.1.jar:1.0.1] 
    at clojure.lang.AFn.applyToHelper(AFn.java:165) [clojure-1.7.0.jar:?] 
    at clojure.lang.AFn.applyTo(AFn.java:144) [clojure-1.7.0.jar:?] 
    at org.apache.storm.daemon.worker.main(Unknown Source) [storm-core-1.0.1.jar:1.0.1]

来源

2016-07-24 M.SH

看起来你必须授予访问某个文件的权限。你在拓扑中使用I/O吗？ – matthiasbe

我知道存在与权限相关的内容，但我无法弄清楚它是什么。我将Apache Storm和Apache Kafka更新为最新版本，然后出现此错误。我正在使用kafka-spout从Kafka主题阅读并将结果写入文件，没有任何问题。 –

这可能与此问题无关，但一旦我升级到最新的卡夫卡和风暴，KafkaSpout就停止处理消息。我的修复记录在这里http://stackoverflow.com/questions/38198961/storm-kafkaspout-stopped-to-consume-messages-from-kafka-topic – YaRiK

的解决方案是检查风暴的本地集群中任务并行的数量。在他们的最新版本中，他们为此任务并行属性添加了最大数量。这会自动删除额外工作者的文件夹。这只是将工人数量从3个改为2个或更少，以便正常执行。

int workers = 2;

conf.setMaxTaskParallelism（workers）;

谢谢大家的意见。

来源

2016-08-22 14:51:38

Apache Storm未正常运行，worker.log生成异常

回答

相关问题