2017-04-20 64 views
0

我的sqoop导入为拼花板文件失败。我试着通过错误和在线搜索,但无法解决它。我试着通过设置“-Dmapreduce.job.user.classpath.first = true”来查看前面的讨论。即使这没有帮助。提前致谢。Sqoop导入为拼花板文件失败

sqoop import -Dmapreduce.job.user.classpath.first=true \ 
--connect jdbc:mysql://ip/dbname \ 
--username username \ 
--password password \ 
--table orders \ 
--warehouse-dir \ 
--driver com.mysql.jdbc.Driver 
--as-parquetfile 

错误:

Application application_1492001640512_0078 failed 2 times due to AM Container for appattempt_149 
2001640512_0078_000002 exited with exitCode: 1 
For more detailed output, check application tracking page:http://ec2-52-44-197-32.compute-1.amazo 
naws.com:8088/cluster/app/application_1492001640512_0078Then, click on links to logs of each atte 
mpt. 
Diagnostics: Exception from container-launch. 
Container id: container_e49_1492001640512_0078_02_000001 
Exit code: 1 
Stack trace: ExitCodeException exitCode=1: 
at org.apache.hadoop.util.Shell.runCommand(Shell.java:576) 
at org.apache.hadoop.util.Shell.run(Shell.java:487) 
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:753) 
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(Def 
aultContainerExecutor.java:212) 
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.ca 
ll(ContainerLaunch.java:303) 
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.ca 
ll(ContainerLaunch.java:82) 
at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) 
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
at java.lang.Thread.run(Thread.java:745) 
Container exited with a non-zero exit code 1 
Failing this attempt. Failing the application. 

PS:一切似乎除了Parquet.I试图导入文本文件的工作,为的Avro文件...

回答

1

而不是使用--warehouse的-dir尝试使用--target-dir。