报错背景
sqoop将HBase的数据导入到HDFS
报错现象
20/10/29 17:17:48 INFO mapreduce.Job: Running job: job_1603962187772_0001 20/10/29 17:17:53 INFO mapreduce.Job: Job job_1603962187772_0001 running in uber mode : false 20/10/29 17:17:53 INFO mapreduce.Job: map 0% reduce 0% 20/10/29 17:17:53 INFO mapreduce.Job: Job job_1603962187772_0001 failed with state FAILED due to: Application application_1603962187772_0001 failed 2 times due to AM Container for appattempt_1603962187772_0001_000002 exited with exitCode: 1 For more detailed output, check application tracking page:http://basecoalmine:8088/cluster/app/application_1603962187772_0001Then, click on links to logs of each attempt. Diagnostics: Exception from container-launch. Container id: container_e08_1603962187772_0001_02_000001 Exit code: 1 Stack trace: ExitCodeException exitCode=1: at org.apache.hadoop.util.Shell.runCommand(Shell.java:585) at org.apache.hadoop.util.Shell.run(Shell.java:482) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:776) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Container exited with a non-zero exit code 1 Failing this attempt. Failing the application. 20/10/29 17:17:53 INFO mapreduce.Job: Counters: 0 20/10/29 17:17:53 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead 20/10/29 17:17:53 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 19.4517 seconds (0 bytes/sec) 20/10/29 17:17:53 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead 20/10/29 17:17:53 INFO mapreduce.ImportJobBase: Retrieved 0 records. 20/10/29 17:17:53 ERROR tool.ImportTool: Error during import: Import job failed!
报错原因
不知
报错解决
修改 mapred-site.xml
<property> <name>vix.mapreduce.framework.name</name> <value>yarn</value> </property>
修改 yarn-site.xml
<property> <name>vix.yarn.resourcemanager.address</name> <value>basecoalmine:18040</value> </property> <property> <name>vix.yarn.resourcemanager.scheduler.address</name> <value>basecoalmine:1800</value> </property>