详细日志信息如下:
2021-05-22 16:07:26,637 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1621661846120_0009_m_000001 Task Transitioned from SCHEDULED to RUNNING 2021-05-22 16:07:39,840 INFO [Socket Reader #1 for port 40178] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1621661846120_0009 (auth:SIMPLE) 2021-05-22 16:07:39,847 INFO [Socket Reader #1 for port 40178] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1621661846120_0009 (auth:SIMPLE) 2021-05-22 16:07:39,904 INFO [IPC Server handler 0 on 40178] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1621661846120_0009_m_000003 asked for a task 2021-05-22 16:07:39,907 INFO [IPC Server handler 0 on 40178] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1621661846120_0009_m_000003 given task: attempt_1621661846120_0009_m_000001_0 2021-05-22 16:07:39,929 INFO [IPC Server handler 1 on 40178] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1621661846120_0009_m_000002 asked for a task 2021-05-22 16:07:39,929 INFO [IPC Server handler 1 on 40178] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1621661846120_0009_m_000002 given task: attempt_1621661846120_0009_m_000000_0 2021-05-22 16:07:47,573 INFO [IPC Server handler 4 on 40178] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1621661846120_0009_m_000001_0 is : 0.0 2021-05-22 16:07:47,573 INFO [IPC Server handler 5 on 40178] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1621661846120_0009_m_000000_0 is : 0.0 2021-05-22 16:07:47,785 FATAL [IPC Server handler 12 on 40178] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1621661846120_0009_m_000000_0 - exited : java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1 at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:322) at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:535) at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61) at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
求大佬指教!在线等
可以参考这篇文章,希望对你有帮助:hadoop——subprocess failed with code_wangzhiqing3的专栏-CSDN博客
您好,我是有问必答小助手,您的问题已经有小伙伴解答了,您看下是否解决,可以追评进行沟通哦~
如果有您比较满意的答案 / 帮您提供解决思路的答案,可以点击【采纳】按钮,给回答的小伙伴一些鼓励哦~~
ps:问答VIP仅需29元,即可享受5次/月 有问必答服务,了解详情>>>https://vip.csdn.net/askvip?utm_source=1146287632