mrjob项目在hadoop运行时报错:subprocess failed with code 1

详细日志信息如下:

2021-05-22 16:07:26,637 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1621661846120_0009_m_000001 Task Transitioned from SCHEDULED to RUNNING
2021-05-22 16:07:39,840 INFO [Socket Reader #1 for port 40178] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1621661846120_0009 (auth:SIMPLE)
2021-05-22 16:07:39,847 INFO [Socket Reader #1 for port 40178] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1621661846120_0009 (auth:SIMPLE)
2021-05-22 16:07:39,904 INFO [IPC Server handler 0 on 40178] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1621661846120_0009_m_000003 asked for a task
2021-05-22 16:07:39,907 INFO [IPC Server handler 0 on 40178] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1621661846120_0009_m_000003 given task: attempt_1621661846120_0009_m_000001_0
2021-05-22 16:07:39,929 INFO [IPC Server handler 1 on 40178] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1621661846120_0009_m_000002 asked for a task
2021-05-22 16:07:39,929 INFO [IPC Server handler 1 on 40178] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1621661846120_0009_m_000002 given task: attempt_1621661846120_0009_m_000000_0
2021-05-22 16:07:47,573 INFO [IPC Server handler 4 on 40178] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1621661846120_0009_m_000001_0 is : 0.0
2021-05-22 16:07:47,573 INFO [IPC Server handler 5 on 40178] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1621661846120_0009_m_000000_0 is : 0.0
2021-05-22 16:07:47,785 FATAL [IPC Server handler 12 on 40178] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1621661846120_0009_m_000000_0 - exited : java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
	at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:322)
	at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:535)
	at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
	at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

求大佬指教!在线等

可以参考这篇文章,希望对你有帮助:hadoop——subprocess failed with code_wangzhiqing3的专栏-CSDN博客

您好,我是有问必答小助手,您的问题已经有小伙伴解答了,您看下是否解决,可以追评进行沟通哦~

如果有您比较满意的答案 / 帮您提供解决思路的答案,可以点击【采纳】按钮,给回答的小伙伴一些鼓励哦~~

ps:问答VIP仅需29元,即可享受5次/月 有问必答服务,了解详情>>>https://vip.csdn.net/askvip?utm_source=1146287632