###问题遇到的现象和发生背景
YARN.NODEMANAGER.RESOURCE.CPU-VCORES=88;
YARN.NODEMANAGER.RESOURCE.MEMORY-MB=360G;
YARN.SCHEDULER.MINIMUM-ALLOCATION-MB=2G;
YARN.SCHEDULER.MINIMUM-ALLOCATION-VCORES=1;
CDH 6.3.2(Hadoop 3.0)集群上执行一个HIVE SQL或SPARK SQL，如下图日志所示，从任务提交到执行MR任务， 需要70-80秒， 正常情况下，只需5-6秒。任务能正常执行
完毕。执行时，指定了队列且队列资源（CPU & 内存）均较为空闲。请问，调整哪些参数，可以将时间缩短至正常范畴内？
###我的解答思路和尝试过的方法
调整MR APPLICATION MASTER的OPT参数，调整为850M，内存为2G.
###我想要达到的结果
将时间缩短至正常5-6秒
###以下是截取的LOG信息：
###1. Hive Log:
hive> select count(*) from xxx.xxxx_xxxx_xxxx;
Query ID = root_20220112091551_9ce7eb8c-3dc8-44df-95e4-568f6eb3a2b5
22/01/12 09:15:54 INFO client.RMProxy: Connecting to ResourceManager at hgf3bdpnn02/192.168.200.10:8032
22/01/12 09:15:54 INFO client.RMProxy: Connecting to ResourceManager at hgf3bdpnn02/192.168.200.10:8032
Starting Job = job_1641369401904_26848, Tracking URL = http://hgf3bdpnn02:8088/proxy/application_1641369401904_26848/
Kill Command = /opt/cloudera/parcels/CDH-6.3.2-1.cdh6.3.2.p0.1605554/lib/hadoop/bin/hadoop job -kill job_1641369401904_26848
Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 1
2022-01-12 09:17:24,688 Stage-1 map = 0%, reduce = 0%
2022-01-12 09:18:24,778 Stage-1 map = 0%, reduce = 0%
2022-01-12 09:18:30,906 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 7.13 sec
2022-01-12 09:19:11,684 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 10.21 sec
MapReduce Total cumulative CPU time: 13 seconds 640 msec
Ended Job = job_1641369401904_26848
MapReduce Jobs Launched:
Stage-Stage-1: Map: 1 Reduce: 1 Cumulative CPU: 13.64 sec HDFS Read: 18652512 HDFS Write: 106 HDFS EC Read: 0 SUCCESS
Total MapReduce CPU Time Spent: 13 seconds 640 msec
401495
###2. Hadoop Job Log
FinalStatus Reported by AM: SUCCEEDED
Started: Wed Jan 12 09:15:56 +0800 2022
Launched: Wed Jan 12 09:15:57 +0800 2022
Finished: Wed Jan 12 09:19:26 +0800 2022
Elapsed: 3mins, 30sec
Tracking URL: History
Log Aggregation Status: SUCCEEDED
###3. Log Type: syslog
Log Upload Time: Wed Jan 12 09:19:33 +0800 2022
Log Length: 70743
2022-01-12 09:16:10,660 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1641369401904_26848_000001
2022-01-12 09:16:12,684 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster:
/************************************************************
[system properties]
os.name: Linux
os.version: 3.10.0-862.el7.x86_64
java.home: /usr/java/jdk1.8.0_181-cloudera/jre
java.runtime.version: 1.8.0_181-b13
java.vendor: Oracle Corporation
java.version: 1.8.0_181
java.vm.name: Java HotSpot(TM) 64-Bit Server VM
java.class.path:
user.name: nobody
************************************************************/
2022-01-12 09:16:13,739 INFO [main] org.apache.hadoop.security.SecurityUtil: Updating Configuration
2022-01-12 09:16:14,792 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens: [Kind: YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id { id: 26848 cluster_timestamp: 1641369401904 } attemptId: 1 } keyId: -1381542009)]
2022-01-12 09:16:14,831 INFO [main] org.apache.hadoop.conf.Configuration: resource-types.xml not found
2022-01-12 09:16:14,832 INFO [main] org.apache.hadoop.yarn.util.resource.ResourceUtils: Unable to find 'resource-types.xml'.
2022-01-12 09:16:15,628 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in config org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter
2022-01-12 09:16:15,631 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter
2022-01-12 09:16:23,750 WARN [main] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2022-01-12 09:16:24,810 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.jobhistory.EventType for class org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
2022-01-12 09:16:24,811 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
2022-01-12 09:16:24,811 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
2022-01-12 09:16:24,812 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
2022-01-12 09:16:24,812 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
2022-01-12 09:16:24,816 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
2022-01-12 09:16:24,816 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
2022-01-12 09:16:24,817 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
2022-01-12 09:16:25,612 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://ns1:8020]
2022-01-12 09:16:25,630 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://ns1:8020]
2022-01-12 09:16:25,678 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://ns1:8020]
2022-01-12 09:16:25,730 INFO [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Emitting job history data to the timeline server is not enabled
2022-01-12 09:16:25,777 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
2022-01-12 09:16:28,735 WARN [main] org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties
2022-01-12 09:16:29,711 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s).
2022-01-12 09:16:29,711 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics system started
2022-01-12 09:16:29,726 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token for job_1641369401904_26848 to jobTokenSecretManager
2022-01-12 09:16:31,710 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing job_1641369401904_26848 because: not enabled; too much RAM;
2022-01-12 09:16:31,739 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for job job_1641369401904_26848 = 18639751. Number of splits = 1
2022-01-12 09:16:31,740 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces for job job_1641369401904_26848 = 1
2022-01-12 09:16:31,740 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1641369401904_26848Job Transitioned from NEW to INITED
2022-01-12 09:16:31,741 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching normal, non-uberized, multi-container job job_1641369401904_26848.
2022-01-12 09:16:32,619 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue queueCapacity: 100 scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler
2022-01-12 09:16:32,634 INFO [Socket Reader #1 for port 16679] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 16679
2022-01-12 09:16:35,660 INFO [main] org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB to the server
2022-01-12 09:16:35,661 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2022-01-12 09:16:35,661 INFO [IPC Server listener on 16679] org.apache.hadoop.ipc.Server: IPC Server listener on 16679: starting
2022-01-12 09:16:35,667 INFO [main] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Instantiated MRClientService at hgf3bdpadc02/192.168.200.34:16679
2022-01-12 09:16:36,626 INFO [main] org.eclipse.jetty.util.log: Logging initialized @35781ms
2022-01-12 09:16:42,646 INFO [main] org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets.
2022-01-12 09:16:42,676 INFO [main] org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.mapreduce is not defined
2022-01-12 09:16:42,685 INFO [main] org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2022-01-12 09:16:43,635 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context mapreduce
2022-01-12 09:16:43,636 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context static
2022-01-12 09:16:43,639 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/*
2022-01-12 09:16:43,639 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /ws/*
2022-01-12 09:16:48,644 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules
2022-01-12 09:16:48,645 INFO [main] org.apache.hadoop.http.HttpServer2: Jetty bound to port 12782
2022-01-12 09:16:48,647 INFO [main] org.eclipse.jetty.server.Server: jetty-9.3.25.v20180904, build timestamp: 2018-09-05T05:11:46+08:00, git hash: 3ce520221d0240229c862b122d2b06c12a625732
2022-01-12 09:16:49,617 INFO [main] org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.s.ServletContextHandler@42210be1{/static,jar:file:/data04/yarn/nm/filecache/10/3.0.0-cdh6.3.2-mr-framework.tar.gz/hadoop-yarn-common-3.0.0-cdh6.3.2.jar!/webapps/static,AVAILABLE}
2022-01-12 09:17:12,635 INFO [main] org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.w.WebAppContext@4da1f38a{/,file:///data02/yarn/nm/usercache/root/appcache/application_1641369401904_26848/container_1641369401904_26848_01_000001/tmp/jetty-0.0.0.0-12782-mapreduce-_-any-5462558378322261565.dir/webapp/,AVAILABLE}{/mapreduce}
2022-01-12 09:17:13,598 INFO [main] org.eclipse.jetty.server.AbstractConnector: Started ServerConnector@68ddd415{HTTP/1.1,[http/1.1]}{0.0.0.0:12782}
2022-01-12 09:17:13,598 INFO [main] org.eclipse.jetty.server.Server: Started @72753ms
2022-01-12 09:17:13,599 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Web app mapreduce started at 12782
2022-01-12 09:17:13,719 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue queueCapacity: 3000 scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler
2022-01-12 09:17:13,727 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator: JOB_CREATE job_1641369401904_26848
2022-01-12 09:17:13,731 INFO [Socket Reader #1 for port 24352] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 24352
2022-01-12 09:17:13,738 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2022-01-12 09:17:14,605 INFO [IPC Server listener on 24352] org.apache.hadoop.ipc.Server: IPC Server listener on 24352: starting
2022-01-12 09:17:14,768 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: nodeBlacklistingEnabled:true
2022-01-12 09:17:14,768 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: maxTaskFailuresPerNode is 3
2022-01-12 09:17:14,768 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: blacklistDisablePercent is 33
2022-01-12 09:17:14,772 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: 0% of the mappers will be scheduled using OPPORTUNISTIC containers
2022-01-12 09:17:17,697 INFO [main] org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at hgf3bdpnn02/192.168.200.10:8030
2022-01-12 09:17:19,701 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: maxContainerCapability: <memory:16384, vCores:48>
2022-01-12 09:17:19,702 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue: root.default
2022-01-12 09:17:20,607 INFO [main] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Upper limit on the thread pool size is 500
2022-01-12 09:17:20,607 INFO [main] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: The thread pool initial size is 10
2022-01-12 09:17:20,733 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1641369401904_26848Job Transitioned from INITED to SETUP
2022-01-12 09:17:20,743 INFO [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_SETUP
2022-01-12 09:17:20,750 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1641369401904_26848Job Transitioned from SETUP to RUNNING
2022-01-12 09:17:22,610 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1641369401904_26848_m_000000 Task Transitioned from NEW to SCHEDULED
2022-01-12 09:17:22,620 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1641369401904_26848_r_000000 Task Transitioned from NEW to SCHEDULED
2022-01-12 09:17:22,622 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1641369401904_26848_m_000000_0 TaskAttempt Transitioned from NEW to UNASSIGNED
2022-01-12 09:17:22,622 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1641369401904_26848_r_000000_0 TaskAttempt Transitioned from NEW to UNASSIGNED
2022-01-12 09:17:23,599 INFO [IPC Server handler 0 on 16679] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Getting task report for MAP job_1641369401904_26848. Report-size will be 1
2022-01-12 09:17:23,621 INFO [Thread-59] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: mapResourceRequest:<memory:4096, vCores:1>
2022-01-12 09:17:23,645 INFO [Thread-59] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: reduceResourceRequest:<memory:1024, vCores:1>
2022-01-12 09:17:23,680 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event Writer setup for JobId: job_1641369401904_26848, File: hdfs://ns1:8020/user/root/.staging/job_1641369401904_26848/job_1641369401904_26848_1.jhist
2022-01-12 09:17:24,596 INFO [IPC Server handler 0 on 16679] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Getting task report for REDUCE job_1641369401904_26848. Report-size will be 1
2022-01-12 09:17:24,614 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:1 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0
2022-01-12 09:17:24,635 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1641369401904_26848: ask=3 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:77918, vCores:16> knownNMs=7
2022-01-12 09:17:24,639 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:77918, vCores:16>
2022-01-12 09:17:24,640 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
2022-01-12 09:17:25,666 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:77918, vCores:16>
2022-01-12 09:17:25,666 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
2022-01-12 09:17:27,644 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1
2022-01-12 09:17:28,634 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1641369401904_26848_01_000002 to attempt_1641369401904_26848_m_000000_0
2022-01-12 09:17:28,635 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:73822, vCores:15>
2022-01-12 09:17:28,635 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
2022-01-12 09:17:28,635 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:1 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:1
2022-01-12 09:17:29,631 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-jar file on the remote FS is hdfs://ns1/user/root/.staging/job_1641369401904_26848/job.jar
2022-01-12 09:17:29,636 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-conf file on the remote FS is /user/root/.staging/job_1641369401904_26848/job.xml
2022-01-12 09:17:29,648 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #0 tokens and #1 secret keys for NM use for launching container
2022-01-12 09:17:29,648 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of containertokens_dob is 1
2022-01-12 09:17:29,648 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting shuffle token in serviceData
2022-01-12 09:17:29,717 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapred.JobConf: Task java-opts do not specify heap size. Setting task attempt jvm max heap size to -Xmx3277m
2022-01-12 09:17:29,721 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1641369401904_26848_m_000000_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
2022-01-12 09:17:29,724 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1641369401904_26848: ask=3 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:73822, vCores:15> knownNMs=7
2022-01-12 09:17:29,726 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1641369401904_26848_01_000002 taskAttempt attempt_1641369401904_26848_m_000000_0
2022-01-12 09:17:29,728 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1641369401904_26848_m_000000_0
2022-01-12 09:17:30,711 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1641369401904_26848_m_000000_0 : 13562
2022-01-12 09:17:30,713 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1641369401904_26848_m_000000_0] using containerId: [container_1641369401904_26848_01_000002 on NM: [hgf3bdpdn02:8041]
2022-01-12 09:17:30,717 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1641369401904_26848_m_000000_0 TaskAttempt Transitioned from ASSIGNED to RUNNING
2022-01-12 09:17:30,717 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1641369401904_26848_m_000000 Task Transitioned from SCHEDULED to RUNNING
2022-01-12 09:17:45,729 INFO [Socket Reader #1 for port 24352] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1641369401904_26848 (auth:SIMPLE)
2022-01-12 09:17:46,591 INFO [IPC Server handler 7 on 24352] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1641369401904_26848_m_000002 asked for a task
2022-01-12 09:17:46,592 INFO [IPC Server handler 7 on 24352] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1641369401904_26848_m_000002 given task: attempt_1641369401904_26848_m_000000_0
2022-01-12 09:18:07,587 INFO [Socket Reader #1 for port 24352] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1641369401904_26848 (auth:SIMPLE)
2022-01-12 09:18:29,766 INFO [IPC Server handler 7 on 24352] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1641369401904_26848_m_000000_0 is : 0.0
2022-01-12 09:18:30,734 INFO [IPC Server handler 4 on 24352] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1641369401904_26848_m_000000_0 is : 1.0
2022-01-12 09:18:30,745 INFO [IPC Server handler 17 on 24352] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgment from attempt_1641369401904_26848_m_000000_0
2022-01-12 09:18:30,748 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1641369401904_26848_m_000000_0 TaskAttempt Transitioned from RUNNING to SUCCESS_FINISHING_CONTAINER
2022-01-12 09:18:30,758 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with attempt attempt_1641369401904_26848_m_000000_0
2022-01-12 09:18:30,759 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1641369401904_26848_m_000000 Task Transitioned from RUNNING to SUCCEEDED
2022-01-12 09:18:30,762 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 1
2022-01-12 09:18:30,818 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:1 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:1 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:1
2022-01-12 09:18:30,820 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:73822, vCores:15>
2022-01-12 09:18:30,820 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold reached. Scheduling reduces.
2022-01-12 09:18:30,820 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: All maps assigned. Ramping up all remaining reduces:1
2022-01-12 09:18:30,820 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:1 AssignedMaps:1 AssignedReds:0 CompletedMaps:1 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:1
2022-01-12 09:18:31,822 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1641369401904_26848: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:73822, vCores:15> knownNMs=7
2022-01-12 09:18:32,829 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_1641369401904_26848_01_000002
2022-01-12 09:18:32,829 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1
2022-01-12 09:18:32,830 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1641369401904_26848_m_000000_0:
2022-01-12 09:18:32,830 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned to reduce
2022-01-12 09:18:32,830 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1641369401904_26848_01_000003 to attempt_1641369401904_26848_r_000000_0
2022-01-12 09:18:32,830 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:1 CompletedMaps:1 CompletedReds:0 ContAlloc:2 ContRel:0 HostLocal:0 RackLocal:1
2022-01-12 09:18:32,830 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1641369401904_26848_m_000000_0 TaskAttempt Transitioned from SUCCESS_FINISHING_CONTAINER to SUCCEEDED
2022-01-12 09:18:32,840 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapred.JobConf: Task java-opts do not specify heap size. Setting task attempt jvm max heap size to -Xmx820m
2022-01-12 09:18:32,841 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1641369401904_26848_r_000000_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
2022-01-12 09:18:32,842 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_COMPLETED for container container_1641369401904_26848_01_000002 taskAttempt attempt_1641369401904_26848_m_000000_0
2022-01-12 09:18:32,842 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1641369401904_26848_01_000003 taskAttempt attempt_1641369401904_26848_r_000000_0
2022-01-12 09:18:32,842 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1641369401904_26848_r_000000_0
2022-01-12 09:18:32,852 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1641369401904_26848_r_000000_0 : 13562
2022-01-12 09:18:32,853 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1641369401904_26848_r_000000_0] using containerId: [container_1641369401904_26848_01_000003 on NM: [hgf3bdpdn02:8041]
2022-01-12 09:18:32,853 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1641369401904_26848_r_000000_0 TaskAttempt Transitioned from ASSIGNED to RUNNING
2022-01-12 09:18:32,853 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator: ATTEMPT_START task_1641369401904_26848_r_000000
2022-01-12 09:18:32,853 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1641369401904_26848_r_000000 Task Transitioned from SCHEDULED to RUNNING
2022-01-12 09:18:33,832 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1641369401904_26848: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:75870, vCores:15> knownNMs=7
2022-01-12 09:18:44,590 INFO [Socket Reader #1 for port 24352] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1641369401904_26848 (auth:SIMPLE)
2022-01-12 09:18:44,626 INFO [IPC Server handler 24 on 24352] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1641369401904_26848_r_000003 asked for a task
2022-01-12 09:18:44,627 INFO [IPC Server handler 24 on 24352] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1641369401904_26848_r_000003 given task: attempt_1641369401904_26848_r_000000_0
2022-01-12 09:18:58,687 INFO [Socket Reader #1 for port 24352] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1641369401904_26848 (auth:SIMPLE)
2022-01-12 09:18:58,691 INFO [IPC Server handler 14 on 24352] org.apache.hadoop.mapred.TaskAttemptListenerImpl: MapCompletionEvents request from attempt_1641369401904_26848_r_000000_0. startIndex 0 maxEvents 10000
2022-01-12 09:19:00,587 INFO [IPC Server handler 12 on 24352] org.apache.hadoop.mapred.TaskAttemptListenerImpl: MapCompletionEvents request from attempt_1641369401904_26848_r_000000_0. startIndex 1 maxEvents 10000
2022-01-12 09:19:01,600 INFO [IPC Server handler 24 on 24352] org.apache.hadoop.mapred.TaskAttemptListenerImpl: MapCompletionEvents request from attempt_1641369401904_26848_r_000000_0. startIndex 1 maxEvents 10000
2022-01-12 09:19:01,621 INFO [IPC Server handler 14 on 24352] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1641369401904_26848_r_000000_0 is : 0.0
2022-01-12 09:19:01,665 INFO [IPC Server handler 4 on 24352] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1641369401904_26848_r_000000_0 is : 0.0
2022-01-12 09:19:11,607 INFO [IPC Server handler 14 on 24352] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1641369401904_26848_r_000000_0 is : 1.0
2022-01-12 09:19:23,580 INFO [Socket Reader #1 for port 24352] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1641369401904_26848 (auth:SIMPLE)
2022-01-12 09:19:23,586 INFO [IPC Server handler 12 on 24352] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1641369401904_26848_r_000000_0 is : 1.0
2022-01-12 09:19:25,588 INFO [IPC Server handler 12 on 24352] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1641369401904_26848_r_000000_0 is : 1.0
2022-01-12 09:19:25,592 INFO [IPC Server handler 24 on 24352] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgment from attempt_1641369401904_26848_r_000000_0
2022-01-12 09:19:25,594 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1641369401904_26848_r_000000_0 TaskAttempt Transitioned from RUNNING to SUCCESS_FINISHING_CONTAINER
2022-01-12 09:19:25,594 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with attempt attempt_1641369401904_26848_r_000000_0
2022-01-12 09:19:25,594 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1641369401904_26848_r_000000 Task Transitioned from RUNNING to SUCCEEDED
2022-01-12 09:19:25,595 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 2
2022-01-12 09:19:25,595 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1641369401904_26848Job Transitioned from RUNNING to COMMITTING
2022-01-12 09:19:25,596 INFO [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_COMMIT
2022-01-12 09:19:25,607 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Calling handler for JobFinishedEvent
2022-01-12 09:19:25,607 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1641369401904_26848Job Transitioned from COMMITTING to SUCCEEDED
2022-01-12 09:19:25,608 INFO [Thread-85] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Job finished cleanly, recording last MRAppMaster retry
2022-01-12 09:19:25,608 INFO [Thread-85] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator isAMLastRetry: true
2022-01-12 09:19:25,608 INFO [Thread-85] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: RMCommunicator notified that shouldUnregistered is: true
2022-01-12 09:19:25,608 INFO [Thread-85] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry: true
2022-01-12 09:19:25,608 INFO [Thread-85] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: JobHistoryEventHandler notified that forceJobCompletion is true
2022-01-12 09:19:25,608 INFO [Thread-85] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all the services
2022-01-12 09:19:25,610 INFO [Thread-85] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 0
2022-01-12 09:19:25,698 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://ns1:8020/user/root/.staging/job_1641369401904_26848/job_1641369401904_26848_1.jhist to hdfs://ns1:8020/user/history/done_intermediate/root/job_1641369401904_26848-1641950156442-root-select+count%28*%29+from+eda.ods_eda_lot+%28Stage-1641950365606-1-1-SUCCEEDED-root.default-1641950240674.jhist_tmp
2022-01-12 09:19:25,781 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied from: hdfs://ns1:8020/user/root/.staging/job_1641369401904_26848/job_1641369401904_26848_1.jhist to done location: hdfs://ns1:8020/user/history/done_intermediate/root/job_1641369401904_26848-1641950156442-root-select+count%28*%29+from+eda.ods_eda_lot+%28Stage-1641950365606-1-1-SUCCEEDED-root.default-1641950240674.jhist_tmp
2022-01-12 09:19:25,781 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Set historyUrl to http://hgf3bdpcm02:19888/jobhistory/job/job_1641369401904_26848
2022-01-12 09:19:25,782 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://ns1:8020/user/root/.staging/job_1641369401904_26848/job_1641369401904_26848_1_conf.xml to hdfs://ns1:8020/user/history/done_intermediate/root/job_1641369401904_26848_conf.xml_tmp
2022-01-12 09:19:25,909 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:1 CompletedMaps:1 CompletedReds:1 ContAlloc:2 ContRel:0 HostLocal:0 RackLocal:1
2022-01-12 09:19:26,636 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied from: hdfs://ns1:8020/user/root/.staging/job_1641369401904_26848/job_1641369401904_26848_1_conf.xml to done location: hdfs://ns1:8020/user/history/done_intermediate/root/job_1641369401904_26848_conf.xml_tmp
2022-01-12 09:19:26,642 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://ns1:8020/user/history/done_intermediate/root/job_1641369401904_26848.summary_tmp to hdfs://ns1:8020/user/history/done_intermediate/root/job_1641369401904_26848.summary
2022-01-12 09:19:26,644 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://ns1:8020/user/history/done_intermediate/root/job_1641369401904_26848_conf.xml_tmp to hdfs://ns1:8020/user/history/done_intermediate/root/job_1641369401904_26848_conf.xml
2022-01-12 09:19:26,646 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://ns1:8020/user/history/done_intermediate/root/job_1641369401904_26848-1641950156442-root-select+count%28*%29+from+eda.ods_eda_lot+%28Stage-1641950365606-1-1-SUCCEEDED-root.default-1641950240674.jhist_tmp to hdfs://ns1:8020/user/history/done_intermediate/root/job_1641369401904_26848-1641950156442-root-select+count%28*%29+from+eda.ods_eda_lot+%28Stage-1641950365606-1-1-SUCCEEDED-root.default-1641950240674.jhist
2022-01-12 09:19:26,647 INFO [Thread-85] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped JobHistoryEventHandler. super.stop()
2022-01-12 09:19:26,647 INFO [Thread-85] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1641369401904_26848_r_000000_0
2022-01-12 09:19:26,661 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1641369401904_26848_r_000000_0 TaskAttempt Transitioned from SUCCESS_FINISHING_CONTAINER to SUCCEEDED
2022-01-12 09:19:26,664 INFO [Thread-85] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting job diagnostics to
2022-01-12 09:19:26,664 INFO [Thread-85] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: History url is http://hgf3bdpcm02:19888/jobhistory/job/job_1641369401904_26848
2022-01-12 09:19:26,668 INFO [Thread-85] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Waiting for application to be successfully unregistered.
2022-01-12 09:19:27,670 INFO [Thread-85] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:1 CompletedMaps:1 CompletedReds:1 ContAlloc:2 ContRel:0 HostLocal:0 RackLocal:1
2022-01-12 09:19:27,672 INFO [Thread-85] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging directory hdfs://ns1 /user/root/.staging/job_1641369401904_26848
2022-01-12 09:19:27,675 INFO [Thread-85] org.apache.hadoop.ipc.Server: Stopping server on 24352
2022-01-12 09:19:27,678 INFO [IPC Server listener on 24352] org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 24352
2022-01-12 09:19:27,679 INFO [TaskHeartbeatHandler PingChecker] org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler: TaskHeartbeatHandler thread interrupted
2022-01-12 09:19:27,679 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
2022-01-12 09:19:27,681 INFO [Ping Checker] org.apache.hadoop.yarn.util.AbstractLivelinessMonitor: TaskAttemptFinishingMonitor thread interrupted
2022-01-12 09:19:32,681 INFO [Thread-85] org.apache.hadoop.ipc.Server: Stopping server on 16679
2022-01-12 09:19:32,682 INFO [IPC Server listener on 16679] org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 16679
2022-01-12 09:19:32,682 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
2022-01-12 09:19:32,686 INFO [Thread-85] org.eclipse.jetty.server.handler.ContextHandler: Stopped o.e.j.w.WebAppContext@4da1f38a{/,null,UNAVAILABLE}{/mapreduce}
2022-01-12 09:19:32,690 INFO [Thread-85] org.eclipse.jetty.server.AbstractConnector: Stopped ServerConnector@68ddd415{HTTP/1.1,[http/1.1]}{0.0.0.0:0}