2021年 04月 26日 星期一 09:15:07 CST Starting regionserver on slave1
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 30280
max locked memory (kbytes, -l) 16384
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes (-u) 30280
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
2021-04-26 09:15:08,973 INFO [main] util.VersionInfo: HBase 1.3.1
2021-04-26 09:15:08,973 INFO [main] util.VersionInfo: Source code repository git://mantonov-mbp1/Users/mantonov/hbase revision=930b9a55528fe45d8edce7af42fef2d35e77677a
2021-04-26 09:15:08,974 INFO [main] util.VersionInfo: Compiled by mantonov on Thu Apr 6 19:36:54 PDT 2017
2021-04-26 09:15:08,974 INFO [main] util.VersionInfo: From source with checksum a34b810bed77b3a56af797405bea7c78
2021-04-26 09:15:09,215 INFO [main] util.ServerCommandLine: env:PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
2021-04-26 09:15:09,216 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hadoop-regionserver-slave1.log
2021-04-26 09:15:09,216 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/usr/local/hbase/pids
2021-04-26 09:15:09,216 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:PermSize=128m -XX:MaxPermSize=128m
2021-04-26 09:15:09,216 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/local/java/jdk/
2021-04-26 09:15:09,216 INFO [main] util.ServerCommandLine: env:DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1001/bus
2021-04-26 09:15:09,216 INFO [main] util.ServerCommandLine: env:LANG=zh_CN.UTF-8
2021-04-26 09:15:09,216 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=8
2021-04-26 09:15:09,216 INFO [main] util.ServerCommandLine: env:MAIL=/var/mail/hadoop
2021-04-26 09:15:09,216 INFO [main] util.ServerCommandLine: env:LOGNAME=hadoop
2021-04-26 09:15:09,216 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS=
2021-04-26 09:15:09,216 INFO [main] util.ServerCommandLine: env:PWD=/usr/local/hbase
2021-04-26 09:15:09,216 INFO [main] util.ServerCommandLine: env:LANGUAGE=zh_CN:zh
2021-04-26 09:15:09,216 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/local/hadoop/etc/hadoop
2021-04-26 09:15:09,216 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash
2021-04-26 09:15:09,216 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA
2021-04-26 09:15:09,216 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true
2021-04-26 09:15:09,216 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hadoop
2021-04-26 09:15:09,216 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/usr/local/hbase/pids/hbase-hadoop-regionserver.znode
2021-04-26 09:15:09,216 INFO [main] util.ServerCommandLine: env:SSH_CLIENT=192.168.214.179 33974 22
2021-04-26 09:15:09,216 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/usr/local/hbase/logs
2021-04-26 09:15:09,216 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hadoop-regionserver-slave1
2021-04-26 09:15:09,216 INFO [main] util.ServerCommandLine: env:OLDPWD=/home/hadoop
2021-04-26 09:15:09,216 INFO [main] util.ServerCommandLine: env:USER=hadoop
2021-04-26 09:15:09,217 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/local/hbase/conf:/usr/local/java/jdk//lib/tools.jar:/usr/local/hbase:/usr/local/hbase/lib/activation-1.1.jar:/usr/local/hbase/lib/aopalliance-1.0.jar:/usr/local/hbase/lib/apacheds-i18n-2.0.0-M15.jar:/usr/local/hbase/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/local/hbase/lib/api-asn1-api-1.0.0-M20.jar:/usr/local/hbase/lib/api-util-1.0.0-M20.jar:/usr/local/hbase/lib/asm-3.1.jar:/usr/local/hbase/lib/avro-1.7.4.jar:/usr/local/hbase/lib/commons-beanutils-1.7.0.jar:/usr/local/hbase/lib/commons-beanutils-core-1.8.0.jar:/usr/local/hbase/lib/commons-cli-1.2.jar:/usr/local/hbase/lib/commons-codec-1.9.jar:/usr/local/hbase/lib/commons-collections-3.2.2.jar:/usr/local/hbase/lib/commons-compress-1.4.1.jar:/usr/local/hbase/lib/commons-configuration-1.6.jar:/usr/local/hbase/lib/commons-daemon-1.0.13.jar:/usr/local/hbase/lib/commons-digester-1.8.jar:/usr/local/hbase/lib/commons-el-1.0.jar:/usr/local/hbase/lib/commons-httpclient-3.1.jar:/usr/local/hbase/lib/commons-io-2.4.jar:/usr/local/hbase/lib/commons-lang-2.6.jar:/usr/local/hbase/lib/commons-logging-1.2.jar:/usr/local/hbase/lib/commons-math-2.2.jar:/usr/local/hbase/lib/commons-math3-3.1.1.jar:/usr/local/hbase/lib/commons-net-3.1.jar:/usr/local/hbase/lib/disruptor-3.3.0.jar:/usr/local/hbase/lib/findbugs-annotations-1.3.9-1.jar:/usr/local/hbase/lib/guava-12.0.1.jar:/usr/local/hbase/lib/guice-3.0.jar:/usr/local/hbase/lib/guice-servlet-3.0.jar:/usr/local/hbase/lib/hadoop-annotations-2.5.1.jar:/usr/local/hbase/lib/hadoop-auth-2.5.1.jar:/usr/local/hbase/lib/hadoop-client-2.5.1.jar:/usr/local/hbase/lib/hadoop-common-2.5.1.jar:/usr/local/hbase/lib/hadoop-hdfs-2.5.1.jar:/usr/local/hbase/lib/hadoop-mapreduce-client-app-2.5.1.jar:/usr/local/hbase/lib/hadoop-mapreduce-client-common-2.5.1.jar:/usr/local/hbase/lib/hadoop-mapreduce-client-core-2.5.1.jar:/usr/local/hbase/lib/hadoop-mapreduce-client-jobclient-2.5.1.jar:/usr/local/hbase/lib/hadoop-mapreduce-client-shuffle-2.5.1.jar:/usr/local/hbase/lib/hadoop-yarn-api-2.5.1.jar:/usr/local/hbase/lib/hadoop-yarn-client-2.5.1.jar:/usr/local/hbase/lib/hadoop-yarn-common-2.5.1.jar:/usr/local/hbase/lib/hadoop-yarn-server-common-2.5.1.jar:/usr/local/hbase/lib/hbase-annotations-1.3.1.jar:/usr/local/hbase/lib/hbase-annotations-1.3.1-tests.jar:/usr/local/hbase/lib/hbase-client-1.3.1.jar:/usr/local/hbase/lib/hbase-common-1.3.1.jar:/usr/local/hbase/lib/hbase-common-1.3.1-tests.jar:/usr/local/hbase/lib/hbase-examples-1.3.1.jar:/usr/local/hbase/lib/hbase-external-blockcache-1.3.1.jar:/usr/local/hbase/lib/hbase-hadoop2-compat-1.3.1.jar:/usr/local/hbase/lib/hbase-hadoop-compat-1.3.1.jar:/usr/local/hbase/lib/hbase-it-1.3.1.jar:/usr/local/hbase/lib/hbase-it-1.3.1-tests.jar:/usr/local/hbase/lib/hbase-prefix-tree-1.3.1.jar:/usr/local/hbase/lib/hbase-procedure-1.3.1.jar:/usr/local/hbase/lib/hbase-protocol-1.3.1.jar:/usr/local/hbase/lib/hbase-resource-bundle-1.3.1.jar:/usr/local/hbase/lib/hbase-rest-1.3.1.jar:/usr/local/hbase/lib/hbase-server-1.3.1.jar:/usr/local/hbase/lib/hbase-server-1.3.1-tests.jar:/usr/local/hbase/lib/hbase-shell-1.3.1.jar:/usr/local/hbase/lib/hbase-thrift-1.3.1.jar:/usr/local/hbase/lib/htrace-core-3.1.0-incubating.jar:/usr/local/hbase/lib/httpclient-4.2.5.jar:/usr/local/hbase/lib/httpcore-4.4.1.jar:/usr/local/hbase/lib/jackson-core-asl-1.9.13.jar:/usr/local/hbase/lib/jackson-jaxrs-1.9.13.jar:/usr/local/hbase/lib/jackson-mapper-asl-1.9.13.jar:/usr/local/hbase/lib/jackson-xc-1.9.13.jar:/usr/local/hbase/lib/jamon-runtime-2.4.1.jar:/usr/local/hbase/lib/jasper-compiler-5.5.23.jar:/usr/local/hbase/lib/jasper-runtime-5.5.23.jar:/usr/local/hbase/lib/javax.inject-1.jar:/usr/local/hbase/lib/java-xmlbuilder-0.4.jar:/usr/local/hbase/lib/jaxb-api-2.2.2.jar:/usr/local/hbase/lib/jaxb-impl-2.2.3-1.jar:/usr/local/hbase/lib/jcodings-1.0.8.jar:/usr/local/hbase/lib/jersey-client-1.9.jar:/usr/local/hbase/lib/jersey-core-1.9.jar:/usr/local/hbase/lib/jersey-guice-1.9.jar:/usr/local/hbase/lib/jersey-json-1.9.jar:/usr/local/hbase/lib/jersey-server-1.9.jar:/usr/local/hbase/lib/jets3t-0.9.0.jar:/usr/local/hbase/lib/jettison-1.3.3.jar:/usr/local/hbase/lib/jetty-6.1.26.jar:/usr/local/hbase/lib/jetty-sslengine-6.1.26.jar:/usr/local/hbase/lib/jetty-util-6.1.26.jar:/usr/local/hbase/lib/joni-2.1.2.jar:/usr/local/hbase/lib/jruby-complete-1.6.8.jar:/usr/local/hbase/lib/jsch-0.1.42.jar:/usr/local/hbase/lib/jsp-2.1-6.1.14.jar:/usr/local/hbase/lib/jsp-api-2.1-6.1.14.jar:/usr/local/hbase/lib/junit-4.12.jar:/usr/local/hbase/lib/leveldbjni-all-1.8.jar:/usr/local/hbase/lib/libthrift-0.9.3.jar:/usr/local/hbase/lib/log4j-1.2.17.jar:/usr/local/hbase/lib/metrics-core-2.2.0.jar:/usr/local/hbase/lib/netty-all-4.0.23.Final.jar:/usr/local/hbase/lib/paranamer-2.3.jar:/usr/local/hbase/lib/protobuf-java-2.5.0.jar:/usr/local/hbase/lib/servlet-api-2.5-6.1.14.jar:/usr/local/hbase/lib/servlet-api-2.5.jar:/usr/local/hbase/lib/slf4j-api-1.7.7.jar:/usr/local/hbase/lib/slf4j-log4j12-1.7.5.jar:/usr/local/hbase/lib/snappy-java-1.0.4.1.jar:/usr/local/hbase/lib/spymemcached-2.11.6.jar:/usr/local/hbase/lib/xmlenc-0.52.jar:/usr/local/hbase/lib/xz-1.0.jar:/usr/local/hbase/lib/zookeeper-3.4.6.jar::/usr/local/hadoop/etc/hadoop
2021-04-26 09:15:09,217 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -XX:PermSize=128m -XX:MaxPermSize=128m
2021-04-26 09:15:09,217 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false
2021-04-26 09:15:09,217 INFO [main] util.ServerCommandLine: env:SSH_CONNECTION=192.168.214.179 33974 192.168.214.180 22
2021-04-26 09:15:09,217 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0
2021-04-26 09:15:09,217 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS
2021-04-26 09:15:09,217 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-XX:+UseConcMarkSweepGC -XX:PermSize=128m -XX:MaxPermSize=128m -Dhbase.log.dir=/usr/local/hbase/logs -Dhbase.log.file=hbase-hadoop-regionserver-slave1.log -Dhbase.home.dir=/usr/local/hbase -Dhbase.id.str=hadoop -Dhbase.root.logger=INFO,RFA -Dhbase.security.logger=INFO,RFAS
2021-04-26 09:15:09,217 INFO [main] util.ServerCommandLine: env:HBASE_START_FILE=/usr/local/hbase/pids/hbase-hadoop-regionserver.autorestart
2021-04-26 09:15:09,217 INFO [main] util.ServerCommandLine: env:XDG_RUNTIME_DIR=/run/user/1001
2021-04-26 09:15:09,217 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/local/hbase
2021-04-26 09:15:09,217 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS=
2021-04-26 09:15:09,217 INFO [main] util.ServerCommandLine: env:SHLVL=3
2021-04-26 09:15:09,217 INFO [main] util.ServerCommandLine: env:HOME=/home/hadoop
2021-04-26 09:15:09,217 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4
2021-04-26 09:15:09,217 INFO [main] util.ServerCommandLine: vmName=Java HotSpot(TM) 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.201-b09
2021-04-26 09:15:09,217 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -XX:+UseConcMarkSweepGC, -XX:PermSize=128m, -XX:MaxPermSize=128m, -Dhbase.log.dir=/usr/local/hbase/logs, -Dhbase.log.file=hbase-hadoop-regionserver-slave1.log, -Dhbase.home.dir=/usr/local/hbase, -Dhbase.id.str=hadoop, -Dhbase.root.logger=INFO,RFA, -Dhbase.security.logger=INFO,RFAS]
2021-04-26 09:15:09,277 WARN [main] util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2021-04-26 09:15:09,368 INFO [main] regionserver.RSRpcServices: regionserver/slave1/192.168.214.180:16020 server-side HConnection retries=350
2021-04-26 09:15:09,444 INFO [main] ipc.SimpleRpcScheduler: Using fifo as user call queue, count=3
2021-04-26 09:15:09,460 INFO [main] ipc.RpcServer: regionserver/slave1/192.168.214.180:16020: started 10 reader(s) listening on port=16020
2021-04-26 09:15:09,950 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks
2021-04-26 09:15:10,062 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=master:2181,slave1:2181,slave2:2181,slave3:2181,slave4:2181
2021-04-26 09:15:10,066 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
2021-04-26 09:15:10,066 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=slave1
2021-04-26 09:15:10,066 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_201
2021-04-26 09:15:10,066 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
2021-04-26 09:15:10,066 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/local/java/jdk/jre
2021-04-26 09:15:10,066 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/local/hbase/conf:/usr/local/java/jdk//lib/tools.jar:/usr/local/hbase:/usr/local/hbase/lib/activation-1.1.jar:/usr/local/hbase/lib/aopalliance-1.0.jar:/usr/local/hbase/lib/apacheds-i18n-2.0.0-M15.jar:/usr/local/hbase/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/local/hbase/lib/api-asn1-api-1.0.0-M20.jar:/usr/local/hbase/lib/api-util-1.0.0-M20.jar:/usr/local/hbase/lib/asm-3.1.jar:/usr/local/hbase/lib/avro-1.7.4.jar:/usr/local/hbase/lib/commons-beanutils-1.7.0.jar:/usr/local/hbase/lib/commons-beanutils-core-1.8.0.jar:/usr/local/hbase/lib/commons-cli-1.2.jar:/usr/local/hbase/lib/commons-codec-1.9.jar:/usr/local/hbase/lib/commons-collections-3.2.2.jar:/usr/local/hbase/lib/commons-compress-1.4.1.jar:/usr/local/hbase/lib/commons-configuration-1.6.jar:/usr/local/hbase/lib/commons-daemon-1.0.13.jar:/usr/local/hbase/lib/commons-digester-1.8.jar:/usr/local/hbase/lib/commons-el-1.0.jar:/usr/local/hbase/lib/commons-httpclient-3.1.jar:/usr/local/hbase/lib/commons-io-2.4.jar:/usr/local/hbase/lib/commons-lang-2.6.jar:/usr/local/hbase/lib/commons-logging-1.2.jar:/usr/local/hbase/lib/commons-math-2.2.jar:/usr/local/hbase/lib/commons-math3-3.1.1.jar:/usr/local/hbase/lib/commons-net-3.1.jar:/usr/local/hbase/lib/disruptor-3.3.0.jar:/usr/local/hbase/lib/findbugs-annotations-1.3.9-1.jar:/usr/local/hbase/lib/guava-12.0.1.jar:/usr/local/hbase/lib/guice-3.0.jar:/usr/local/hbase/lib/guice-servlet-3.0.jar:/usr/local/hbase/lib/hadoop-annotations-2.5.1.jar:/usr/local/hbase/lib/hadoop-auth-2.5.1.jar:/usr/local/hbase/lib/hadoop-client-2.5.1.jar:/usr/local/hbase/lib/hadoop-common-2.5.1.jar:/usr/local/hbase/lib/hadoop-hdfs-2.5.1.jar:/usr/local/hbase/lib/hadoop-mapreduce-client-app-2.5.1.jar:/usr/local/hbase/lib/hadoop-mapreduce-client-common-2.5.1.jar:/usr/local/hbase/lib/hadoop-mapreduce-client-core-2.5.1.jar:/usr/local/hbase/lib/hadoop-mapreduce-client-jobclient-2.5.1.jar:/usr/local/hbase/lib/hadoop-mapreduce-client-shuffle-2.5.1.jar:/usr/local/hbase/lib/hadoop-yarn-api-2.5.1.jar:/usr/local/hbase/lib/hadoop-yarn-client-2.5.1.jar:/usr/local/hbase/lib/hadoop-yarn-common-2.5.1.jar:/usr/local/hbase/lib/hadoop-yarn-server-common-2.5.1.jar:/usr/local/hbase/lib/hbase-annotations-1.3.1.jar:/usr/local/hbase/lib/hbase-annotations-1.3.1-tests.jar:/usr/local/hbase/lib/hbase-client-1.3.1.jar:/usr/local/hbase/lib/hbase-common-1.3.1.jar:/usr/local/hbase/lib/hbase-common-1.3.1-tests.jar:/usr/local/hbase/lib/hbase-examples-1.3.1.jar:/usr/local/hbase/lib/hbase-external-blockcache-1.3.1.jar:/usr/local/hbase/lib/hbase-hadoop2-compat-1.3.1.jar:/usr/local/hbase/lib/hbase-hadoop-compat-1.3.1.jar:/usr/local/hbase/lib/hbase-it-1.3.1.jar:/usr/local/hbase/lib/hbase-it-1.3.1-tests.jar:/usr/local/hbase/lib/hbase-prefix-tree-1.3.1.jar:/usr/local/hbase/lib/hbase-procedure-1.3.1.jar:/usr/local/hbase/lib/hbase-protocol-1.3.1.jar:/usr/local/hbase/lib/hbase-resource-bundle-1.3.1.jar:/usr/local/hbase/lib/hbase-rest-1.3.1.jar:/usr/local/hbase/lib/hbase-server-1.3.1.jar:/usr/local/hbase/lib/hbase-server-1.3.1-tests.jar:/usr/local/hbase/lib/hbase-shell-1.3.1.jar:/usr/local/hbase/lib/hbase-thrift-1.3.1.jar:/usr/local/hbase/lib/htrace-core-3.1.0-incubating.jar:/usr/local/hbase/lib/httpclient-4.2.5.jar:/usr/local/hbase/lib/httpcore-4.4.1.jar:/usr/local/hbase/lib/jackson-core-asl-1.9.13.jar:/usr/local/hbase/lib/jackson-jaxrs-1.9.13.jar:/usr/local/hbase/lib/jackson-mapper-asl-1.9.13.jar:/usr/local/hbase/lib/jackson-xc-1.9.13.jar:/usr/local/hbase/lib/jamon-runtime-2.4.1.jar:/usr/local/hbase/lib/jasper-compiler-5.5.23.jar:/usr/local/hbase/lib/jasper-runtime-5.5.23.jar:/usr/local/hbase/lib/javax.inject-1.jar:/usr/local/hbase/lib/java-xmlbuilder-0.4.jar:/usr/local/hbase/lib/jaxb-api-2.2.2.jar:/usr/local/hbase/lib/jaxb-impl-2.2.3-1.jar:/usr/local/hbase/lib/jcodings-1.0.8.jar:/usr/local/hbase/lib/jersey-client-1.9.jar:/usr/local/hbase/lib/jersey-core-1.9.jar:/usr/local/hbase/lib/jersey-guice-1.9.jar:/usr/local/hbase/lib/jersey-json-1.9.jar:/usr/local/hbase/lib/jersey-server-1.9.jar:/usr/local/hbase/lib/jets3t-0.9.0.jar:/usr/local/hbase/lib/jettison-1.3.3.jar:/usr/local/hbase/lib/jetty-6.1.26.jar:/usr/local/hbase/lib/jetty-sslengine-6.1.26.jar:/usr/local/hbase/lib/jetty-util-6.1.26.jar:/usr/local/hbase/lib/joni-2.1.2.jar:/usr/local/hbase/lib/jruby-complete-1.6.8.jar:/usr/local/hbase/lib/jsch-0.1.42.jar:/usr/local/hbase/lib/jsp-2.1-6.1.14.jar:/usr/local/hbase/lib/jsp-api-2.1-6.1.14.jar:/usr/local/hbase/lib/junit-4.12.jar:/usr/local/hbase/lib/leveldbjni-all-1.8.jar:/usr/local/hbase/lib/libthrift-0.9.3.jar:/usr/local/hbase/lib/log4j-1.2.17.jar:/usr/local/hbase/lib/metrics-core-2.2.0.jar:/usr/local/hbase/lib/netty-all-4.0.23.Final.jar:/usr/local/hbase/lib/paranamer-2.3.jar:/usr/local/hbase/lib/protobuf-java-2.5.0.jar:/usr/local/hbase/lib/servlet-api-2.5-6.1.14.jar:/usr/local/hbase/lib/servlet-api-2.5.jar:/usr/local/hbase/lib/slf4j-api-1.7.7.jar:/usr/local/hbase/lib/slf4j-log4j12-1.7.5.jar:/usr/local/hbase/lib/snappy-java-1.0.4.1.jar:/usr/local/hbase/lib/spymemcached-2.11.6.jar:/usr/local/hbase/lib/xmlenc-0.52.jar:/usr/local/hbase/lib/xz-1.0.jar:/usr/local/hbase/lib/zookeeper-3.4.6.jar::/usr/local/hadoop/etc/hadoop
2021-04-26 09:15:10,066 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2021-04-26 09:15:10,066 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
2021-04-26 09:15:10,066 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
2021-04-26 09:15:10,066 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux
2021-04-26 09:15:10,066 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64
2021-04-26 09:15:10,066 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=4.18.0-25-generic
2021-04-26 09:15:10,066 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hadoop
2021-04-26 09:15:10,066 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/home/hadoop
2021-04-26 09:15:10,066 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/usr/local/hbase
2021-04-26 09:15:10,066 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=master:2181,slave1:2181,slave2:2181,slave3:2181,slave4:2181 sessionTimeout=240000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@1f6c9cd8
2021-04-26 09:15:10,074 INFO [main-SendThread(slave2:2181)] zookeeper.ClientCnxn: Opening socket connection to server slave2/192.168.214.181:2181. Will not attempt to authenticate using SASL (unknown error)
2021-04-26 09:15:10,076 INFO [main-SendThread(slave2:2181)] zookeeper.ClientCnxn: Socket connection established to slave2/192.168.214.181:2181, initiating session
2021-04-26 09:15:10,108 INFO [main-SendThread(slave2:2181)] zookeeper.ClientCnxn: Session establishment complete on server slave2/192.168.214.181:2181, sessionid = 0x200000526bc0003, negotiated timeout = 100000
2021-04-26 09:15:10,117 INFO [RpcServer.responder] ipc.RpcServer: RpcServer.responder: starting
2021-04-26 09:15:10,117 INFO [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: starting
2021-04-26 09:15:10,177 INFO [main] mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2021-04-26 09:15:10,179 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined
2021-04-26 09:15:10,185 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter)
2021-04-26 09:15:10,185 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter)
2021-04-26 09:15:10,186 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver
2021-04-26 09:15:10,186 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2021-04-26 09:15:10,186 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2021-04-26 09:15:10,195 INFO [main] http.HttpServer: Jetty bound to port 16030
2021-04-26 09:15:10,195 INFO [main] mortbay.log: jetty-6.1.26
2021-04-26 09:15:10,382 INFO [main] mortbay.log: Started SelectChannelConnector@0.0.0.0:16030
2021-04-26 09:15:10,434 INFO [regionserver/slave1/192.168.214.180:16020] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x2208047f connecting to ZooKeeper ensemble=master:2181,slave1:2181,slave2:2181,slave3:2181,slave4:2181
2021-04-26 09:15:10,434 INFO [regionserver/slave1/192.168.214.180:16020] zookeeper.ZooKeeper: Initiating client connection, connectString=master:2181,slave1:2181,slave2:2181,slave3:2181,slave4:2181 sessionTimeout=240000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@2be9d757
2021-04-26 09:15:10,435 INFO [regionserver/slave1/192.168.214.180:16020-SendThread(slave1:2181)] zookeeper.ClientCnxn: Opening socket connection to server slave1/192.168.214.180:2181. Will not attempt to authenticate using SASL (unknown error)
2021-04-26 09:15:10,435 INFO [regionserver/slave1/192.168.214.180:16020-SendThread(slave1:2181)] zookeeper.ClientCnxn: Socket connection established to slave1/192.168.214.180:2181, initiating session
2021-04-26 09:15:10,465 INFO [regionserver/slave1/192.168.214.180:16020-SendThread(slave1:2181)] zookeeper.ClientCnxn: Session establishment complete on server slave1/192.168.214.180:2181, sessionid = 0x10000058a180002, negotiated timeout = 100000
2021-04-26 09:15:10,502 INFO [regionserver/slave1/192.168.214.180:16020] regionserver.HRegionServer: ClusterId : 8fdfa755-d5da-4a44-b9da-c1ad0a0c8778
2021-04-26 09:15:10,547 INFO [regionserver/slave1/192.168.214.180:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=758.7 M, globalMemStoreLimitLowMark=720.7 M, maxHeap=1.9 G
2021-04-26 09:15:10,550 INFO [regionserver/slave1/192.168.214.180:16020] regionserver.HRegionServer: CompactionChecker runs every 10sec
2021-04-26 09:15:10,554 FATAL [regionserver/slave1/192.168.214.180:16020] regionserver.HRegionServer: ABORTING region server slave1,16020,1619399709556: Unhandled: Failed suppression of fs shutdown hook: org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@39d4aec4
java.lang.RuntimeException: Failed suppression of fs shutdown hook: org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@39d4aec4
at org.apache.hadoop.hbase.regionserver.ShutdownHook.suppressHdfsShutdownHook(ShutdownHook.java:205)
at org.apache.hadoop.hbase.regionserver.ShutdownHook.install(ShutdownHook.java:84)
at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:918)
at java.lang.Thread.run(Thread.java:748)
2021-04-26 09:15:10,555 FATAL [regionserver/slave1/192.168.214.180:16020] regionserver.HRegionServer: RegionServer abort: loaded coprocessors are: []
2021-04-26 09:15:10,565 INFO [regionserver/slave1/192.168.214.180:16020] regionserver.HRegionServer: Dump of metrics as JSON on abort: {
"beans" : [ {
"name" : "java.lang:type=Memory",
"modelerType" : "sun.management.MemoryImpl",
"ObjectPendingFinalizationCount" : 0,
"NonHeapMemoryUsage" : {
"committed" : 39149568,
"init" : 2555904,
"max" : -1,
"used" : 38397288
},
"Verbose" : false,
"HeapMemoryUsage" : {
"committed" : 125698048,
"init" : 130023424,
"max" : 1988820992,
"used" : 33191008
},
"ObjectName" : "java.lang:type=Memory"
} ],
"beans" : [ {
"name" : "Hadoop:service=HBase,name=RegionServer,sub=IPC",
"modelerType" : "RegionServer,sub=IPC",
"tag.Context" : "regionserver",
"tag.Hostname" : "slave1",
"queueSize" : 0,
"numCallsInGeneralQueue" : 0,
"numCallsInReplicationQueue" : 0,
"numCallsInPriorityQueue" : 0,
"numOpenConnections" : 0,
"numActiveHandler" : 0,
"numGeneralCallsDropped" : 0,
"numLifoModeSwitches" : 0,
"receivedBytes" : 0,
"exceptions.RegionMovedException" : 0,
"exceptions.multiResponseTooLarge" : 0,
"authenticationSuccesses" : 0,
"authorizationFailures" : 0,
"TotalCallTime_num_ops" : 0,
"TotalCallTime_min" : 0,
"TotalCallTime_max" : 0,
"TotalCallTime_mean" : 0,
"TotalCallTime_25th_percentile" : 0,
"TotalCallTime_median" : 0,
"TotalCallTime_75th_percentile" : 0,
"TotalCallTime_90th_percentile" : 0,
"TotalCallTime_95th_percentile" : 0,
"TotalCallTime_98th_percentile" : 0,
"TotalCallTime_99th_percentile" : 0,
"TotalCallTime_99.9th_percentile" : 0,
"exceptions.RegionTooBusyException" : 0,
"exceptions.FailedSanityCheckException" : 0,
"ResponseSize_num_ops" : 0,
"ResponseSize_min" : 0,
"ResponseSize_max" : 0,
"ResponseSize_mean" : 0,
"ResponseSize_25th_percentile" : 0,
"ResponseSize_median" : 0,
"ResponseSize_75th_percentile" : 0,
"ResponseSize_90th_percentile" : 0,
"ResponseSize_95th_percentile" : 0,
"ResponseSize_98th_percentile" : 0,
"ResponseSize_99th_percentile" : 0,
"ResponseSize_99.9th_percentile" : 0,
"exceptions.UnknownScannerException" : 0,
"exceptions.OutOfOrderScannerNextException" : 0,
"exceptions" : 0,
"ProcessCallTime_num_ops" : 0,
"ProcessCallTime_min" : 0,
"ProcessCallTime_max" : 0,
"ProcessCallTime_mean" : 0,
"ProcessCallTime_25th_percentile" : 0,
"ProcessCallTime_median" : 0,
"ProcessCallTime_75th_percentile" : 0,
"ProcessCallTime_90th_percentile" : 0,
"ProcessCallTime_95th_percentile" : 0,
"ProcessCallTime_98th_percentile" : 0,
"ProcessCallTime_99th_percentile" : 0,
"ProcessCallTime_99.9th_percentile" : 0,
"authenticationFallbacks" : 0,
"exceptions.NotServingRegionException" : 0,
"exceptions.callQueueTooBig" : 0,
"authorizationSuccesses" : 0,
"exceptions.ScannerResetException" : 0,
"RequestSize_num_ops" : 0,
"RequestSize_min" : 0,
"RequestSize_max" : 0,
"RequestSize_mean" : 0,
"RequestSize_25th_percentile" : 0,
"RequestSize_median" : 0,
"RequestSize_75th_percentile" : 0,
"RequestSize_90th_percentile" : 0,
"RequestSize_95th_percentile" : 0,
"RequestSize_98th_percentile" : 0,
"RequestSize_99th_percentile" : 0,
"RequestSize_99.9th_percentile" : 0,
"sentBytes" : 0,
"QueueCallTime_num_ops" : 0,
"QueueCallTime_min" : 0,
"QueueCallTime_max" : 0,
"QueueCallTime_mean" : 0,
"QueueCallTime_25th_percentile" : 0,
"QueueCallTime_median" : 0,
"QueueCallTime_75th_percentile" : 0,
"QueueCallTime_90th_percentile" : 0,
"QueueCallTime_95th_percentile" : 0,
"QueueCallTime_98th_percentile" : 0,
"QueueCallTime_99th_percentile" : 0,
"QueueCallTime_99.9th_percentile" : 0,
"authenticationFailures" : 0
} ],
"beans" : [ ],
"beans" : [ ]
}
2021-04-26 09:15:10,565 INFO [regionserver/slave1/192.168.214.180:16020] regionserver.HRegionServer: STOPPED: Unhandled: Failed suppression of fs shutdown hook: org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@39d4aec4
2021-04-26 09:15:10,565 INFO [regionserver/slave1/192.168.214.180:16020] regionserver.HRegionServer: Stopping infoServer
2021-04-26 09:15:10,566 INFO [regionserver/slave1/192.168.214.180:16020] mortbay.log: Stopped SelectChannelConnector@0.0.0.0:16030
2021-04-26 09:15:10,666 INFO [regionserver/slave1/192.168.214.180:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager abruptly.
2021-04-26 09:15:10,667 INFO [regionserver/slave1/192.168.214.180:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager abruptly.
2021-04-26 09:15:10,667 INFO [regionserver/slave1/192.168.214.180:16020] regionserver.HRegionServer: aborting server slave1,16020,1619399709556
2021-04-26 09:15:10,668 INFO [regionserver/slave1/192.168.214.180:16020] client.ConnectionManager$HConnectionImplementation: Closing zookeeper sessionid=0x10000058a180002
2021-04-26 09:15:10,682 INFO [regionserver/slave1/192.168.214.180:16020] zookeeper.ZooKeeper: Session: 0x10000058a180002 closed
2021-04-26 09:15:10,682 INFO [regionserver/slave1/192.168.214.180:16020-EventThread] zookeeper.ClientCnxn: EventThread shut down
2021-04-26 09:15:10,687 INFO [regionserver/slave1/192.168.214.180:16020] regionserver.HRegionServer: stopping server slave1,16020,1619399709556; all regions closed.
2021-04-26 09:15:10,687 INFO [regionserver/slave1/192.168.214.180:16020] regionserver.Leases: regionserver/slave1/192.168.214.180:16020 closing leases
2021-04-26 09:15:10,687 INFO [regionserver/slave1/192.168.214.180:16020] regionserver.Leases: regionserver/slave1/192.168.214.180:16020 closed leases
2021-04-26 09:15:10,688 INFO [regionserver/slave1/192.168.214.180:16020] hbase.ChoreService: Chore service for: slave1,16020,1619399709556 had [[ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS]] on shutdown
2021-04-26 09:15:10,688 INFO [regionserver/slave1/192.168.214.180:16020] regionserver.CompactSplitThread: Waiting for Split Thread to finish...
2021-04-26 09:15:10,689 INFO [regionserver/slave1/192.168.214.180:16020] regionserver.CompactSplitThread: Waiting for Merge Thread to finish...
2021-04-26 09:15:10,689 INFO [regionserver/slave1/192.168.214.180:16020] regionserver.CompactSplitThread: Waiting for Large Compaction Thread to finish...
2021-04-26 09:15:10,689 INFO [regionserver/slave1/192.168.214.180:16020] regionserver.CompactSplitThread: Waiting for Small Compaction Thread to finish...
2021-04-26 09:15:10,689 INFO [regionserver/slave1/192.168.214.180:16020] ipc.RpcServer: Stopping server on 16020
2021-04-26 09:15:10,689 INFO [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: stopping
2021-04-26 09:15:10,689 INFO [RpcServer.responder] ipc.RpcServer: RpcServer.responder: stopped
2021-04-26 09:15:10,690 INFO [RpcServer.responder] ipc.RpcServer: RpcServer.responder: stopping
2021-04-26 09:15:10,740 INFO [regionserver/slave1/192.168.214.180:16020] zookeeper.ZooKeeper: Session: 0x200000526bc0003 closed
2021-04-26 09:15:10,740 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down
2021-04-26 09:15:10,740 INFO [regionserver/slave1/192.168.214.180:16020] regionserver.HRegionServer: stopping server slave1,16020,1619399709556; zookeeper connection closed.
2021-04-26 09:15:10,740 INFO [regionserver/slave1/192.168.214.180:16020] regionserver.HRegionServer: regionserver/slave1/192.168.214.180:16020 exiting
2021-04-26 09:15:10,740 ERROR [main] regionserver.HRegionServerCommandLine: Region server exiting
java.lang.RuntimeException: HRegionServer Aborted
at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.start(HRegionServerCommandLine.java:68)
at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.run(HRegionServerCommandLine.java:87)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
at org.apache.hadoop.hbase.regionserver.HRegionServer.main(HRegionServer.java:2721)
之前遇过类似的问题，最后排查定位是跟集群之间节点的时间同步有关系。
zkCli.sh
rmr /hbase
高版本zookeeper是
deleteall /hbase
原因网上有搜你FATAL那个进程
(再不好使就不知道了)