2021-05-20 17:19:00,425 WARN [master/rhel145-2-fgos:16000:becomeActiveMaster] regionserver.HRegion: Failed initialize of region= master:store,,1.1595e783b53d99cd5eef43b6debb2682., starting to roll back memstore
java.io.EOFException: Cannot seek after EOF
at org.apache.hadoop.hdfs.DFSInputStream.seek(DFSInputStream.java:1648)
at org.apache.hadoop.fs.FSDataInputStream.seek(FSDataInputStream.java:66)
at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogReader.initInternal(ProtobufLogReader.java:211)
at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogReader.initReader(ProtobufLogReader.java:173)
at org.apache.hadoop.hbase.regionserver.wal.ReaderBase.init(ReaderBase.java:64)
at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogReader.init(ProtobufLogReader.java:168)
at org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:323)
at org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:305)
at org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:293)
at org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:429)
at org.apache.hadoop.hbase.regionserver.HRegion.replayRecoveredEdits(HRegion.java:4859)
at org.apache.hadoop.hbase.regionserver.HRegion.replayRecoveredEditsIfAny(HRegion.java:4765)
at org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionInternals(HRegion.java:1014)
at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:956)
at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:7496)
at org.apache.hadoop.hbase.regionserver.HRegion.openHRegionFromTableDir(HRegion.java:7454)
at org.apache.hadoop.hbase.master.region.MasterRegion.open(MasterRegion.java:269)
at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:309)
at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104)
at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:949)
at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2240)
at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:622)
at java.lang.Thread.run(Thread.java:748)
2021-05-20 17:19:00,449 INFO [master/rhel145-2-fgos:16000:becomeActiveMaster] regionserver.HRegion: Drop memstore for Store proc in region master:store,,1.1595e783b53d99cd5eef43b6debb2682. , dropped memstoresize: [dataSize=59508, getHeapSize=77080, getOffHeapSize=0, getCellsCount=229 }
2021-05-20 17:19:00,449 INFO [master/rhel145-2-fgos:16000:becomeActiveMaster] regionserver.HRegion: Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682.
2021-05-20 17:19:00,478 INFO [master/rhel145-2-fgos:16000:becomeActiveMaster] regionserver.HRegion: Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682.
2021-05-20 17:19:00,481 ERROR [master/rhel145-2-fgos:16000:becomeActiveMaster] master.HMaster: Failed to become active master
java.io.EOFException: Cannot seek after EOF
at org.apache.hadoop.hdfs.DFSInputStream.seek(DFSInputStream.java:1648)
at org.apache.hadoop.fs.FSDataInputStream.seek(FSDataInputStream.java:66)
at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogReader.initInternal(ProtobufLogReader.java:211)
at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogReader.initReader(ProtobufLogReader.java:173)
at org.apache.hadoop.hbase.regionserver.wal.ReaderBase.init(ReaderBase.java:64)
at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogReader.init(ProtobufLogReader.java:168)
at org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:323)
at org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:305)
at org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:293)
at org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:429)
at org.apache.hadoop.hbase.regionserver.HRegion.replayRecoveredEdits(HRegion.java:4859)
at org.apache.hadoop.hbase.regionserver.HRegion.replayRecoveredEditsIfAny(HRegion.java:4765)
at org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionInternals(HRegion.java:1014)
at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:956)
at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:7496)
at org.apache.hadoop.hbase.regionserver.HRegion.openHRegionFromTableDir(HRegion.java:7454)
at org.apache.hadoop.hbase.master.region.MasterRegion.open(MasterRegion.java:269)
at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:309)
at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104)
at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:949)
at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2240)
at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:622)
at java.lang.Thread.run(Thread.java:748)
2021-05-20 17:19:00,481 ERROR [master/rhel145-2-fgos:16000:becomeActiveMaster] master.HMaster: ***** ABORTING master rhel145-2-fgos,16000,1621502322999: Unhandled exception. Starting shutdown. *****
java.io.EOFException: Cannot seek after EOF
at org.apache.hadoop.hdfs.DFSInputStream.seek(DFSInputStream.java:1648)
at org.apache.hadoop.fs.FSDataInputStream.seek(FSDataInputStream.java:66)
at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogReader.initInternal(ProtobufLogReader.java:211)
at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogReader.initReader(ProtobufLogReader.java:173)
at org.apache.hadoop.hbase.regionserver.wal.ReaderBase.init(ReaderBase.java:64)
at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogReader.init(ProtobufLogReader.java:168)
at org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:323)
at org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:305)
at org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:293)
at org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:429)
at org.apache.hadoop.hbase.regionserver.HRegion.replayRecoveredEdits(HRegion.java:4859)
at org.apache.hadoop.hbase.regionserver.HRegion.replayRecoveredEditsIfAny(HRegion.java:4765)
at org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionInternals(HRegion.java:1014)
at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:956)
at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:7496)
at org.apache.hadoop.hbase.regionserver.HRegion.openHRegionFromTableDir(HRegion.java:7454)
at org.apache.hadoop.hbase.master.region.MasterRegion.open(MasterRegion.java:269)
at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:309)
at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104)
at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:949)
at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2240)
at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:622)
at java.lang.Thread.run(Thread.java:748)
2021-05-20 17:19:00,482 INFO [master/rhel145-2-fgos:16000:becomeActiveMaster] regionserver.HRegionServer: ***** STOPPING region server 'rhel145-2-fgos,16000,1621502322999' *****
2021-05-20 17:19:00,482 INFO [master/rhel145-2-fgos:16000:becomeActiveMaster] regionserver.HRegionServer: STOPPED: Stopped by master/rhel145-2-fgos:16000:becomeActiveMaster
2021-05-20 17:19:00,560 INFO [rhel145-2-fgos:16000.splitLogManager..Chore.1] hbase.ScheduledChore: Chore: SplitLogManager Timeout Monitor was stopped
2021-05-20 17:19:01,000 INFO [master/rhel145-2-fgos:16000] ipc.NettyRpcServer: Stopping server on /0:0:0:0:0:0:0:0%0:16000
2021-05-20 17:19:01,004 INFO [master/rhel145-2-fgos:16000] regionserver.HRegionServer: Stopping infoServer
2021-05-20 17:19:01,023 INFO [master/rhel145-2-fgos:16000] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@1de9b505{/,null,UNAVAILABLE}{file:/opt/hbase/hbase-2.3.1/hbase-webapps/master}
2021-05-20 17:19:01,029 INFO [master/rhel145-2-fgos:16000] server.AbstractConnector: Stopped ServerConnector@2eeb0f9b{HTTP/1.1,[http/1.1]}{0.0.0.0:16010}
2021-05-20 17:19:01,030 INFO [master/rhel145-2-fgos:16000] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@4c6007fb{/static,file:///opt/hbase/hbase-2.3.1/hbase-webapps/static/,UNAVAILABLE}
2021-05-20 17:19:01,030 INFO [master/rhel145-2-fgos:16000] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@80bfdc6{/logs,file:///opt/hbase/hbase-2.3.1/logs/,UNAVAILABLE}
2021-05-20 17:19:01,032 INFO [master/rhel145-2-fgos:16000] regionserver.HRegionServer: aborting server rhel145-2-fgos,16000,1621502322999
2021-05-20 17:19:01,033 INFO [master/rhel145-2-fgos:16000] regionserver.HRegionServer: stopping server rhel145-2-fgos,16000,1621502322999; all regions closed.
2021-05-20 17:19:01,033 INFO [master/rhel145-2-fgos:16000] hbase.ChoreService: Chore service for: master/rhel145-2-fgos:16000 had [] on shutdown
2021-05-20 17:19:01,035 WARN [master/rhel145-2-fgos:16000] master.ActiveMasterManager: Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null
2021-05-20 17:19:01,035 INFO [master/rhel145-2-fgos:16000] hbase.ChoreService: Chore service for: rhel145-2-fgos:16000.splitLogManager. had [] on shutdown
2021-05-20 17:19:01,139 INFO [ReadOnlyZKClient-rhel123-1-fgos:2181,rhel143-2-fgos:2181,rhel63-3-fgos:2181@0x5b772ad8] zookeeper.ZooKeeper: Session: 0x2004643c1fb184d closed
2021-05-20 17:19:01,141 INFO [ReadOnlyZKClient-rhel123-1-fgos:2181,rhel143-2-fgos:2181,rhel63-3-fgos:2181@0x5b772ad8-EventThread] zookeeper.ClientCnxn: EventThread shut down for session: 0x2004643c1fb184d
2021-05-20 17:19:01,238 INFO [master/rhel145-2-fgos:16000] zookeeper.ZooKeeper: Session: 0x2004643c1fb184c closed
2021-05-20 17:19:01,238 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down for session: 0x2004643c1fb184c
2021-05-20 17:19:01,238 INFO [master/rhel145-2-fgos:16000] regionserver.HRegionServer: Exiting; stopping=rhel145-2-fgos,16000,1621502322999; zookeeper connection closed.
2021-05-20 17:19:01,239 ERROR [main] master.HMasterCommandLine: Master exiting
java.lang.RuntimeException: HMaster Aborted
at org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:244)
at org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:140)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:149)
at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:3072)
我也遇到相同的问题了,请问解决了吗?
我遇到过一次查看服务器的时候有的文件里面没有内容,删除之后好像就行了