Hadoop伪分布式无法启动namenode

我在用虚拟机启动hadoop的时候不能启动namenode,调试了很久也没能搞出来,下面是namenode的log文件

hadoop@dblab-VirtualBox:/usr/local/hadoop$ tail -n 100 /usr/local/hadoop/logs/hadoop-hadoop-namenode-dblab-VirtualBox.log
2022-05-25 14:11:35,834 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Clients are to use localhost:9000 to access this namenode/service.
2022-05-25 14:11:36,282 INFO org.apache.hadoop.hdfs.DFSUtil: Starting Web-server for hdfs at: http://0.0.0.0:50070
2022-05-25 14:11:36,417 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2022-05-25 14:11:36,434 INFO org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets.
2022-05-25 14:11:36,446 INFO org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.namenode is not defined
2022-05-25 14:11:36,454 INFO org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2022-05-25 14:11:36,463 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs
2022-05-25 14:11:36,463 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2022-05-25 14:11:36,463 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2022-05-25 14:11:36,532 INFO org.apache.hadoop.http.HttpServer2: Added filter 'org.apache.hadoop.hdfs.web.AuthFilter' (class=org.apache.hadoop.hdfs.web.AuthFilter)
2022-05-25 14:11:36,534 INFO org.apache.hadoop.http.HttpServer2: addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
2022-05-25 14:11:36,581 INFO org.apache.hadoop.http.HttpServer2: Jetty bound to port 50070
2022-05-25 14:11:36,581 INFO org.mortbay.log: jetty-6.1.26
2022-05-25 14:11:36,953 INFO org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:50070
2022-05-25 14:11:37,092 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Only one image storage directory (dfs.namenode.name.dir) configured. Beware of data loss due to lack of redundant storage directories!
2022-05-25 14:11:37,092 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Only one namespace edits storage directory (dfs.namenode.edits.dir) configured. Beware of data loss due to lack of redundant storage directories!
2022-05-25 14:11:37,147 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: No KeyProvider found.
2022-05-25 14:11:37,147 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: fsLock is fair:true
2022-05-25 14:11:37,241 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager: dfs.block.invalidate.limit=1000
2022-05-25 14:11:37,241 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager: dfs.namenode.datanode.registration.ip-hostname-check=true
2022-05-25 14:11:37,243 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
2022-05-25 14:11:37,249 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: The block deletion will start around 2022 五月 25 14:11:37
2022-05-25 14:11:37,261 INFO org.apache.hadoop.util.GSet: Computing capacity for map BlocksMap
2022-05-25 14:11:37,261 INFO org.apache.hadoop.util.GSet: VM type = 64-bit
2022-05-25 14:11:37,269 INFO org.apache.hadoop.util.GSet: 2.0% max memory 966.7 MB = 19.3 MB
2022-05-25 14:11:37,269 INFO org.apache.hadoop.util.GSet: capacity = 2^21 = 2097152 entries
2022-05-25 14:11:37,372 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: dfs.block.access.token.enable=false
2022-05-25 14:11:37,372 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: defaultReplication = 1
2022-05-25 14:11:37,372 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: maxReplication = 512
2022-05-25 14:11:37,372 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: minReplication = 1
2022-05-25 14:11:37,372 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: maxReplicationStreams = 2
2022-05-25 14:11:37,372 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: shouldCheckForEnoughRacks = false
2022-05-25 14:11:37,372 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: replicationRecheckInterval = 3000
2022-05-25 14:11:37,372 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: encryptDataTransfer = false
2022-05-25 14:11:37,372 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: maxNumBlocksToLog = 1000
2022-05-25 14:11:37,385 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: fsOwner = hadoop (auth:SIMPLE)
2022-05-25 14:11:37,385 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: supergroup = supergroup
2022-05-25 14:11:37,385 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: isPermissionEnabled = true
2022-05-25 14:11:37,388 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: HA Enabled: false
2022-05-25 14:11:37,393 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Append Enabled: true
2022-05-25 14:11:38,573 INFO org.apache.hadoop.util.GSet: Computing capacity for map INodeMap
2022-05-25 14:11:38,573 INFO org.apache.hadoop.util.GSet: VM type = 64-bit
2022-05-25 14:11:38,587 INFO org.apache.hadoop.util.GSet: 1.0% max memory 966.7 MB = 9.7 MB
2022-05-25 14:11:38,588 INFO org.apache.hadoop.util.GSet: capacity = 2^20 = 1048576 entries
2022-05-25 14:11:38,596 INFO org.apache.hadoop.hdfs.server.namenode.FSDirectory: ACLs enabled? false
2022-05-25 14:11:38,596 INFO org.apache.hadoop.hdfs.server.namenode.FSDirectory: XAttrs enabled? true
2022-05-25 14:11:38,596 INFO org.apache.hadoop.hdfs.server.namenode.FSDirectory: Maximum size of an xattr: 16384
2022-05-25 14:11:38,596 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Caching file names occuring more than 10 times
2022-05-25 14:11:38,705 INFO org.apache.hadoop.util.GSet: Computing capacity for map cachedBlocks
2022-05-25 14:11:38,705 INFO org.apache.hadoop.util.GSet: VM type = 64-bit
2022-05-25 14:11:38,705 INFO org.apache.hadoop.util.GSet: 0.25% max memory 966.7 MB = 2.4 MB
2022-05-25 14:11:38,705 INFO org.apache.hadoop.util.GSet: capacity = 2^18 = 262144 entries
2022-05-25 14:11:38,706 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: dfs.namenode.safemode.threshold-pct = 0.9990000128746033
2022-05-25 14:11:38,706 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: dfs.namenode.safemode.min.datanodes = 0
2022-05-25 14:11:38,707 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: dfs.namenode.safemode.extension = 30000
2022-05-25 14:11:38,712 INFO org.apache.hadoop.hdfs.server.namenode.top.metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.num.buckets = 10
2022-05-25 14:11:38,713 INFO org.apache.hadoop.hdfs.server.namenode.top.metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.users = 10
2022-05-25 14:11:38,717 INFO org.apache.hadoop.hdfs.server.namenode.top.metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.minutes = 1,5,25
2022-05-25 14:11:38,719 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Retry cache on namenode is enabled
2022-05-25 14:11:38,719 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
2022-05-25 14:11:38,735 INFO org.apache.hadoop.util.GSet: Computing capacity for map NameNodeRetryCache
2022-05-25 14:11:38,735 INFO org.apache.hadoop.util.GSet: VM type = 64-bit
2022-05-25 14:11:38,735 INFO org.apache.hadoop.util.GSet: 0.029999999329447746% max memory 966.7 MB = 297.0 KB
2022-05-25 14:11:38,735 INFO org.apache.hadoop.util.GSet: capacity = 2^15 = 32768 entries
2022-05-25 14:11:38,884 INFO org.apache.hadoop.hdfs.server.common.Storage: Lock on /usr/local/hadoop/tmp/dfs/name/in_use.lock acquired by nodename 3009@dblab-VirtualBox
2022-05-25 14:11:39,252 INFO org.apache.hadoop.hdfs.server.namenode.FileJournalManager: Recovering unfinalized segments in /usr/local/hadoop/tmp/dfs/name/current
2022-05-25 14:11:39,439 INFO org.apache.hadoop.hdfs.server.namenode.FileJournalManager: Finalizing edits file /usr/local/hadoop/tmp/dfs/name/current/edits_inprogress_0000000000000000001 -> /usr/local/hadoop/tmp/dfs/name/current/edits_0000000000000000001-0000000000000000001
2022-05-25 14:11:39,576 INFO org.apache.hadoop.hdfs.server.namenode.FSImageFormatPBINode: Loading 1 INodes.
2022-05-25 14:11:39,644 INFO org.apache.hadoop.hdfs.server.namenode.FSImageFormatProtobuf: Loaded FSImage in 0 seconds.
2022-05-25 14:11:39,648 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Loaded image for txid 0 from /usr/local/hadoop/tmp/dfs/name/current/fsimage_0000000000000000000
2022-05-25 14:11:39,648 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Reading org.apache.hadoop.hdfs.server.namenode.RedundantEditLogInputStream@2d1dee39 expecting start txid #1
2022-05-25 14:11:39,648 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Start loading edits file /usr/local/hadoop/tmp/dfs/name/current/edits_0000000000000000001-0000000000000000001
2022-05-25 14:11:39,657 INFO org.apache.hadoop.hdfs.server.namenode.EditLogInputStream: Fast-forwarding stream '/usr/local/hadoop/tmp/dfs/name/current/edits_0000000000000000001-0000000000000000001' to transaction ID 1
2022-05-25 14:11:39,671 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Edits file /usr/local/hadoop/tmp/dfs/name/current/edits_0000000000000000001-0000000000000000001 of size 1048576 edits # 1 loaded in 0 seconds
2022-05-25 14:11:39,693 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Need to save fs image? false (staleImage=false, haEnabled=false, isRollingUpgrade=false)
2022-05-25 14:11:39,700 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Starting log segment at 2
2022-05-25 14:11:40,419 INFO org.apache.hadoop.hdfs.server.namenode.NameCache: initialized with 0 entries 0 lookups
2022-05-25 14:11:40,419 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Finished loading FSImage in 1605 msecs
2022-05-25 14:11:40,912 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: RPC server is binding to localhost:9000
2022-05-25 14:11:40,934 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
2022-05-25 14:11:40,991 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 9000
2022-05-25 14:11:41,148 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Registered FSNamesystemState MBean
2022-05-25 14:11:41,214 INFO org.apache.hadoop.hdfs.server.namenode.LeaseManager: Number of blocks under construction: 0
2022-05-25 14:11:41,214 INFO org.apache.hadoop.hdfs.server.namenode.LeaseManager: Number of blocks under construction: 0
2022-05-25 14:11:41,214 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: initializing replication queues
2022-05-25 14:11:41,222 INFO org.apache.hadoop.hdfs.StateChange: STATE* Leaving safe mode after 4 secs
2022-05-25 14:11:41,222 INFO org.apache.hadoop.hdfs.StateChange: STATE* Network topology has 0 racks and 0 datanodes
2022-05-25 14:11:41,222 INFO org.apache.hadoop.hdfs.StateChange: STATE* UnderReplicatedBlocks has 0 blocks
2022-05-25 14:11:41,256 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeDescriptor: Number of failed storage changes from 0 to 0
2022-05-25 14:11:41,337 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Total number of blocks = 0
2022-05-25 14:11:41,337 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Number of invalid blocks = 0
2022-05-25 14:11:41,337 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Number of under-replicated blocks = 0
2022-05-25 14:11:41,344 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Number of over-replicated blocks = 0
2022-05-25 14:11:41,344 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Number of blocks being written = 0
2022-05-25 14:11:41,344 INFO org.apache.hadoop.hdfs.StateChange: STATE* Replication Queue initialization scan for invalid, over- and under-replicated blocks completed in 118 msec
2022-05-25 14:11:41,383 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: NameNode RPC up at: localhost/127.0.0.1:9000
2022-05-25 14:11:41,383 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Starting services required for active state
2022-05-25 14:11:41,375 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2022-05-25 14:11:41,376 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 9000: starting
2022-05-25 14:11:41,409 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Starting CacheReplicationMonitor with interval 30000 milliseconds
hadoop@dblab-VirtualBox:/usr/local/hadoop$ jps
3537 Jps
3132 DataNode
3343 SecondaryNameNode

检查一下NameNode是不是配置在其他节点上了?
请参考这篇博客:https://blog.csdn.net/u011109589/article/details/124852278?spm=1001.2014.3001.5502
希望对你有所帮助!

好像是安全模式 org.apache.hadoop.hdfs.server.namenode.FSNamesystem: No KeyProvider found.
我之前也写过单机和集群都有,可以借鉴下

你重新格式化过了没,看看你hdfs -site.xml配件

1.执行命令对namenode进行格式化:hadoop namenode -format;
2.重新启动namenode即可。

看你的log上边没有ERROR的报错
有详细的报错信息没,不能正常启动的报错提示是什么

单机还是集群