罗列出Hadoop中常用命令,用于日后查阅。

HDFS

  • 格式化NameNode

bin/hdfs namenode -format

  • 启停NameNode

sbin/hadoop-daemon.sh start/stop namenode

  • 启停DataNode

sbin/hadoop-daemon.sh start/stop datanode

  • 启停HDFS集群

sbin/start/stop-dfs.sh

YARN

  • 启停ResourceManager

sbin/yarn-daemon.sh start/stop resourcemanager

  • 启停NodeManager

sbin/yarn-daemon.sh start/stop nodemanager

  • 启停WebAppProxy服务

sbin/yarn-daemon.sh start/stop proxyserver

  • 启停MapReduce JobHistory Server

sbin/mr-jobhistory-daemon.sh start/stop historyserver

  • 启停所有Yarn服务

sbin/start/stop-yarn.sh

状态查询

可是用jps命令查看各个服务是否启动,各个服务/进程的对应关系

进程 所属服务 备注
NameNode HDFS sbin/hadoop-daemon.sh hdfs start namenode
DataNode HDFS sbin/hadoop-daemon.sh hdfs start datanode
SecondaryNameNode HDFS
ResourceManager YARN
NodeManager YARN
WebAppProxy YARN
JobHistoryServer MapReduce
QuorumPeerMain Zookeeper
DFSZKFailoverController HDFS-HA sbin/hadoop-daemon.sh start zkfc
nn1> bin/hdfs zkfc -formatZK 
jn1,jn2,jn3> sbin/hadoop-daemon.sh start journalnode
nn1> bin/hdfs namenode -format hcluster
nn1> sbin/hadoop-daemon.sh start namenode
nn2> bin/hdfs namenode -bootstrapStandby
nn2> sbin/hadoop-daemon.sh start namenode

nn1> sbin/hadoop-daemon.sh start zkfc

hdfs haadmin -transitionToActive nn1
hdfs haadmin -transitionToActive --forceactive nn1
hdfs haadmin -getServiceState nn1
bin/hdfs haadmin -failover --forceactive hadoop101 hadoop100
hdfs haadmin -transitionToActive --forceactive --forcemanual nn1