Example Analysis of hadoop2.6 configuration File
This article will explain in detail the example analysis of the hadoop2.6 configuration file. The editor thinks it is very practical, so I share it for you as a reference. I hope you can get something after reading this article.
Hdfs-site.xml
Dfs.nameservices
Mycluster
Dfs.ha.namenodes.mycluster
Nn1,nn2
Dfs.namenode.rpc-address.mycluster.nn1
Machine1.example.com:8020
Dfs.namenode.rpc-address.mycluster.nn2
Machine2.example.com:8020
Dfs.namenode.http-address.mycluster.nn1
Machine1.example.com:50070
Dfs.namenode.http-address.mycluster.nn2
Machine2.example.com:50070
Dfs.namenode.shared.edits.dir
Qjournal://node1.example.com:8485;node2.example.com:8485;node3.example.com:8485/mycluster
Dfs.client.failover.proxy.provider.mycluster
Org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider
Dfs.ha.fencing.methods
Sshfence
/ / Private key address
Dfs.ha.fencing.ssh.private-key-files
/ home/exampleuser/.ssh/id_rsa
Dfs.journalnode.edits.dir
/ path/to/journal/node/local/data
Automatic switching
Dfs.ha.automatic-failover.enabled
True
Core-site.xml
Fs.defaultFS
Hdfs://mycluster
/ / join the zookeeper cluster in core-site
Ha.zookeeper.quorum
Zk1.example.com:2181,zk2.example.com:2181,zk3.example.com:2181
Configure hadoop.tmp.dir
Yarn-site.xml
Yarn.resourcemanager.hostname
Master
Yarn.nodemanager.aux-services.mapreduce_shuffle.class
Org.apache.hadoop.mapred.ShuffleHandler
Yarn.nodemanager.aux-services
Mapreduce_shuffle
Zookeeper configuration
TickTime=2000
DataDir=/var/lib/zookeeper
ClientPort=2181
InitLimit=5
SyncLimit=2
Server.1=zoo1:2888:3888
Server.2=zoo2:2888:3888
Server.3=zoo3:2888:3888
This is the end of this article on "sample analysis of hadoop2.6 configuration files". I hope the above content can be of some help to you, so that you can learn more knowledge. if you think the article is good, please share it for more people to see.
