Shulou(Shulou.com)06/03 Report--

# # ENV#spark01 192.168.51.6#spark02 192.168.51.18#spark03 192.168.51.19#spark04 192.168.51.21#spark05 192.168.51.24##We must to improve file limits on every nodesecho "ulimit-SHn 204800 "> > / etc/rc.localecho" ulimit-SHu 204800 "> > / etc/rc.localcat > > / etc/security/limits.conf > / etc/sysctl.confecho 'net.ipv6.conf.default.disable_ipv6 = 1' > > / etc/sysctl.confecho 'vm.swappiness = 0' > > / etc/sysctl.confsysctl-pecho' echo never > / sys/kernel/mm/transparent_hugepage/defrag' > > / etc/rc.localchmod + x / etc/rc.d/rc.local#1) Edit / etc/hosts file on Every nodescat > / etc/hosts/etc/sudoers#4) set permission with opt directory on every nodeschown-R hadoop.hadoop / opt/#5) Set up key-based (passwordless) login:#just do it no spark01su-hadoopssh-keygenssh-copy-id-I ~ / .ssh/id_rsa.pub hadoop@spark01ssh-copy-id-I ~ / .ssh/id_rsa.pub hadoop@spark02ssh-copy-id-I ~ / .ssh/id_rsa.pub hadoop@spark03ssh-copy-id-I ~ / .ssh / id_rsa.pub hadoop@spark04ssh-copy-id-I ~ / .ssh/id_rsa.pub hadoop@spark05#6) install hadoop on spark01 and propagate / opt/hadoop2.7.3 to other nodes:cd / home/toolssudo wget http://god.nongdingbang.net/downloads/hadoop-2.7.3.tar.gzsudo tar zxvf hadoop-2.7.3.tar.gz-C / opt/sudo chown-R hadoop.hadoop / opt/hadoop-2.7.3scp-r / opt/hadoop- 2.7.3 hadoop@spark02:/optscp-r / opt/hadoop-2.7.3 hadoop@spark03:/optscp-r / opt/hadoop-2.7.3 hadoop@spark04:/optscp-r / opt/hadoop-2.7.3 hadoop@spark05:/opt#7) Edit this file on every nodessudo su-cat > / etc/profile.d/hadoop.sh

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.