Set up the CDH experimental environment and take the installation and configuration of three nodes as an example
(1) Experimental environment
L experimental medium
N CentOS-7-x86_64-Everything-1708.iso
N jdk-8u161-linux-x64.rpm
N cloudera-manager-centos7-cm5.12.1_x86_64.tar.gz
N CDH-5.12.1-1.cdh6.12.1.p0.3-el7.parcel
N CDH-5.12.1-1.cdh6.12.1.p0.3-el7.parcel.sha1
N manifest.json
L prepare three CentOS virtual machines, three nodes: one Cloudera Manager node, two Agent nodes
The installation is as follows:
N CDH71:Server GUI 、 Development Tools 、 MariaDB
N CDH72 、 CDH73:Server GUI 、 Development Tools
(2) install and configure CentOS (each machine)
Note that the following two options are selected
L Server With GUI
L Development Tools
L MariaDB Server (that is, MySQL database): note that it is only installed on cdh71
L turn off the firewall
Systemctl stop firewalld.service
Systemctl disable firewalld.service
L configure hostname: edit / etc/hosts file
L configure password-free login
L configure ntp service
Create directory: mkdir / root/cdroom/
* Mount CD: mount / dev/cdrom / root/cdroom/
Delete all original repo files
Create the source file of yum: vi / etc/yum.repos.d/my.repo
[centos-yum]
Baseurl= file:///root/cdroom
Enabled=1
Gpgcheck=0
Open the NTP service
Yum install ntp
Systemctl is-enabled ntpd
Systemctl enable ntpd
Systemctl start ntpd
L yum-y install psmisc-> install the pstree command
(3) install JDK (per machine)
Be careful, this step is not the same as before!
L uninstall the original Java environment of the system
Step 1: view the installation packages for all current Java environments using the following command
Rpm-qa | grep java
Step 2: remove all Java installation packages using the following command
Rpm-e-- nodeps package name
L install the new JDK environment
Upload jdk-8u161-linux-x64.rpm to the / opt directory
Install JDK:rpm-ivh jdk-8u161-linux-x64.rpm
Z. execute the following command to set the environment variable:
Echo "JAVA_HOME=/usr/java/latest/" > > / etc/environment
L verify the JDK environment
(IV) configure MariaDB (on cdh71)
L start MariaDB
Systemctl start mariadb
Systemctl enable mariadb (Boot self-boot)
L configure MariaDB
Mysql_secure_installation
# the first step is to set the password, which will prompt you to enter the password first
Enter current password for root (enter for none):