CDH 5.13.0 how to install Spark 2.2
This article mainly explains "CDH 5.13.0 how to install Spark 2.2", the content of the article is simple and clear, easy to learn and understand, now please follow the editor's ideas slowly in depth, together to study and learn "CDH 5.13.0 how to install Spark 2.2" bar!
1. Install the CDH environment
two。 Create directories on the primary and standby nodes of the CDH
[root@yp-test-3 /] # mkdir / opt/cloudera/csd/
3. Download the Spark 2.2 package
Download csd address: http://archive.cloudera.com/spark2/csd/-corresponding system version (SPARK2_ON_YARN-2.2.0.cloudera4.jar)
Download parcel library address: http://archive.cloudera.com/spark2/parcels/2.2.0.cloudera4/ has a total of four files:
[root@yp-test-3 csd] # ll
Total 176904
-rw-r--r-- 1 root root 5171 Oct 30 17:44 manifest.json
-rw-r--r-- 1 root root 181104738 Oct 30 17:48 SPARK2-2.2.0.cloudera4-1.cdh6.13.3.p0.603055-el7.parcel
-rw-r--r-- 1 root root 41 Oct 30 17:42 SPARK2-2.2.0.cloudera4-1.cdh6.13.3.p0.603055-el7.parcel.sha
-rw-r--r-- 1 root root 17493 Oct 30 17:42 SPARK2_ON_YARN-2.2.0.cloudera4.jar
[root@yp-test-3 csd] #
4. Add parcel libraries to the CDH interface
5. Add apsrk 2.2 service
Thank you for reading, the above is "CDH 5.13.0 how to install Spark 2.2" content, after the study of this article, I believe you on CDH 5.13.0 how to install Spark 2.2 this problem has a deeper understanding, the specific use of the situation also needs to be verified in practice. Here is, the editor will push for you more related knowledge points of the article, welcome to follow!
