How to ​ Test Spark Cluster

This article mainly introduces "how to test Spark clusters". In daily operation, I believe many people have doubts about how to test Spark clusters. The editor consulted all kinds of materials and sorted out simple and easy-to-use methods of operation. I hope it will be helpful to answer the doubts of "how to test Spark clusters". Next, please follow the editor to study!

Test the Spark cluster

Upload the "README.txt" under the Spark installation package to

You can find that the file has been uploaded successfully through the web console of hdfs:

Use the "MASTER:spark://SparkMaster:7077. / spark-shell" command to start Spark shell:

Next, read the "README.md" file you just uploaded to HDFS with the following command:

Do the following for the read file:

Next, use the collect command to submit and execute the Job:

At this point, the study on "how to test Spark clusters" is over. I hope to be able to solve your doubts. The collocation of theory and practice can better help you learn, go and try it! If you want to continue to learn more related knowledge, please continue to follow the website, the editor will continue to work hard to bring you more practical articles!