How to solve the Could not find or load main class org.apache.spark.deploy.yarn.ApplicationMaster problem
This article mainly explains "how to solve the Could not find or load main class org.apache.spark.deploy.yarn.ApplicationMaster problem". The content in the article is simple and clear, and it is easy to learn and understand. Please follow the editor's train of thought to study and learn "how to solve the Could not find or load main class org.apache.spark.deploy.yarn.ApplicationMaster problem".
Spark YARN Cluster mode get this error "Could not find or load main class org.apache.spark.deploy.yarn.ApplicationMaster"
Spark.yarn.jars
Spark.yarn.archive
Misconfiguration may cause this problem
/ tmp/spark-80645695-04d9-4801-b119-bf526e903334/__spark_libs__5482901671928622840.zip-> hdfs:
Correct configuration:
Spark.yarn.jar hdfs://udp02:8020/user//spark-lib/*.jar
Thank you for your reading, the above is the content of "how to solve the Could not find or load main class org.apache.spark.deploy.yarn.ApplicationMaster problem", after the study of this article, I believe you have a deeper understanding of how to solve the Could not find or load main class org.apache.spark.deploy.yarn.ApplicationMaster problem, and the specific use needs to be verified in practice. Here is, the editor will push for you more related knowledge points of the article, welcome to follow!