Get the App
SLTechnology News&Howtos  ›  Development  › 

How to solve the Could not find or load main class org.apache.spark.deploy.yarn.ApplicationMaster problem

Shulou Source: shulou.com Published: 2022-06-03 06:05:07 11月16日 Update

This article mainly explains "how to solve the Could not find or load main class org.apache.spark.deploy.yarn.ApplicationMaster problem". The content in the article is simple and clear, and it is easy to learn and understand. Please follow the editor's train of thought to study and learn "how to solve the Could not find or load main class org.apache.spark.deploy.yarn.ApplicationMaster problem".

Spark YARN Cluster mode get this error "Could not find or load main class org.apache.spark.deploy.yarn.ApplicationMaster"

Spark.yarn.jars

Spark.yarn.archive

Misconfiguration may cause this problem

/ tmp/spark-80645695-04d9-4801-b119-bf526e903334/__spark_libs__5482901671928622840.zip-> hdfs:

Correct configuration:

Spark.yarn.jar hdfs://udp02:8020/user//spark-lib/*.jar

Thank you for your reading, the above is the content of "how to solve the Could not find or load main class org.apache.spark.deploy.yarn.ApplicationMaster problem", after the study of this article, I believe you have a deeper understanding of how to solve the Could not find or load main class org.apache.spark.deploy.yarn.ApplicationMaster problem, and the specific use needs to be verified in practice. Here is, the editor will push for you more related knowledge points of the article, welcome to follow!

Tags: Questions learning content configuration that is ideas situations articles more knowledge knowledge points articles follow errors practice push research verification Apple Docker Huawei Linux macOS MariaDB Microsoft MySQL NVidia OPPO Reno vpn Apple Microsoft Huawei Xiaomi