Shulou(Shulou.com)06/03 Report--

1. Spark submit task

. / spark-submit-- class "com.prime.dsc.mention.main.WordCountForSpark"-- master spark://DEV-HADOOP-01:7077 / data/server/spark-1.5.0-bin-hadoop2.6/sparkJar/PRIME_DSC_Mention-1.0.0-SNAPSHOT.jar

2. Spark runs locally

SparkConf sparkConf = new SparkConf () .setAppName ("wordCountForSpark") .setMaster ("local")

3. Myeclipse pack Jar package

1) Maven clean

2) Maven install

3) copying the .jar file in the target directory is the required Jar package.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.