SLTechnology News&Howtos › Internet Technology ›

Org.apache.spark.streaming.flume.sink.SparkFlumeProtocol$Callback not found

Shulou Source: shulou.com Published: 2022-06-03 06:24:51 11月13日 Update

Java.lang.NoClassDefFoundError: org/apache/spark/streaming/flume/sink/SparkFlumeProtocol$Callback

At org.apache.spark.streaming.flume.FlumePollingReceiver$$anonfun$onStart$1.apply (FlumePollingInputDStream.scala:84)

At org.apache.spark.streaming.flume.FlumePollingReceiver$$anonfun$onStart$1.apply (FlumePollingInputDStream.scala:82)

At scala.collection.IndexedSeqOptimized$class.foreach (IndexedSeqOptimized.scala:33)

At scala.collection.mutable.WrappedArray.foreach (WrappedArray.scala:34)

At org.apache.spark.streaming.flume.FlumePollingReceiver.onStart (FlumePollingInputDStream.scala:82)

At org.apache.spark.streaming.receiver.ReceiverSupervisor.startReceiver (ReceiverSupervisor.scala:148)

At org.apache.spark.streaming.receiver.ReceiverSupervisor.start (ReceiverSupervisor.scala:130)

At org.apache.spark.streaming.scheduler.ReceiverTracker$ReceiverTrackerEndpoint$$anonfun$9.apply (ReceiverTracker.scala:542)

At org.apache.spark.streaming.scheduler.ReceiverTracker$ReceiverTrackerEndpoint$$anonfun$9.apply (ReceiverTracker.scala:532)

At org.apache.spark.SparkContext$$anonfun$37.apply (SparkContext.scala:1984)

At org.apache.spark.scheduler.ResultTask.runTask (ResultTask.scala:66)

At org.apache.spark.scheduler.Task.run (Task.scala:88)

At org.apache.spark.executor.Executor$TaskRunner.run (Executor.scala:214)

At java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1145)

At java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:615)

At java.lang.Thread.run (Thread.java:745)

Caused by: java.lang.ClassNotFoundException: org.apache.spark.streaming.flume.sink.SparkFlumeProtocol$Callback

At java.net.URLClassLoader$1.run (URLClassLoader.java:366)

At java.net.URLClassLoader$1.run (URLClassLoader.java:355)

At java.security.AccessController.doPrivileged (Native Method)

At java.net.URLClassLoader.findClass (URLClassLoader.java:354)

At java.lang.ClassLoader.loadClass (ClassLoader.java:425)

At java.lang.ClassLoader.loadClass (ClassLoader.java:358)

If you can't find the class org.apache.spark.streaming.flume.sink.SparkFlumeProtocol$Callback.

This class belongs to spark-streaming-flume-sink_2.10.jar

Org.apache.spark

Spark-streaming-flume-sink_2.10

1.5.2