Shulou(Shulou.com)06/03 Report--

Some problems encountered in flume Packaging

1.ipc compatibility issues. 2.3.0 hdfs is used online, but the default is 1.2.1 when packaging.

08 Apr 2015 19V 38 SinkRunner-PollingRunner-DefaultSinkProcessor 25122 WARN [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.flume.sink.hdfs.HDFSEventSink.process:455)-HDFS IO errororg.apache.hadoop.ipc.RemoteException: Server IPC version 9 cannot communicate with client version 4 at org.apache.hadoop.ipc.Client.call (Client.java:1113) at org.apache.hadoop.ipc.RPC$Invoker.invoke (RPC.java:229)

Just copy the hadoop-core package or change the pom.xml file

1.2.1 / / hadoop-core-1.2.1.jar changed to hadoop-core-2.3.0-mr1-cdh6.1.0.jar 0.92.1 hadoop-core 0.7.0

Or specify when packing:

Mvn clean install-Phadoop-2

two。 When test is not skipped

Org.apache.flume.auth.TestFlumeAuthenticator: org/apache/commons/io/Charsets (no class error)

In the pom.xml file under the root directory, change to:

The package of commons-io commons-io 2.4 / / 2.1 does not have the class Charsets

If you download the jar package manually, you can import it using the following command:

Mvn install:install-file-DgroupId=commons-io-DartifactId=commons-io-Dversion=2.0.1-Dpackaging=jar-Dfile=commons-io-2.4.jar

3. There is a problem with the program language, the compilation failed because the Chinese environment was used in the system

1)

@ Test public void shouldUseUtcAsBasisForDateFormat () {assertEquals ("Coordinated Universal Time", factory.fastDateFormat.getTimeZone () .getDisplayName ()); / / request English, return Chinese}.

2)

Running org.apache.flume.source.twitter.TestTwitterSourceTests run: 2, Failures: 0, Errors: 1, Skipped: 1, Time elapsed: 0.247 sec

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.