How to compile Flink 1.10.2
-[INFO] Building force-shading 1.10.2 [1CM176] [INFO]-- [jar]-- Packaging
In order to be compatible with hadoop, we need to manually copy the flink-shaded-hadoop-2-uber-3.1.1.3.1.5.1-2-9.0.jar compiled in the previous step to flink-1.10.2-bin/flink-1.10.2/lib
Then manually package flink-1.10.2/flink-dist/target/flink-1.10.2-bin/flink-1.10.2 into tar.gz and go to the server to deploy and install it.
Note that the hadoop version had better be consistent, otherwise there may be incompatibility.
# finally generate the path where the compilation package is located: flink-1.10.2-bin$ ll flink-1.10.2/flink-dist/targettotal 264176drwxr-xr-x 3 jiazz staff 96B 12 5 18:03 antrundrwxr-xr-x 2 jiazz staff 64B 12 5 18:04 archive-tmp-rw-r--r-- 1 jiazz staff 490K 12 5 18:04 bash-java-utils.jardrwxr-xr-x 5 jiazz staff 160B 12 5 18:03 classesdrwxr-xr-x 3 jiazz staff 96B 12 5 18:04 flink-1.10.2-bin-rw-r--r-- 1 jiazz staff 116M 12 5 18:04 flink-dist_2.11-1.10.2.jardrwxr-xr-x 3 jiazz staff 96B 12 5 18:03 generated-test-sourcesdrwxr-xr-x 3 jiazz staff 96B 12 5 18:03 maven-archiverdrwxr-xr-x 3 jiazz staff 96B 12 5 18:03 maven-shared-archive-resources-rw-r--r-- 1 jiazz staff 206K 12 5 18:03 original-flink-dist_2.11-1.10.2.jardrwxr-xr-x 4 jiazz staff 128B 12 5 18:03 temporarydrwxr-xr-x 5 jiazz staff 160B 12 5 18:03 test-classes# add flink-shaded-hadoop-2-uber to lib$ cp ~ / .m2 / repository/org/apache/flink/flink-shaded-hadoop-2-uber/3.1.1.3.1.5.1-2-9.0 Accord 2-uber-3.1.1.3.1.5.1-2-9.0.jar flink-1.10.2-bin/flink-1.10.2/lib# package $tar czvf flink-1.10.2- 3.1.5.1-problems encountered in 2.tar.gz flink-1.10.2-bin/flink-1.10.2/ compilation
I have obviously compiled flink-shaded, but I compiled 10, and the default is 9.0, so download flink-shaded-9.0 and compile again, and then continue to compile flink, or change it to the version of flink-shaded you compiled.
[ERROR] Failed to execute goal on project flink-hadoop-fs: Could not resolve dependencies for project org.apache.flink:flink-hadoop-fs:jar:1.10.2: Could not find artifact org.apache.flink:flink-shaded-hadoop-2:jar:3.1.1.3.1.5.1-2-9.0 in jetty (http://repo.hortonworks.com/content/groups/public/)-> [Help 1] [ERROR] about "Flink 1.10.2 such as This is the end of the article "he compiled". Hope that the above content can be helpful to you, so that you can learn more knowledge, if you think the article is good, please share it for more people to see.
