Get the App
SLTechnology News&Howtos  ›  Internet Technology  › 

Learning Log-hadoop maven packing jar problem

Shulou Source: shulou.com Published: 2022-06-03 06:51:25 11月23日 Update

At first, I used maven's build to clean package the project, generated the jar package, and then ran it on hadoop with a classNotFound error.

Hint redis.jedis.redis.. not found Mistake.

Cause of error: there is no maven dependency in the generated jar package.

Solution: rebuild the maven project, package separate programs running on mapreduce, package them with runnable jar, and generate jar an order of magnitude larger than the original jar package (formerly k, now M). Then run it on hadoop, and it will be fine.

Tags: Error build run project number method reason program magnitude hint log problem learning Apple Docker Huawei Linux macOS MariaDB Microsoft MySQL NVidia OPPO Reno Linux NVidia vpn Xiaomi MariaDB