Get the App
SLTechnology News&Howtos  ›  Servers  › 

The method of enabling local mode in hive

Shulou Source: shulou.com Published: 2022-06-01 16:58:48 10月03日 Update

This article mainly introduces "the method of enabling local mode in hive". In the daily operation, I believe many people have doubts about the method of enabling local mode in hive. The editor has consulted all kinds of materials and sorted out simple and easy-to-use operation methods. I hope it will be helpful to answer the doubts about "how to enable local mode in hive". Next, please follow the editor to study!

Hive enables local mode and is mainly used to deal with situations where the amount of data is relatively small.

Hive.exec.mode.local.auto=true

Hive.exec.mode.local.auto.inputbytes.max=50000000

Hive.exec.mode.local.auto.tasks.max=10

Hive.exec.mode.local.auto.input.files.max=50

Hive.exec.mode.local.auto.tasks.max and hive.exec.mode.local.auto.inputbytes.max, the default values are 4 and 128MB, respectively, that is, local mr mode is enabled when the number of files processed by map does not exceed 4 and the total size is less than 128MB.

At this point, the study on "hive's way to enable local mode" is over. I hope to be able to solve your doubts. The collocation of theory and practice can better help you learn, go and try it! If you want to continue to learn more related knowledge, please continue to follow the website, the editor will continue to work hard to bring you more practical articles!

Tags: Patterns methods learning situations more processing help practical next number of pieces size data articles theory knowledge articles websites materials follow questions Apple Docker Huawei Linux macOS MariaDB Microsoft MySQL NVidia OPPO Reno macOS Docker Shulou Technology Shulou Information Shulou Tech Info