Get the App
SLTechnology News&Howtos  ›  Internet Technology  › 

The pit that big data stepped on

Shulou Source: shulou.com Published: 2022-06-03 05:01:21 10月01日 Update

When building a cluster, the data mount point of hdfs must be specified to a separate directory, not under / home, because it is likely to cause a mount point to be full during use. In that case, / home may be full, affecting the normal use of the linux system. If the storage space of multiple mount points varies greatly, it is best to set the policy according to the space instead of using the default rotation training method, or it is easy for the disk with small space to fill up first. When using impala, you should be careful not to specify the path to the root directory when creating the table, otherwise the following directory may be deleted when the table is deleted.

Tags: Time space directory process data larger in this case multiple size way best root directory disk policy system or if path cluster storage Apple Docker Huawei Linux macOS MariaDB Microsoft MySQL NVidia OPPO Reno MariaDB macOS Xiaomi vpn Microsoft