Get the App
SLTechnology News&Howtos  ›  Internet Technology  › 

What is the HDFS replica placement strategy?

Shulou Source: shulou.com Published: 2022-06-01 15:55:15 10月02日 Update

This article will explain in detail what the HDFS copy placement strategy is. The editor thinks it is very practical, so I share it for you as a reference. I hope you can get something after reading this article.

1. Each document is generally divided into three copies, when the actual situation requires (when the job demand is large, there will be 5 or 7 copies)

two。 First copy: when the node is on DN, the first copy is usually on DN, but in other cases (commit outside the cluster), the first copy can also be on a randomly selected disk with more space left and faster.

3. The second copy: placed on a rack different from the first copy.

4. The third copy: placed on a different rack from the second copy.

This is the end of this article on "what is the HDFS copy placement strategy?". I hope the above content can be of some help to you, so that you can learn more knowledge. if you think the article is good, please share it out for more people to see.

Tags: Copy situation article strategy different larger more rack disk good practical three content file article time reality knowledge space node Apple Docker Huawei Linux macOS MariaDB Microsoft MySQL NVidia OPPO Reno NVidia Shulou Information vpn MariaDB Apple