Get the App
SLTechnology News&Howtos  ›  Development  › 

What is the MapReduce1 architecture design method?

Shulou Source: shulou.com Published: 2022-06-02 04:25:06 10月03日 Update

This article focuses on "what is the design method of MapReduce1 architecture". Interested friends may wish to have a look. The method introduced in this paper is simple, fast and practical. Let's let the editor take you to learn "what is the MapReduce1 architecture design method"?

MapReduces1 architecture design

Hadoop1.x MR1 (Computing + Resource Job scheduling)

There are two processes, JobTracker and TaskTracker (map task+reduce task), which belong to the master-slave architecture.

JobTracker:

Monitor resources and job scheduling, monitor the health status of all TaskTracker and job through heartbeat

Tell the scheduler to trace the task usage resource usage

TaskTracker:

Responsible for receiving and executing commands sent by JobTracker

Report node resource usage and tasks to JobTracker

TaskScheduler:

Task Scheduler (FIFO principle, first-in, first-out, first-hand execution according to job priority time)

At this point, I believe you have a deeper understanding of "what is the method of MapReduce1 architecture design?" you might as well do it in practice. Here is the website, more related content can enter the relevant channels to inquire, follow us, continue to learn!

Tags: Architecture method design resources scheduling tasks situations assignments content first-out learning monitoring practical deeper healthy two master-slave first-hand interest principles Apple Docker Huawei Linux macOS MariaDB Microsoft MySQL NVidia OPPO Reno vpn Shulou Information Apple Xiaomi MariaDB