Example Analysis of map-reduce, map and reduce in hadoop
This article mainly introduces the example analysis of map-reduce, map and reduce in hadoop, which is very detailed and has certain reference value. Friends who are interested must finish it!
Map-reduce process
The green line in the middle is the shuffle (shuffle) process: the process after map and before reduce.
It can be understood that the data generated by a map is partitioned through the hash process but assigned to different reduce tasks, which is equivalent to the process of shuffling the data.
Map end process
Reduce process
The above is all the contents of the article "sample Analysis of map-reduce, map and reduce in hadoop". Thank you for reading! Hope to share the content to help you, more related knowledge, welcome to follow the industry information channel!
