Example Analysis of critical stage sort in shuffle
This article mainly introduces the example analysis of the key stage of sort in shuffle, which has a certain reference value, and interested friends can refer to it. I hope you will gain a lot after reading this article.
There is a piece of code in the source code
1. Comparator obtained by sorting on the Map side
Public RawComparator getOutputKeyComparator () {/ / gets mapreduce.job.output.key.comparator.class. It must be of type RawComparator. If not set, it must be null Class.