Get the App
SLTechnology News&Howtos  ›  Internet Technology  › 

[Spark] when does Spark crawl Shuffle data?

Shulou Source: shulou.com Published: 2022-06-03 02:48:55 10月03日 Update

I see two completely opposite views in a book. Contradiction! Who knows the details and conclusions? leave a comment.

1. Mapper while Reducer

2. The Shuffle on the Reducer side will not be performed until the Mapper is completed.

Tags: Contradiction two end detail conclusion opinion comment data time Apple Docker Huawei Linux macOS MariaDB Microsoft MySQL NVidia OPPO Reno MariaDB vpn Shulou Technology MySQL Apple