Get the App
SLTechnology News&Howtos  ›  Internet Technology  › 

How to learn spark big data-from beginner to beginner

Shulou Source: shulou.com Published: 2022-06-03 04:51:26 11月12日 Update

Apache Spark is a fast and general computing engine specially designed for large-scale data processing. Spark is a general parallel framework like Hadoop MapReduce opened by UC Berkeley AMP lab (AMP Lab of the University of California, Berkeley). Spark has the advantages of Hadoop MapReduce; but what is different from MapReduce is that the intermediate output of Job can be saved in memory, so it is no longer necessary to read and write HDFS, so Spark can be better applied to iterative MapReduce algorithms such as data mining and machine learning.

As for how to learn, of course, is to read books to learn, paper books or e-books can be. If you have money, you can also choose to study in a training institution.

Then, to learn this piece, we must not work behind closed doors, but should communicate more and communicate more, visit more relevant community forums, and ask the gods for advice.

Another thing is to do more. It is better to do a project by yourself than to read 10 books.

I will continue to explain to you this knowledge, please look forward to it!

Tags: Learning data that is money working behind closed doors designed for advantages memory training institutions universities gods large-scale laboratories engines data processing data mining machines institutions frameworks electronics Apple Docker Huawei Linux macOS MariaDB Microsoft MySQL NVidia OPPO Reno Apple Microsoft Redmi Docker Shulou Tech Info