Get the App
SLTechnology News&Howtos  ›  Internet Technology  › 

Developing wordcount programs with spark-shell

Shulou Source: shulou.com Published: 2022-06-03 07:17:43 09月23日 Update

Edit the file to be processed

Vim spark.txt

The contents are as follows

Upload files to hdfs

Hadoop fs-put / spark.txt /

View

Hadoop fs-ls /

Go to the bin directory of spark and execute. / spark-shell

Write scala code

Tags: File code content directory processing program development Apple Docker Huawei Linux macOS MariaDB Microsoft MySQL NVidia OPPO Reno Shulou Tech Info Docker Xiaomi NVidia vpn