What are the common commands of hadoop cluster under linux

What are the common commands of hadoop cluster under linux? Hadoop is a distributed system infrastructure developed by the Apache Foundation. Users can develop distributed programs without knowing the underlying details of the distribution. Make full use of the power of the cluster for high-speed operation and storage.

Upload files

1) hadoop fs-put words.txt / path/to/input/2) hdfs dfs-put words.txt / path/wc/input/

View the files contained in a directory

1) hadoop fs-ls / path/wc/input/2) hadoop fs-ls hdfs://node1:9000/path/wc/input/

As in the linux file system, the permissions to which the file belongs

1) hadoop fs-chmod 666 / hello.txt2) hadoop fs-chown someuser:somegrp / hello.txt

Du Statistics File size

Hadoop fs-du-h / # Statistics the size of each file under the folder hadoop fs-du-s-h / # calculate the total size of this folder. The returned data is the folder size, the total backup size hadoop fs-count / # statistics the number of files, the returned data is the number of directories, the number of files, the total file size, input path

Kill yarn task

Yarn application-kill application_id

View yarn Log

Yarn logs-applicationId application_id > logs.txt

Container cloud products are implemented by deploying container services on cluster servers through docker technology, with tens of thousands of Linux images, powerful, easy to use, and easy to build cluster services.