Hadoop looks at a file divided into several pieces, each on which machine in that rack
The order is
Hadoop fsck / g6/input/baidu.log-files-blocks-locations-racks [hadoop@hadoop002] $hadoop fsck / g6/input/baidu.log-files-blocks-locations-racksDEPRECATED: Use of this script to execute hdfs command is deprecated.Instead use the hdfs command for it.Connecting to namenode via http://hadoop001:50070FSCK started by hadoop (auth:SIMPLE) from / 192.168.1.202 for path / g6/input/baidu.log at Fri May 17 07:17:29 EDT 2019/g6/input/baidu.log 709286098 bytes, 3 block (s): OK0. BP-1964109503-192.168.1.201-1557058616667:blk_1073741939_1115 len=268435456 Live_repl=3 [/ default-rack/192.168.1.203:50010, / default-rack/192.168.1.202:50010, / default-rack/192.168.1.201:50010] 1. BP-1964109503-192.168.1.201-1557058616667:blk_1073741940_1116 len=268435456 Live_repl=3 [/ default-rack/192.168.1.202:50010, / default-rack/192.168.1.203:50010 / default-rack/192.168.1.201:50010] 2. BP-1964109503-192.168.1.201-1557058616667:blk_1073741941_1117 len=172415186 Live_repl=3 [/ default-rack/192.168.1.202:50010, / default-rack/192.168.1.203:50010, / default-rack/192.168.1.201:50010] Status: HEALTHY Total size: 709286098 B Total dirs: 0 Total files: 1 Total symlinks: 0 Total blocks (validated): 3 (avg. Block size 236428699 B) Minimally replicated blocks: 3 (100.0) Over-replicated blocks: 3 (100.0) Under-replicated blocks: 0 (0.0%) Mis-replicated blocks: 0 (0.0%) Default replication factor: 2 Average block replication: 3.0 Corrupt blocks: 0 Missing replicas: 0 (0.0%) Number of data-nodes: 3 Number of racks: 1FSCK ended at Fri May 17 07:17: 29 EDT 2019 in 3 millisecondsThe filesystem under path'/ g6 engine Baidu.log' is HEALTHY
The information below is the location information and copy information of the block.
0. BP-1964109503-192.168.1.201-1557058616667:blk_1073741939_1115 len=268435456 Live_repl=3 [/ default-rack/192.168.1.203:50010, / default-rack/192.168.1.202:50010, / default-rack/192.168.1.201:50010] 1. BP-1964109503-192.168.1.201-1557058616667:blk_1073741940_1116 len=268435456 Live_repl=3 [/ default-rack/192.168.1.202:50010, / default-rack/192.168.1.203:50010 / default-rack/192.168.1.201:50010] 2.BP-1964109503-192.168.1.201-1557058616667:blk_1073741941_1117 len=172415186 Live_repl=3 [/ default-rack/192.168.1.202:50010, / default-rack/192.168.1.203:50010, / default-rack/192.168.1.201:50010]
