1、配置方式
2、实际操作演示
(1)在Hadoop用户的根目录下创建text.txt文件
(2)上传文件
hadoop@node1:~$ hdfs dfs -ls hdfs://node1:8020/
Found 4 items
drwxr-xr-x - hadoop supergroup 0 2023-11-21 23:06 hdfs://node1:8020/home
-rw-r--r-- 2 hadoop supergroup 35 2023-11-26 22:54 hdfs://node1:8020/text.txt
-rw-r--r-- 3 hadoop supergroup 27 2023-11-26 22:57 hdfs://node1:8020/three_text.txt
drwx------ - hadoop supergroup 0 2023-11-18 12:21 hdfs://node1:8020/user
(3)修改副本数
hadoop@node1:~$ hdfs dfs -setrep 1 hdfs://node1:8020/three_text.txt
Replication 1 set: hdfs://node1:8020/three_text.txt
hadoop@node1:~$ hdfs dfs -ls hdfs://node1:8020/
Found 4 items
drwxr-xr-x - hadoop supergroup 0 2023-11-21 23:06 hdfs://node1:8020/home
-rw-r--r-- 2 hadoop supergroup 35 2023-11-26 22:54 hdfs://node1:8020/text.txt
-rw-r--r-- 1 hadoop supergroup 27 2023-11-26 22:57 hdfs://node1:8020/three_text.txt
drwx------ - hadoop supergroup 0 2023-11-18 12:21 hdfs://node1:8020/user
3、fsck命令检查文件的副本数
(1)结果演示:
hadoop@node1:~$ hdfs fsck hdfs://node1:8020/text.txt -files -blocks -locations
Connecting to namenode via http://node1:9870/fsck?ugi=hadoop&files=1&blocks=1&locations=1&path=%2Ftext.txt
FSCK started by hadoop (auth:SIMPLE) from /192.168.88.101 for path /text.txt at Sun Nov 26 23:07:44 CST 2023
/text.txt 35 bytes, replicated: replication=2, 1 block(s): OK
0. BP-1383297113-192.168.88.101-1699274849934:blk_1073741835_1012 len=35 Live_repl=2 [DatanodeInfoWithStorage[192.168.88.103:9866,DS-89bf9985-fca9-4717-bdd1-1476f0b98a0f,DISK], DatanodeInfoWithStorage[192.168.88.101:9866,DS-bc41ebe7-7da0-4097-813b-7a025fba1b99,DISK]]
Status: HEALTHY
Number of data-nodes: 3
Number of racks: 1
Total dirs: 0
Total symlinks: 0
Replicated Blocks:
Total size: 35 B
Total files: 1
Total blocks (validated): 1 (avg. block size 35 B)
Minimally replicated blocks: 1 (100.0 %)
Over-replicated blocks: 0 (0.0 %)
Under-replicated blocks: 0 (0.0 %)
Mis-replicated blocks: 0 (0.0 %)
Default replication factor: 3
Average block replication: 2.0
Missing blocks: 0
Corrupt blocks: 0
Missing replicas: 0 (0.0 %)
Blocks queued for replication: 0
Erasure Coded Block Groups:
Total size: 0 B
Total files: 0
Total block groups (validated): 0
Minimally erasure-coded block groups: 0
Over-erasure-coded block groups: 0
Under-erasure-coded block groups: 0
Unsatisfactory placement block groups: 0
Average block group size: 0.0
Missing block groups: 0
Corrupt block groups: 0
Missing internal blocks: 0
Blocks queued for replication: 0
FSCK ended at Sun Nov 26 23:07:44 CST 2023 in 1 milliseconds
The filesystem under path '/text.txt' is HEALTHY
(2)分析
原文地址:https://blog.csdn.net/2301_79149013/article/details/134699854
本文来自互联网用户投稿,该文观点仅代表作者本人,不代表本站立场。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。
如若转载,请注明出处:http://www.7code.cn/show_35404.html
如若内容造成侵权/违法违规/事实不符,请联系代码007邮箱:suwngjj01@126.com进行投诉反馈,一经查实,立即删除!
声明:本站所有文章,如无特殊说明或标注,均为本站原创发布。任何个人或组织,在未征得本站同意时,禁止复制、盗用、采集、发布本站内容到任何网站、书籍等各类媒体平台。如若本站内容侵犯了原著者的合法权益,可联系我们进行处理。