53.MFS distributed file system
MFS distributed file system
MFS distributed file system is a fault-tolerant network distributed file system, which stores data on multiple physical servers and presents a unified resource to users.
The construction process of MFS distributed operating system:
V build master server
# iptables-F
# setenforce 0
# yum-y install zlib-devel
# useradd mfs-s / sbin/nologin
# tar xzvf mfs-1.6.27-5.tar.gz
# cd mfs.1.6.27
#. / configure-prefix=/usr/local/mfs-with-default-user=mfs-with-default-group=mfs-disable-mfschunkserver-disable-mfsmount
# make & & make install
# cp / usr/local/mfs/etc/mfs/mfsmaster.cfg.dist / usr/local/mfs/etc/mfs/mfsmaster.cfg
# cp / usr/local/mfs/etc/mfs/mfsexports.cfg.dist / usr/local/mfs/etc/mfs/mfsexports.cfg
# cp / usr/local/mfs/etc/mfs/mfstopology.cfg.dist / usr/local/mfs/etc/mfs/mfstopology.cfg
# cp / usr/local/mfs/var/mfs/metadata.mfs.empty / usr/local/mfs/var/mfs/metadata.mfs
# ln-s / usr/local/mfs/sbin/mfsmaster / usr/local/sbin
# mfsmaster start
# netstat-lnupt | grep mfs
V build metalogger server
# iptables-F
# setenforce 0
# yum-y install zlib-devel
# useradd mfs-s / sbin/nologin
# tar xzvf mfs-1.6.27-5.tar.gz
# cd mfs.1.6.27
#. / configure-prefix=/usr/local/mfs-with-default-user=mfs-with-default-group=mfs-disable-mfschunkserver-disable-mfsmount
# make & & make install
# cp / usr/local/mfs/etc/mfs/mfsmetapology.cfg.dist / usr/local/mfs/etc/mfs/mfsmetapology.cfg
# vim / usr/local/mfs/etc/mfs/mfsmetapology.cfg
Modify the content:
MASTER_HOST=1.1.1.1 specifies the IP address of the maser server
# ln-s / usr/local/mfs/sbin/mfsmaster / usr/local/sbin
# mfsmetalogger-s
# mfsmetalogger start
# ps aux | grep mfs
V build chunk server
# iptables-F
# setenforce 0
# yum-y install zlib-devel
# useradd mfs-s / sbin/nologin
# tar xzvf mfs-1.6.27-5.tar.gz
# cd mfs.1.6.27
#. / configure-prefix=/usr/local/mfs-with-default-user=mfs-with-default-group=mfs-disable-mfsmaster-disable-mfsmount
# make & & make install
# cp / usr/local/mfs/etc/mfs/mfstchunkserver.cfg.dist / usr/local/mfs/etc/mfs/mfschunkserver.cfg
# cp / usr/local/mfs/etc/mfs/mfshdd.cfg.dist / usr/local/mfs/etc/mfs/mfshdd.cfg
# vim / usr/local/mfs/etc/mfs/mfschunkserver.cfg
Modify the content:
MASTER_HOST = 1.1.1.1 specify the IP address of the master server
/ data gives MFS a partition
# mkdir / data
# chown-R mfs.mfs / data
# ps aux | grep mfs
V client installs FUSE software, installs MFS client
# iptables-F
# setenforce 0
# yum-y install zlib-devel
# tar xzvf fuse-2.9.2.tar.gz
# cd fuse.2.9.2
#. / configure & & make & & make install
# echo 'export PKG_CONFIG_PATH=/usr/local/lib/pkgconfig:$PKG_CONFIG_PATH' > > / etc/profile
# source / etc/profile
# useradd mfs-s / sbin/nologin
# tar xzvf mfs-1.6.27-5.tar.gz
# cd mfs.1.6.27
#. / configure-prefix=/usr/local/mfs-with-default-user=mfs-with-default-group=mfs-disable-mfsmaster-disable-mfschunkserver-disable-mfsmount
# make & & make install
# ln-s / usr/local/mfs/bin/* / usr/local/bin
# modprobe fuse
# mfsmount-H 1.1.1.1 / mnt
# df
MFS monitoring
# mfscgiserv
Note:
Access http://1.1.1.1:9245 through a browser
Info displays the basic information of MFS
Servers lists existing chunk server
Disks lists the hard disk information of the existing chunk server
Exports lists directories that can be mounted
Mounts lists the mounted directories
Operations shows the operation being performed
Mater MFS server configuration file parsing: mfsmaster.cfg is the main configuration file, and mfsexports.cfg is the mounted directory and permissions directory.
Contents of mfsmaster.cfg file:
# WORKING_USER = mfs running user
# WORKING_GROUP = mfs running user group
# SYSLOG_IDENT = mfsmaster identity
# LOCK_MEMORY = 0 whether to execute mlocalall, 0 means to avoid process overflow
# NICE_LEVEL =-19 priority of running
# EXPORTS_FILENAME = / usr/local/mfs/etc/mfs/mfsexports.cfg is mounted and permissions directory
# TOPOLOGY_FILENAME = / usr/local/mfs/etc/mfs/mfstopology.cfg
# DATA_PATH = / usr/local/mfs/var/mfs data storage path
# BACK_LOGS = 50 changed number of log files
# BACK_META_KEEP_PREVIOUS = 1
# REPLICATIONS_DELAY_INIT = 300delayed replication time
# REPLICATIONS_DELAY_DISCONNECT = 3600 replication delay when the chunk server is disconnected
# MATOML_LISTEN_HOST = * IP address of metalogger listener
# MATOML_LISTEN_PORT = port address of 9419 metalogger listener
# MATOML_LOG_PRESERVE_SECONDS = 600
# MATOCS_LISTEN_HOST = * IP address to which the chunk server is connected
# MATOCS_LISTEN_PORT = the port address of the 9420 chunk server connection
# MATOCL_LISTEN_HOST = * IP address for client connection
# MATOCL_LISTEN_PORT = 9421 Port address for client connection
# CHUNKS_LOOP_MAX_CPS = 100000
# CHUNKS_LOOP_MIN_TIME = loopback frequency of 300chunks
# CHUNKS_SOFT_DEL_LIMIT = 10
# CHUNKS_HARD_DEL_LIMIT = 25
# CHUNKS_WRITE_REP_LIMIT = 2 maximum number of connections written to the chunk server from the client
# CHUNKS_READ_REP_LIMIT = 10 maximum number of connections to read content from the chunk server
# ACCEPTABLE_DIFFERENCE = 0.1
# SESSION_SUSTAIN_TIME = 86400
# REJECT_OLD_CLIENTS = 0 pops up client hook with less than 1.6.0
Contents of mfsexports.cfg file:
# Allow everything but "meta".
* / rw,alldirs,maproot=0
# Allow "meta".
*. Rw
IP address of the client
Attached directory
Permissions that the client has
* indicates all
/ indicates the MFS root
. Represents the MFSMETA file system
Ro means read-only
Rw means readable and writable
Alldirs means that any specified subdirectory is allowed to be mounted
Maport indicates whether to map to roog or to specify a user
Password indicates the client password
