Configure the pve cluster to use external ceph storage

Prepare the next cluster

A computing cluster containing 3 pve hosts with only pve installed

The management host is comp1 (IP:10.8.20.21).

Computing cluster

One storage cluster with 4 pve hosts installed with pve and internally integrated ceph

Mgr:store1 (the management host is store1, IP:10.8.20.11)

Mon: store1 store2 store3 store4

Osd: store2 store3 store4

Storage pool name of ceph: store-pool

Storage cluster

The following configure the compute cluster to be able to use ceph storage on the storage cluster, add a rbd to the compute cluster, and use the ceph of the storage cluster

1. Ensure that the hosts in the two clusters can communicate with each other.

2. Add access to the ceph on the storage cluster above the comp1 of the computing cluster

Execute the following two commands under the shell of comp1 (Compute Node, IP:10.8.20.21):

Mkdir / etc/pve/priv/ceph

Scp root@10.8.20.11:/etc/ceph/ceph.client.admin.keyring / etc/pve/priv/ceph/ceph-external.keyring

Enter the password of the root user of yes and store1 (10.8.20.11) to copy the ceph.client.admin.keyring file, where ceph-external is the ID of the RBD to be added.

3. Add RBD

Log in to the web management platform of comp1 (10.8.20.21, compute node), click the "add" button for → storage → in the data center, and select BRD:

Add RBD

The ID of RBD is the file name copied above: ceph-external

Storage pool: store-pool (that is, the name of the storage pool established when the storage cluster is established)

Monitors: monitor of the storage cluster ceph. Enter IP, and multiple ones are separated by spaces. Three have been added here:

After adding it, refresh the web management platform of comp1, and you can see that there is an additional storage called ceph-external, and confirm that its size is not NAMA.

You can set up and run virtual machines on it