Oracle RAC modifies private IB Nic protocol to RDS protocol
Follow the oraclesupport online steps and further refine the steps. The environment is rhel6.2-64 oracle11.2.0.3.
1. First install the IB network card and its driver, and use the command to view the installed network card:
[root@nari65 bin] # ifconfig-a
Ib0 Link encap:InfiniBand HWaddrA0:00:01:00:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00
Inet addr:192.168.12.65 Bcast:192.168.12.255 Mask:255.255.255.0
Inet6 addr: fe80::f652:1403:86:3ae1/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:2044 Metric:1
RX packets:185019 errors:0 dropped:0 overruns:0 frame:0
TX packets:232627 errors:0 dropped:6 overruns:0 carrier:0
Collisions:0 txqueuelen:1024
RX bytes:117911220 (112.4 MiB) TXbytes:324758674 (309.7 MiB)
2. If you use the RDS protocol, you need to modify the linux kernel parameters of all nodes:
Net.core.rmem_default=262144
Net.core.rmem_max=4194304
Net.core.wmem_default=262144
Net.core.wmem_max=2097152
3 the ipoib protocol is the default for the RDS Infiniband Nic. If you use the RDS protocol, modify the contents of the / etc/infiniband/openib.conf file on all nodes, add RDS_LOAD=yes, or change it to yes and change the ipoib parameter to no when this parameter is already no.
# Load IPoIB
IPOIB_LOAD=no
# Enable IPoIB Connected Mode
SET_IPOIB_CM=no
# Load SRP module
SRP_LOAD=no
RDS_LOAD=yes
# Load ISER module
ISER_LOAD=no
4. Verify that the ip address of the IB network card is in the / etc/hosts file, and that the network card is in the private network of RAC.
[root@nari65 bin] # cat / etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
:: 1 localhost localhost.localdomain localhost6 localhost6.localdomain6
# node1
# public
192.168.200.62 nari62
192.168.200.65 nari65
# priv
192.168.12.62 nari62-priv
192.168.12.65 nari65-priv
# vip
192.168.200.32 nari62-vip
192.168.200.35 nari65-vip
# scan_ip
192.168.200.33 racscan
[grid@nari65 ~] $oifcfg getif
Eth0 192.168.200.0 global public
Ib0 192.168.12.0 global cluster_interconnect
5. If you originally used the ipoib protocol, you need to shut down all node oracle services.
[root@nari62 bin] #. / crsctl stop crs
6. After confirming that the service is turned off, use oracle users to relink on all nodes.
[oracle@nari65~] $cd $ORACLE_HOME/rdbms/lib
[oracle@nari65~] $make-f ins_rdbms.mk ipc_rdsioracle
7, after relink, use root to start the oracle service of all nodes again.
[root@nari62 bin] #. / crsctl start crs
If you look at the alert-log file, you can see that it is already a rds protocol:
