OpenSM 적용하기

InfiniBand 를 연결하기 위해 opensm 을 이용하는데, 다음과 같이 설치한다.

$ yum groupinstall "Infiniband Support" -y

그 다음은 연결되어 있는 FC port 의 GUID 를 가져와서 /etc/sysconfig/opensm 에 등록해줘야 한다.

$ ibstat
CA 'mlx4_0'
    CA type: MT4099
    Number of ports: 2
    Firmware version: 2.42.5000
    Hardware version: 1
    Node GUID: 0xf4521403007c3cf0
    System image GUID: 0xf4521403007c3cf3
    Port 1:
        State: Down
        Physical state: Polling
        Rate: 10
        Base lid: 0
        LMC: 0
        SM lid: 0
        Capability mask: 0x02594868
        Port GUID: 0xf4521403007c3cf1
        Link layer: InfiniBand
    Port 2:
        State: Active
        Physical state: LinkUp
        Rate: 56
        Base lid: 1
        LMC: 0
        SM lid: 1
        Capability mask: 0x0259486a
        Port GUID: 0xf4521403007c3cf2  # <- 이거!
        Link layer: InfiniBand

Tip : 한번에 적용하기

$ ibstat | awk '/State:/{s=$2}/Port GUID:/{if(s=="Active"){print $3}}' | xargs echo

0xf4521403007c3cf2

$ cat /etc/sysconfig/opensm
# second on the primary), then the only way to do that is to use method #1
# above and individually edit the config files.  If you edit the config
# files to set the priority and then also set the priority here, then
# this setting will override the config files and render that particular
# edit useless.
#
#PRIORITY=15
GUIDS="0xf4521403007c3cf2"  #  <-  여기에 복사

Tip : 한번에 적용하기

GUID=`ibstat | awk '/State:/{s=$2}/Port GUID:/{if(s=="Active"){print $3}}' | xargs echo`
sed -i "73s/\".*\"/\"$GUID\"/g" /etc/sysconfig/opensm

그 뒤 재시작 하면 끝

$ systemctl restart opensm