HCA卡的Port GUID 和ib0的關系
[[email protected] ~]# ibstat
CA 'mlx4_0' ——————————————>>>>額外說明：這是第一個HCA卡(并且是雙port，是以下面有port1和prot2)
CA type: MT4099
Number of ports: 2
Firmware version: 2.35.5100
Hardware version: 0
Node GUID: 0x248a0703005d07f0
System image GUID: 0x248a0703005d07f3
Port 1:
State: Active
Physical state: LinkUp
Rate: 56
Base lid: 4
LMC: 0
SM lid: 4
Capability mask: 0x0259486a
Port GUID: 0x248a0703005d07f1---------------->>>注意此處！！！！
Link layer: InfiniBand
Port 2:
State: Down
Physical state: Polling
Rate: 10
Base lid: 0
LMC: 0
SM lid: 0
Capability mask: 0x02594868
Port GUID: 0x248a0703005d07f2
Link layer: InfiniBand
CA 'mlx4_1'' ——————————————>>>>額外說明：這是第二個HCA卡(并且是雙port，是以下面有port1和prot2)
CA type: MT4099
Number of ports: 2
Firmware version: 2.35.5100
Hardware version: 0
Node GUID: 0x248a0703005d0840
System image GUID: 0x248a0703005d0843
Port 1:
State: Active
Physical state: LinkUp
Rate: 56
Base lid: 6
LMC: 0
SM lid: 8
Capability mask: 0x02594868
Port GUID: 0x248a0703005d0841
Link layer: InfiniBand
Port 2:
State: Down
Physical state: Polling
Rate: 10
Base lid: 0
LMC: 0
SM lid: 0
Capability mask: 0x02594868
Port GUID: 0x248a0703005d0842
Link layer: InfiniBand
[[email protected] ~]# ip addr show
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: enp5s0f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
link/ether 0c:c4:7a:ab:d3:4c brd ff:ff:ff:ff:ff:ff
inet 192.168.100.102/24 brd 192.168.100.255 scope global enp5s0f0
valid_lft forever preferred_lft forever
inet6 fe80::ec4:7aff:feab:d34c/64 scope link
valid_lft forever preferred_lft forever
3: enp5s0f1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN qlen 1000
link/ether 0c:c4:7a:ab:d3:4d brd ff:ff:ff:ff:ff:ff
4: ib0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 2044 qdisc pfifo_fast state UP qlen 256
link/infiniband 80:00:02:08:fe:80:00:00:00:00:00:00:24:8a:07:03:00:5d:07:f1 brd 00:ff:ff:ff:ff:12:40:1b:ff:ff:00:00:00:00:00:00:ff:ff:ff:ff
inet 10.10.10.105/24 brd 10.10.10.255 scope global ib0 ~~~~~~~~~~~~--->注意此處！！！
valid_lft forever preferred_lft forever
inet6 fe80::268a:703:5d:7f1/64 scope link
valid_lft forever preferred_lft forever
5: ib1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 2044 qdisc pfifo_fast state DOWN qlen 256
link/infiniband 80:00:02:09:fe:80:00:00:00:00:00:00:24:8a:07:03:00:5d:07:f2 brd 00:ff:ff:ff:ff:12:40:1b:ff:ff:00:00:00:00:00:00:ff:ff:ff:ff
inet 10.10.10.106/24 brd 10.10.10.255 scope global ib1
valid_lft forever preferred_lft forever
6: ib2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 2044 qdisc pfifo_fast state UP qlen 256
link/infiniband 80:00:02:08:fe:80:00:00:00:00:00:02:24:8a:07:03:00:5d:08:41 brd 00:ff:ff:ff:ff:12:40:1b:ff:ff:00:00:00:00:00:00:ff:ff:ff:ff
inet 10.10.10.107/24 brd 10.10.10.255 scope global ib2
valid_lft forever preferred_lft forever
inet6 fe80::268a:703:5d:841/64 scope link
valid_lft forever preferred_lft forever
7: ib3: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 2044 qdisc pfifo_fast state DOWN qlen 256
link/infiniband 80:00:02:09:fe:80:00:00:00:00:00:00:24:8a:07:03:00:5d:08:42 brd 00:ff:ff:ff:ff:12:40:1b:ff:ff:00:00:00:00:00:00:ff:ff:ff:ff
inet 10.10.10.108/24 brd 10.10.10.255 scope global ib3
valid_lft forever preferred_lft forever
8: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN
link/ether 52:54:00:74:ff:7b brd ff:ff:ff:ff:ff:ff
inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0
valid_lft forever preferred_lft forever
9: virbr0-nic: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast master virbr0 state DOWN qlen 500
link/ether 52:54:00:74:ff:7b brd ff:ff:ff:ff:ff:ff
[[email protected] ~]# ifconfig
enp5s0f0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 192.168.100.102 netmask 255.255.255.0 broadcast 192.168.100.255
inet6 fe80::ec4:7aff:feab:d34c prefixlen 64 scopeid 0x20<link>
ether 0c:c4:7a:ab:d3:4c txqueuelen 1000 (Ethernet)
RX packets 9803 bytes 744701 (727.2 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 2027 bytes 175450 (171.3 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
device memory 0xc7820000-c783ffff
ib0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 2044
inet 10.10.10.105 netmask 255.255.255.0 broadcast 10.10.10.255
inet6 fe80::268a:703:5d:7f1 prefixlen 64 scopeid 0x20<link>---------------------------->注意本行最左側！！
Infiniband hardware address can be incorrect! Please read BUGS section in ifconfig(8).
infiniband 80:00:02:08:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00 txqueuelen 256 (InfiniBand)
RX packets 61 bytes 6687 (6.5 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 51 bytes 4298 (4.1 KiB)
TX errors 0 dropped 7 overruns 0 carrier 0 collisions 0
ib1: flags=4099<UP,BROADCAST,MULTICAST> mtu 2044
inet 10.10.10.106 netmask 255.255.255.0 broadcast 10.10.10.255
Infiniband hardware address can be incorrect! Please read BUGS section in ifconfig(8).
infiniband 80:00:02:09:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00 txqueuelen 256 (InfiniBand)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
ib2: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 2044
inet 10.10.10.107 netmask 255.255.255.0 broadcast 10.10.10.255
inet6 fe80::268a:703:5d:841 prefixlen 64 scopeid 0x20<link>
Infiniband hardware address can be incorrect! Please read BUGS section in ifconfig(8).
infiniband 80:00:02:08:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00 txqueuelen 256 (InfiniBand)
RX packets 14 bytes 3411 (3.3 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 7 overruns 0 carrier 0 collisions 0
ib3: flags=4099<UP,BROADCAST,MULTICAST> mtu 2044
inet 10.10.10.108 netmask 255.255.255.0 broadcast 10.10.10.255
Infiniband hardware address can be incorrect! Please read BUGS section in ifconfig(8).
infiniband 80:00:02:09:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00 txqueuelen 256 (InfiniBand)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536
inet 127.0.0.1 netmask 255.0.0.0
inet6 ::1 prefixlen 128 scopeid 0x10<host>
loop txqueuelen 0 (Local Loopback)
RX packets 24 bytes 1724 (1.6 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 24 bytes 1724 (1.6 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
virbr0: flags=4099<UP,BROADCAST,MULTICAST> mtu 1500
inet 192.168.122.1 netmask 255.255.255.0 broadcast 192.168.122.255
ether 52:54:00:74:ff:7b txqueuelen 0 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
[[email protected] ~]#
![iSCSI vs iSER vs SRP on Ethernet & InfiniBand本文轉自：[圖]](data:image/gif;base64,R0lGODlhAQABAIAAAP///wAAACwAAAAAAQABAAACAkQBADs=)