This chapter provides release notes information for Sun Network QDR InfiniBand Gateway Switches, which are included in the Exalogic machine (EL X2-2).
This chapter contains the following sections:
2.1 Latest Product Information
For latest information about Sun InfiniBand QDR Gateway Switches, including product notes, see the following link:
http://docs.sun.com/app/docs/prod/qdr.infini.switch?l=en&a=view
2.2 Known Problems
The following table describes known problems with the gateway switch.
| CR | Description | Workaround |
|---|---|---|
|
6987184 |
Firmware upgrade for the gateway fails when using the TFTP protocol. |
Use either the FTP or HTTP protocols for firmware upgrade. |
|
6962346 |
The dcsport command shows incorrect output when |
Use the following command:
|
|
6929482 |
The dcsport command shows incorrect output when |
Use the following command:
|
2.3 General Issues
The following general issues exist for Sun Network QDR InfiniBand Gateway Switches:
2.3.1 Jumbo Frames
Consider the following for Jumbo Frames:
-
True Jumbo Frames are not supported.
-
The maximum MTU is limited by the MTU of the InfiniBand fabric.
-
The MTU of the HCA is 2048 by default, but can be increased up to 4096.
-
The default MTU of the I4 switch chip and BridgeX chips is 4096.
The gateway supports jumbo frames up to the InfiniBand limit of 4096 bytes.
You must configure the entire InfiniBand fabric to use a 4096 MTU. This includes configuring the Subnet Manager, InfiniBand devices, and the ConnectX HCAs. You can configure a ConnectX HCA by activating the set_4k_mtu parameter of the HCA's mlx4_core module.
2.3.2 Subnet Manager
Access to the VNICs through the gateway requires an active Subnet Manager for the InfiniBand fabric. The management controller within the gateway is already configured with a Subnet Manager. You can enable the Subnet Manager with the enablesm command.
Note:
VNICs are unavailable or not created if there is no physical connection between the 10 GbE ports and the 10 GbE network.2.4 Software Information
The following software information is available for Sun Network QDR InfiniBand Gateway Switches:
2.4.1 Gateway Firmware Version
The gateway firmware version at the time of this release is Sun DCS GW Firmware version 1.1.2-2
The gateway firmware is downloadable from the Oracle download center at:
http://www.oracle.com/technetwork/indexes/downloads/index.html
2.4.2 Host Software and Firmware
To configure and use VNICs from an InfiniBand host, the host must have the following software and firmware installed:
-
BXOFED software. The BXOFED software is downloadable from Mellanox at:
http://www.mellanox.com/content/pages.php?pg=firmware_table_Sun -
ConnectX-2 firmware version 2.7.00 or higher. The ConnectX-2 firmware is available at:
http://www.mellanox.com/content/pages.php?pg=firmware_table_Sun
2.5 Software Issues
The following software issue exist for Sun Network QDR InfiniBand Gateway Switches.
2.5.1 Symbol Errors on Internal Ports
When starting the gateway or when restarting the Bridge Manager (bxm), there might be 65535 symbol errors on the internal links between the I4 switch chip and the BridgeX chips. These errors are identified in hardware commands like getportcounters or in InfiniBand commands like ibdiagnet.
The workaround is to manually reset the error counters using the following commands:
# getportcounters 1 -R; getportcounters 2 -R; getportcounters 3 -R;getportcounters 4 -R
Or
# ibclearerrors
Note:
Theibclearerrors command is not selective, and clears errors from all ports.2.6 Sun Network QDR InfiniBand Gateway Switch Product Issues
The following issues exist for this release of the Sun Network QDR InfiniBand Gateway Switch from Oracle:
2.6.1 Unusable Ports
The ports covered by the Do Not Remove plastic tab are unusable at the time of this document. Do not remove the tab.
