2-Port 100Gb EDR IB PCIe x16 Adapter

(FC: EC3F, EC3E)

 

 

******* PLEASE READ THIS ENTIRE NOTICE *********

 
DATE: July 17, 2019 

Table of Contents

 

1.0 Microcode and Document Revision History

2.0 General information

3.0 Installation time

4.0 Machine's Affected

5.0 Linux Requirements

 

 

1.0 Microcode and Document Revision History

Firmware Level

Description

12.24.8000

Impact: Usability    Severity: ATT

(The following are from vendor Bug Fixes History from fw release notes that could potentially affect POWER products)

Fixed an issue that prevented IB QP counters for Acks/Responses from working as a result the NACK/OOS counters showed as zero

Fixed a false signature error reported by the firmware during retransmissions.

Fixed an issue that showed the link as down even when the link was up due to missing asynchronous event.

Fixed an issue that occasionally caused the link to drop after running the 'reboot' command due to I2C being stuck.

Fixed an issue which displayed diagnostic counters only on the adapter that was initialized first, which is the counter's owner.

Fixed a rare issue that caused the firmware to hang.

Fixed an issue that wrongly reportedly the maximum temperature in a setup as the current temperature regardless of the actual temperature.


The Firmware Levels Below Are No Longer Supported By IBM Once They Have Been Removed From The Microcode Down Load Website.

It is best practices to update to the latest FW level not only for IBM support of these products, but for optimal performance and to ensure that all of the required HW/FW fixes are installed. Once new FW has been released to the field, we will provide a 6 month grace period for customers to update these products to the currently supported FW level .

Please Update To The Latest Level At Your Earliest Convenience

 

12.20.1010

Impact: Usability    Severity: ATT

Please refer to link

http://www.mellanox.com/pdf/firmware/ConnectX4-FW-12_20_1010-release_notes.pdf

 

12.17.2020

Please refer to link

http://www.mellanox.com/pdf/firmware/ConnectX4-FW-12_17_2020-release_notes.pdf

 

12.16.1006

Please refer to link

http://www.mellanox.com/pdf/firmware/ConnectX4-FW-12_16_1006-release_notes.pdf

 

12.12.1100

Original release

 

Document Revision History

Description

11/2/2015

Creating readme file with latest microcode – 12.12.1100

6/21/2016

Update  to level 12.16.1006

12/13/2016

Update to level 12.17.2020

11/02/2017

Update to level 12.20.1010

07/17/2019

Update to level 12.24.8000

 

 

2.0 General information

 

This Readme file is intended to give directions on how to update the microcode found on the 2-Port 100 Gb EDR IB  adapter.

 

Special Requirement:

Reboot of the OS is required.

 

Non-Concurrent Download:

The microcode installation does NOT support concurrent download.

 

NOTE: It is recommended that the installation be scheduled during a maintenance window or during non-peak production periods.

 

3.0 Installation time

Approximately 20 minutes.

 

4.0 Machine's Affected

 

Feature Codes:

EC3F   High Profile 2-Port 100 Gb EDR IB  adapter 

EC3E   Low Profile  2-Port 100 Gb EDR IB  adapter

 

CCIN  2CEA

 

 

5.0 Linux Requirements

 Error! Bookmark not defined.

To burn FW for IB adapters here are the instructions (for Linux):

 

 

 

1. Start the MFT software suite by running “mst start” at the command line:

#mst start

Starting MST (Mellanox Software Tools) driver set

Loading MST PCI module - Success

Loading MST PCI configuration module - Success

Create devices

 

You can ignore the "unable to initialize libusb: -99" error.  This occurs on systems without a USB port present.

 

If the system does not have the mst command available, please install the Mellanox Firmware Tools (MFT) available here: http://www.mellanox.com/page/management_tools

 

 

 

2.  # mst status

MST modules:

------------

    MST PCI module is not loaded

    MST PCI configuration module loaded

 

MST devices:

------------

/dev/mst/mt4115_pciconf0         - PCI configuration cycles access.

                                   domain:bus:dev.fn=0000:01:00.0 addr.reg=88 data.reg=92

                                   Chip revision is: 00

 

 

 

3. Verify the current Firmware level with

 

flint -d /dev/mst/mt4115_pciconf0 q

 

 

# flint -d /dev/mst/mt4115_pciconf0 q

Image type:            FS3

FW Version:            12.24.8000

FW Release Date:       29.1.2019

Product Version:       rel-12_24_8000

Description:           UID                GuidsNumber

Base GUID:             e41d2d0300c9c766        4

Base MAC:              0000e41d2dc9c766        4

Image VSD:

Device VSD:

PSID:                  IBM2190110032

Security Attributes:   N/A

 

 

This command reveals the current version of the FW; which is 12.24.8000 in this particular case.  If the version is less than that, please update.

Please note the value for PSID.  This will determine which image is needed in later steps.

 

 

 

 

4. Download the firmware RPM file to the destination machine.

 

Use this method to download the new microcode to a Linux system:

NOTE: The instructions that follow are specific Linux commands. Linux commands are CASE (lower and upper) SENSITIVE, and must be entered exactly as shown, including filenames.

  1. Transfer the RPM format file to the /tmp directory(using “Save as....”). You will see the filename for the RPM file. 
  2. Install rpm on your Linux system by typing:

rpm -ivh /tmp/fw-ConnectX4-rel-12_24_8000-00WT039_Ax.bin.Linux.rpm

  1. The microcode package will install the firmware images in the /lib/firmware directory. If a message is displayed saying the "package <package_name> is already installed", you will need to uninstall the listed rpm package. On the command line type:

rpm -e <package_name>

where <package_name> is the name of the package that was returned in the message. Return to Step 2 and attempt to install the file again.

  1. The microcode file will be installed to the /lib/firmware directory. The file name is fw-ConnectX4-rel-12_24_8000-00WT039_Ax.bin

 

 

 

5. Verify the contents of the image before flashing:

ls -l /lib/firmware/fw-ConnectX4-rel-12_24_8000-00WT039_Ax.bin to verify file size: 16744768

 

sum /lib/firmware/fw-ConnectX4-rel-12_24_8000-00WT039_Ax.bin to verify Checksum: 58962

 

 

6. Update the FW with "flint -d <device id> -i <image filename> burn"

 

     Using the device id from step 3: /dev/mst/mt4115_pciconf0

 

 

# flint -d  /dev/mst/mt4115_pciconf0 -i /lib/firmware/fw-ConnectX4-rel-12_24_8000-00WT039_Ax.bin burn

 

 

    Current FW version on flash:  12.20.1010

    New FW version:               12.24.8000

 

    Note: The new FW version is not newer than the current FW version on flash.

 

 Do you want to continue ? (y/n) [n] : y

 

 

Burning FW image without signatures  - OK

Restoring signature                  - OK

 

 

7. At this point we have burned the new FW on to the Mellanox adapter. However, this FW will not take effect till the system is rebooted.

Reloading the drivers is not enough; it requires the system to be rebooted.