View Cart
0 Items | Total: US$0.00
Welcome,      Register

You are here

Cisco Nexus 7000 Sequential and Parallel EPLD Upgrade. Who wins?

Rating: 
0
No votes yet

Cisco Nexus 7000 EPLD UpgradeWhether it is a fresh new install or a software upgrade, these would be the time for you to also consider an EPLD upgrade. Unlike software upgrade where you can potentially avoid an extended downtime using In-Service Software Upgrade (ISSU), EPLD upgrade requires the hardware to be taken offline and, in some cases, even chassis reload. Since the EPLD version has to stay in sync with the NXOS version, depending on what version you are upgrading to, you might need to upgrade all the pieces of hardware, and these include all supervisors, linecards, fans, and fabrics, which can result in a significant downtime.

Prior to 5.2, the only option available was a sequential upgrade where I/O modules are upgraded one at a time. What this means is the more linecard you have, the longer this process will take, especially if your chassis is fully populated. As of version 5.2, it is possible to perform parallel EPLD upgrade for I/O modules, which can significantly shaves off downtime. In this article, we will provide timing results from running tests between sequential and parallel EPLD upgrade. This is to give you some guideline and help you determine appropriate actions for your environment.  

Note: You must first upgrade the NXOS to the desired version before performing an EPLD upgrade, since the upgrade can only be done to match the running software version on the chassis.

Cisco Nexus 7009 7010 7018

Lab Hardware
    Our test was conducted on a Nexus 7010 with dual SUP2, five FAB2 and multiple M1 linecards

Test #1: Non-I/O Module Upgrade
    To prove that the parallel upgrade has no impact on non-I/O modules, we ran our first test by upgrading all Supervisors, fans and FAB modules (except linecard) from 5.2 to 6.1.4.

    Result: Both sequential and parallel took approximately the same amount of time of 40 minutes. Below are the outputs.

switch# install all epld bootflash:n7000-s2-epld.6.1.4.img parallel
Copy complete, now saving to disk (please wait)...

 EPLD image signature verification passed

Compatibility check:
Module  Type  Upgradable        Impact   Reason
------  ----  ----------    ----------   ------
     2    LC         Yes    disruptive   Module Upgradable
     5   SUP         Yes    disruptive   Module Upgradable
     6   SUP         Yes    disruptive   Module Upgradable
     9    LC         Yes    disruptive   Module Upgradable
     1  Xbar         Yes    disruptive   Module Upgradable
     2  Xbar         Yes    disruptive   Module Upgradable
     3  Xbar         Yes    disruptive   Module Upgradable
     4  Xbar         Yes    disruptive   Module Upgradable
     5  Xbar         Yes    disruptive   Module Upgradable
     1   FAN         Yes    disruptive   Module Upgradable
     2   FAN         Yes    disruptive   Module Upgradable
     3   FAN         Yes    disruptive   Module Upgradable
     4   FAN         Yes    disruptive   Module Upgradable

Retrieving EPLD versions... Please wait.

Images will be upgraded according to following table:
Module  Type           EPLD      Running-Version   New-Version  Upg-Required
------  ----  -------------      ---------------   -----------  ------------
     2    LC  Power Manager              1.006       1.006           No
     2    LC  IO                         0.001       0.001           No
     5   SUP  Power Manager SPI         34.000      36.000          Yes
     5   SUP  IO SPI                     1.012       1.013          Yes
     6   SUP  Power Manager SPI         34.000      36.000          Yes
     6   SUP  IO SPI                     1.012       1.013          Yes

     9    LC  Power Manager              1.006       1.006           No
     9    LC  IO                         0.001       0.001           No
     1  Xbar  Power Manager              0.006       0.007          Yes
     2  Xbar  Power Manager              0.006       0.007          Yes
     3  Xbar  Power Manager              0.006       0.007          Yes
     4  Xbar  Power Manager              0.006       0.007          Yes
     5  Xbar  Power Manager              0.006       0.007          Yes

     1   FAN  Fan Controller (1)         0.007       0.007           No
     1   FAN  Fan Controller (2)         0.007       0.007           No
     2   FAN  Fan Controller (1)         0.007       0.007           No
     2   FAN  Fan Controller (2)         0.007       0.007           No
     3   FAN  Fan Controller (1)         0.007       0.007           No
     3   FAN  Fan Controller (2)         0.007       0.007           No
     4   FAN  Fan Controller (1)         0.007       0.007           No
     4   FAN  Fan Controller (2)         0.007       0.007           No
The above modules require upgrade.
Do you want to continue (y/n) ?  [n] y

There will be a switchover after the upgrade process
if you choose to upgrade the Active Supervisor.
Do you want to upgrade the Active Supervisor also? [n] y

Proceeding to upgrade Modules.

Starting Module 6 EPLD Upgrade
Module 6 : Power Manager SPI [Upgrade Started  ]
Module 6 : Power Manager SPI [Erasing          ] : 100.00%
Module 6 : Power Manager SPI [Programming      ] : 100.00% (1464788 of 1464788 total bytes)
Module 6 : IO SPI [Upgrade Started  ]
Module 6 : IO SPI [Erasing          ] : 100.00%
Module 6 : IO SPI [Programming      ] : 100.00% (2695312 of 2695312 total bytes)

Module 6 Upgrade Done.

Waiting for Module 6 to come online.

 Module 6 Upgrade Done.

Waiting for Module 6 to come online.
2012 Aug 31 02:35:49 switch %$ VDC-1 %$ %PLATFORM-2-MOD_REMOVE: Module 6 removed (Serial number JAF1719R5UD)
Module 6 EPLD upgrade is successful.

Starting Xbar Module 1 EPLD Upgrade
2012 Aug 31 02:43:24 switch %$ VDC-1 %$ %PLATFORM-2-XBAR_DETECT: Xbar 1 detected (Serial number JAF1726HY75)

Xbar Module 1 EPLD upgrade is successful.

Starting Xbar Module 2 EPLD Upgrade
2012 Aug 31 02:47:22 switch %$ VDC-1 %$ %PLATFORM-2-XBAR_DETECT: Xbar 2 detected (Serial number JAF1724TGH7)

Xbar Module 2 EPLD upgrade is successful.

Starting Xbar Module 3 EPLD Upgrade
Xbar   3 : Power Manager [Verifying ] :  25.03% ( 200640 of  801462 total bytes)s)
Xbar   3 : Power Manager [Verifying ] :  36.89% ( 295680 of  801462 total bytes)
2012 Aug 31 02:51:19 switch %$ VDC-1 %$ %PLATFORM-2-XBAR_DETECT: Xbar 3 detected (Serial number JAF172FG8HG)

Xbar Module 3 EPLD upgrade is successful.

Starting Xbar Module 4 EPLD Upgrade
2012 Aug 31 02:55:17 switch %$ VDC-1 %$ %PLATFORM-2-XBAR_DETECT: Xbar 4 detected (Serial number JAF177TGHS)

Xbar Module 4 EPLD upgrade is successful.

Starting Xbar Module 5 EPLD Upgrade
2012 Aug 31 02:59:14 switch %$ VDC-1 %$ %PLATFORM-2-XBAR_DETECT: Xbar 5 detected (Serial number JAF172SE4PC)

Xbar Module 5 EPLD upgrade is successful.

 Starting Module 5 EPLD Upgrade

Module 5 : Power Manager SPI [Programming ] : 100.00% (1464788 of 1464788 total bytes)

Module 5 : IO SPI [Programming ] : 100.00% (2695312 of 2695312 total bytes)
Module 5 EPLD upgrade is successful.
Module    Type  Upgrade-Result
------    ----  --------------
     5     SUP         Success
     6     SUP         Success
     1    Xbar         Success
     2    Xbar         Success
     3    Xbar         Success
     4    Xbar         Success
     5    Xbar         Success

Reconfiguring Active Supervisor EPLDs. Module 6 will become Active Supervisor.

>>>
>>>
>>>
NX7k SUP BIOS version ( 2.08 ) : Build - 06/29/2012 17:07:20
PM FPGA Version : 0x00000024
Power sequence microcode revision - 0x00000009 : card type - 10156EEA0
Booting Spi Flash : Primary
  CPU Signature - 0x000106e4: Version - 0x000106e0
  CPU - 2 : Cores - 4 : HTEn - 1 : HT - 2 : Features - 0xbfebfbff
  FSB Clk - 532 Mhz :  Freq - 2145 Mhz - 2128 Mhz
  MicroCode Version : 0x00000002
  Memory - 32768 MB : Frequency - 1067 MHZ
  Loading Bootloader: Done
  IO FPGA Version   : 0x1000d
  PLX Version       : 861910b5
Bios digital signature verification - Passed
USB bootflash status : [1-1:1-1]
 Filesystem type is ext2fs, partition type 0x83

              GNU GRUB  version 0.97

Autobooting bootflash:/n7000-s2-kickstart.6.1.4.bin bootflash:/n7000-s2-dk9.6.1
.4.bin...
 Filesystem type is ext2fs, partition type 0x83
Booting kickstart image: bootflash:/n7000-s2-kickstart.6.1.4.bin....
...............................................................................
.......................................
Kickstart digital signature verification Successful
Image verification OK

INIT: version 2
slot0 flash device node /dev/sda
Checking obfl filesystem.r
Checking all filesystems..r.r.r.r done.
r/bootflash//n7000-s2-dk9.6.1.4.bin read done
Loading system software
System image digital signature verification successful.
Uncompressing system image: bootflash:/n7000-s2-dk9.6.1.4.bin Sat Aug 31 03:05:08 UTC 2012
blogger: nothing to do.

..done Sat Aug 31 03:05:11 UTC 2012
Load plugins that defined in image conf: /isan/plugin_img/img.conf
Loading plugin 0: core_plugin...
num srgs 1
0: swid-core-sup2dc3, swid-core-sup2dc3
num srgs 1
0: swid-sup2dc3-ks, swid-sup2dc3-ks
INIT: Entering runlevel: 3

2012 Aug 31 03:05:38 switch %$ VDC-1 %$ %USBHSD-2-DISK_MOUNT_FAIL: disk mount unsuccessful on slot0:

User Access Verification
switch(standby) login:
User Access Verification
switch login: admin
Password:
Cisco Nexus Operating System (NX-OS) Software
TAC support: http://www.cisco.com/tac
Copyright (c) 2002-2012, Cisco Systems, Inc. All rights reserved.

Note: Fan did not require upgrade otherwise it would jave taken longer.

Test #2: I/O Module Upgrade
    In our second test, we first sequentially downgraded the linecards to 4.2.6, and then upgraded them to 6.1.4 in parallel.
Note: Downgrading EPLD follows the same procedure as upgrading.

    Result: Sequential downgrade took approximately 28 minutes to complete the total of four linecards (ie. 7 min/linecard), while parallel upgrade only took approximately 7 minutes total (ie. faster by a factor of 4, which is the number of linecard). Below are the outputs.

************************ Sequential EPLD Downgrade ************************
switch# install all epld bootflash:n7000-s1-epld.4.2.6.img

Compatibility check:
Module  Type  Upgradable        Impact   Reason
------  ----  ----------    ----------   ------
     1    LC         Yes    disruptive   Module Upgradable
     4    LC         Yes    disruptive   Module Upgradable
     7    LC         Yes    disruptive   Module Upgradable
    10    LC         Yes    disruptive   Module Upgradable
     1  Xbar         Yes    disruptive   Module Upgradable
     2  Xbar         Yes    disruptive   Module Upgradable
     3  Xbar         Yes    disruptive   Module Upgradable
     1   FAN         Yes    disruptive   Module Upgradable
     2   FAN         Yes    disruptive   Module Upgradable
     3   FAN         Yes    disruptive   Module Upgradable
     4   FAN         Yes    disruptive   Module Upgradable

Retrieving EPLD versions... Please wait.

Images will be upgraded according to following table:
Module  Type           EPLD      Running-Version   New-Version  Upg-Required
------  ----  -------------      ---------------   -----------  ------------
     1    LC  Power Manager                  5.6           5.4           Yes
     1    LC  IO                             2.14          2.11          Yes

     1    LC  Forwarding Engine              1.6           1.6            No
     4    LC  Power Manager                  5.6           5.4           Yes
     4    LC  IO                             2.14          2.11          Yes

     4    LC  Forwarding Engine              1.6           1.6            No
     7    LC  Power Manager                  5.6           5.4           Yes
     7    LC  IO                             2.14          2.11          Yes

     7    LC  Forwarding Engine              1.6           1.6            No
    10    LC  Power Manager                  5.6           5.4           Yes
    10    LC  IO                             2.14          2.11          Yes

    10    LC  Forwarding Engine              1.6           1.6            No
     1  Xbar  Power Manager                  2.10          2.9           Yes
     2  Xbar  Power Manager                  2.10          2.9           Yes
     3  Xbar  Power Manager                  2.10          2.9           Yes

     1   FAN  Fan Controller (1)             0.7           0.7            No
     1   FAN  Fan Controller (2)             0.7           0.7            No
     2   FAN  Fan Controller (1)             0.7           0.7            No
     2   FAN  Fan Controller (2)             0.7           0.7            No
     3   FAN  Fan Controller (1)             0.7           0.7            No
     3   FAN  Fan Controller (2)             0.7           0.7            No
     4   FAN  Fan Controller (1)             0.7           0.7            No
     4   FAN  Fan Controller (2)             0.7           0.7            No
The above modules require upgrade.

Do you want to continue (y/n) ?  [n] y

Starting Module 1 EPLD Upgrade
2012 Sep 25 09:30:34.887 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRDN: Module 1 powered down (Serial number JAF144GT5TY)

2012 Sep 25 09:30:43.821 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 1 detected (Serial number JAF144GT5TY) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 09:30:43.877 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 1 powered up (Serial number JAF144GT5TY)

Power Manager :
Erasing: 0.00%
<omitted>
Erasing: 90.00%
Programming:   1.56% (  19476 of 1247907 total bytes)
<omitted>
Programming: 100.00% (1247907 of 1247907 total bytes)

IO :
Erasing: 0.00%
<omitted>
Erasing: 90.00%
Programming:   1.47% (  83880 of 5718283 total bytes)
<omitted>
Programming: 100.00% (5718283 of 5718283 total bytes)

Waiting for Module to come online.
2012 Sep 25 09:34:35.110 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRDN: Module 1 powered down (Serial number JAF144GT5TY)

2012 Sep 25 09:34:45.621 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 1 detected (Serial number JAF144GT5TY) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 09:34:45.667 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 1 powered up (Serial number JAF144GT5TY)

Module 1 EPLD upgrade is successful.

Starting Module 4 EPLD Upgrade
2012 Sep 25 09:38:21.497 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRDN: Module 4 powered down (Serial number JAF140GGH5T)

2012 Sep 25 09:38:30.031 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 4 detected (Serial number JAF140GGH5T) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 09:38:30.087 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 4 powered up (Serial number JAF140GGH5T)

Power Manager :
Erasing: 0.00%
<omitted>
Erasing: 90.00%
Programming:   1.56% (  19476 of 1247907 total bytes)
<omitted>
Programming: 100.00% (1247907 of 1247907 total bytes)

IO :
Erasing: 0.00%
<omitted>
Erasing: 90.00%
Programming:   1.47% (  83880 of 5718283 total bytes)
<omitted>
Programming: 100.00% (5718283 of 5718283 total bytes)

Waiting for Module to come online.
2012 Sep 25 09:42:21.131 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRDN: Module 4 powered down (Serial number JAF140GGH5T)

2012 Sep 25 09:42:31.641 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 4 detected (Serial number JAF140GGH5T) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 09:42:31.687 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 4 powered up (Serial number JAF140GGH5T)

Module 4 EPLD upgrade is successful.

Starting Module 7 EPLD Upgrade
2012 Sep 25 09:46:09.457 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRDN: Module 7 powered down (Serial number JAF144HHVBA)

2012 Sep 25 09:46:18.381 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 7 detected (Serial number JAF144HHVBA) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 09:46:18.427 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 7 powered up (Serial number JAF144HHVBA)

Power Manager :
Erasing: 0.00%
<omitted>
Erasing: 90.00%
Programming:   1.56% (  19476 of 1247907 total bytes)
<omitted>
Programming: 100.00% (1247907 of 1247907 total bytes)

IO :
Erasing: 0.00%
<omitted>
Erasing: 90.00%
Programming:   1.47% (  83880 of 5718283 total bytes)
<omitted>
Programming: 100.00% (5718283 of 5718283 total bytes)

Waiting for Module to come online.
2012 Sep 25 09:50:10.171 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRDN: Module 7 powered down (Serial number JAF144HHVBA)

2012 Sep 25 09:50:20.681 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 7 detected (Serial number JAF144HHVBA) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 09:50:20.737 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 7 powered up (Serial number JAF144HHVBA)

Module 7 EPLD upgrade is successful.

Starting Module 10 EPLD Upgrade
2012 Sep 25 09:53:58.457 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRDN: Module 10 powered down (Serial number JAF124567HB)

2012 Sep 25 09:54:07.381 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 10 detected (Serial number JAF124567HB) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 09:54:07.427 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 10 powered up (Serial number JAF124567HB)

Power Manager :
Erasing: 0.00%
<omitted>
Erasing: 90.00%
Programming:   1.56% (  19476 of 1247907 total bytes)
<omitted>
Programming: 100.00% (1247907 of 1247907 total bytes)

IO :
Erasing: 0.00%
<omitted>
Erasing: 90.00%
Programming:   1.47% (  83880 of 5718283 total bytes)
<omitted>
Programming: 100.00% (5718283 of 5718283 total bytes)

Waiting for Module to come online.
2012 Sep 25 09:57:58.661 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRDN: Module 10 powered down (Serial number JAF124567HB)

2012 Sep 25 09:58:09.171 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 10 detected (Serial number JAF124567HB) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 09:58:09.227 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 10 powered up (Serial number JAF124567HB)

Module 10 EPLD upgrade is successful. ! End of linecard upgrade

Starting Xbar Module 1 EPLD Upgrade
2012 Sep 25 10:01:39.958 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-XBAR_DETECT: Xbar 1 detected (Serial number JAF14467YWS)

Power Manager :
Erasing: 0.00%
<omitted>
Erasing: 90.00%
Programming:   1.55% (  19298 of 1242389 total bytes)
<omitted>
Programming: 100.00% (1242389 of 1242389 total bytes)

Waiting for Module to come online.
2012 Sep 25 10:02:24.568 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-XBAR_DETECT: Xbar 1 detected (Serial number JAF14467YWS)

Xbar Module 1 EPLD upgrade is successful.

Starting Xbar Module 2 EPLD Upgrade
2012 Sep 25 10:02:55.538 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-XBAR_DETECT: Xbar 1 detected (Serial number JAF14467YWS)

2012 Sep 25 10:02:55.538 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-XBAR_DETECT: Xbar 2 detected (Serial number JAF144E3WSE)

Power Manager :
Erasing: 0.00%
<omitted>
Erasing: 90.00%
Programming:   1.55% (  19298 of 1242389 total bytes)
<omitted>
Programming: 100.00% (1242389 of 1242389 total bytes)

Waiting for Module to come online.
2012 Sep 25 10:03:40.188 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-XBAR_DETECT: Xbar 2 detected (Serial number JAF144E3WSE)

Xbar Module 2 EPLD upgrade is successful.

Starting Xbar Module 3 EPLD Upgrade
2012 Sep 25 10:04:12.388 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-XBAR_DETECT: Xbar 2 detected (Serial number JAF144E3WSE)

2012 Sep 25 10:04:12.388 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-XBAR_DETECT: Xbar 3 detected (Serial number JAF144FGYI2)

Power Manager :
Erasing: 0.00%
<omitted>
Erasing: 90.00%
Programming:   1.55% (  19298 of 1242389 total bytes)
<omitted>
Programming: 100.00% (1242389 of 1242389 total bytes)

Waiting for Module to come online.
2012 Sep 25 10:04:57.028 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-XBAR_DETECT: Xbar 3 detected (Serial number JAF144FGYI2)

Xbar Module 3 EPLD upgrade is successful.

EPLD Upgrade Completed.
Module    Type  Upgrade-Result
------    ----  --------------
     1      LC         Success
     4      LC         Success
     7      LC         Success
    10      LC         Success
     1    Xbar         Success
     2    Xbar         Success
     3    Xbar         Success
2012 Sep 25 10:05:19.201 USIRV2LABswitch %$ VDC-1 %$ %PLATFORM-2-XBAR_DETECT: Xbar 3 detected (Serial number JAF144FGYI2)

2012 Sep 25 10:05:19.201 USIRV2LABswitch %$ VDC-1 %$ ER-2-SYSTEM_MSG: <<%EPLD_UPGRADE-2-ACTIVE_SUP_UPGRADE>> install all epld does not upgrade Active Supervisor module 5. Please do a switchover and upgrade the EPLDs on module 5. - epld_upgrade

! Total Time 36 Min (28 Min for linecard only)

************************ Parallel EPLD Upgrade ************************
switch# install all epld bootflash:n7000-s2-epld.6.1.4.img parallel

Copy complete, now saving to disk (please wait)...

 EPLD image signature verification passed

Compatibility check:
Module  Type  Upgradable        Impact   Reason
------  ----  ----------    ----------   ------
     1    LC         Yes    disruptive   Module Upgradable
     2    LC         Yes    disruptive   Module Upgradable
     4    LC         Yes    disruptive   Module Upgradable
     5   SUP         Yes    disruptive   Module Upgradable
     6   SUP         Yes    disruptive   Module Upgradable
     7    LC         Yes    disruptive   Module Upgradable
     9    LC         Yes    disruptive   Module Upgradable
    10    LC         Yes    disruptive   Module Upgradable
     1  Xbar         Yes    disruptive   Module Upgradable
     2  Xbar         Yes    disruptive   Module Upgradable
     3  Xbar         Yes    disruptive   Module Upgradable
     4  Xbar         Yes    disruptive   Module Upgradable
     5  Xbar         Yes    disruptive   Module Upgradable
     1   FAN         Yes    disruptive   Module Upgradable
     2   FAN         Yes    disruptive   Module Upgradable
     3   FAN         Yes    disruptive   Module Upgradable
     4   FAN         Yes    disruptive   Module Upgradable

Retrieving EPLD versions... Please wait.

Images will be upgraded according to following table:
Module  Type           EPLD      Running-Version   New-Version  Upg-Required
------  ----  -------------      ---------------   -----------  ------------
     1    LC  Power Manager              5.004       5.006          Yes
     1    LC  IO                         2.011       2.014          Yes

     1    LC  Forwarding Engine          1.006       1.006           No
     2    LC  Power Manager              1.006       1.006           No
     2    LC  IO                         0.001       0.001           No
     4    LC  Power Manager              5.004       5.006          Yes
     4    LC  IO                         2.011       2.014          Yes

     4    LC  Forwarding Engine          1.006       1.006           No
     5   SUP  Power Manager SPI         36.000      36.000           No
     5   SUP  IO SPI                     1.013       1.013           No
     6   SUP  Power Manager SPI         36.000      36.000           No
     6   SUP  IO SPI                     1.013       1.013           No
     7    LC  Power Manager              5.004       5.006          Yes
     7    LC  IO                         2.011       2.014          Yes

     7    LC  Forwarding Engine          1.006       1.006           No
     9    LC  Power Manager              1.006       1.006           No
     9    LC  IO                         0.001       0.001           No
    10    LC  Power Manager              5.004       5.006          Yes
    10    LC  IO                         2.011       2.014          Yes

    10    LC  Forwarding Engine          1.006       1.006           No
     1  Xbar  Power Manager              0.007       0.007           No
     2  Xbar  Power Manager              0.007       0.007           No
     3  Xbar  Power Manager              0.007       0.007           No
     4  Xbar  Power Manager              0.007       0.007           No
     5  Xbar  Power Manager              0.007       0.007           No
     1   FAN  Fan Controller (1)         0.007       0.007           No
     1   FAN  Fan Controller (2)         0.007       0.007           No
     2   FAN  Fan Controller (1)         0.007       0.007           No
     2   FAN  Fan Controller (2)         0.007       0.007           No
     3   FAN  Fan Controller (1)         0.007       0.007           No
     3   FAN  Fan Controller (2)         0.007       0.007           No
     4   FAN  Fan Controller (1)         0.007       0.007           No
     4   FAN  Fan Controller (2)         0.007       0.007           No
The above modules require upgrade.

Do you want to continue (y/n) ?  [n] y

2012 Sep 25 22:56:58 switch-Test-switch %$ VDC-2 %$ %PLATFORM-2-MOD_PWRDN: Module 10 powered down (Serial number JAF124567HB)

2012 Sep 25 22:56:58 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRDN: Module 10 powered down (Serial number JAF124567HB)

2012 Sep 25 22:56:58 switch-test2 %$ VDC-3 %$ %PLATFORM-2-MOD_PWRDN: Module 10 powered down (Serial number JAF124567HB)

2012 Sep 25 22:56:59 switch-Test-switch %$ VDC-2 %$ %PLATFORM-2-MOD_PWRDN: Module 1 powered down (Serial number JAF144GT5TY)

2012 Sep 25 22:56:59 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRDN: Module 1 powered down (Serial number JAF144GT5TY)

2012 Sep 25 22:57:00 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRDN: Module 4 powered down (Serial number JAF140GGH5T)

2012 Sep 25 22:56:59 switch-test2 %$ VDC-3 %$ %PLATFORM-2-MOD_PWRDN: Module 1 powered down (Serial number JAF144GT5TY)

2012 Sep 25 22:57:00 switch-test2 %$ VDC-3 %$ %PLATFORM-2-MOD_PWRDN: Module 4 powered down (Serial number JAF140GGH5T)

2012 Sep 25 22:57:00 switch-Test-switch %$ VDC-2 %$ %PLATFORM-2-MOD_PWRDN: Module 4 powered down (Serial number JAF140GGH5T)

2012 Sep 25 22:57:01 switch-Test-switch %$ VDC-2 %$ %PLATFORM-2-MOD_PWRDN: Module 7 powered down (Serial number JAF144HHVBA)

2012 Sep 25 22:57:01 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRDN: Module 7 powered down (Serial number JAF144HHVBA)

2012 Sep 25 22:57:01 switch-test2 %$ VDC-3 %$ %PLATFORM-2-MOD_PWRDN: Module 7 powered down (Serial number JAF144HHVBA)

2012 Sep 25 22:57:08 switch-Test-switch %$ VDC-2 %$ %PLATFORM-2-MOD_DETECT: Module 10 detected (Serial number JAF124567HB) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 22:57:08 switch-Test-switch %$ VDC-2 %$ %PLATFORM-2-MOD_PWRUP: Module 10 powered up (Serial number JAF124567HB)

2012 Sep 25 22:57:08 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 10 detected (Serial number JAF124567HB) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 22:57:08 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 10 powered up (Serial number JAF124567HB)

2012 Sep 25 22:57:08 switch-test2 %$ VDC-3 %$ %PLATFORM-2-MOD_DETECT: Module 10 detected (Serial number JAF124567HB) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 22:57:08 switch-test2 %$ VDC-3 %$ %PLATFORM-2-MOD_PWRUP: Module 10 powered up (Serial number JAF124567HB)

2012 Sep 25 22:57:14 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 1 detected (Serial number JAF144GT5TY) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 22:57:14 switch-test2 %$ VDC-3 %$ %PLATFORM-2-MOD_DETECT: Module 1 detected (Serial number JAF144GT5TY) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 22:57:14 switch-Test-switch %$ VDC-2 %$ %PLATFORM-2-MOD_DETECT: Module 1 detected (Serial number JAF144GT5TY) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 22:57:14 switch-Test-switch %$ VDC-2 %$ %PLATFORM-2-MOD_PWRUP: Module 1 powered up (Serial number JAF144GT5TY)

2012 Sep 25 22:57:14 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 1 powered up (Serial number JAF144GT5TY)

2012 Sep 25 22:57:14 switch-test2 %$ VDC-3 %$ %PLATFORM-2-MOD_PWRUP: Module 1 powered up (Serial number JAF144GT5TY)

2012 Sep 25 22:57:20 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 4 detected (Serial number JAF140GGH5T) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 22:57:20 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 4 powered up (Serial number JAF140GGH5T)

2012 Sep 25 22:57:20 switch-test2 %$ VDC-3 %$ %PLATFORM-2-MOD_DETECT: Module 4 detected (Serial number JAF140GGH5T) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 22:57:20 switch-test2 %$ VDC-3 %$ %PLATFORM-2-MOD_PWRUP: Module 4 powered up (Serial number JAF140GGH5T)

2012 Sep 25 22:57:20 switch-Test-switch %$ VDC-2 %$ %PLATFORM-2-MOD_DETECT: Module 4 detected (Serial number JAF140GGH5T) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 22:57:20 switch-Test-switch %$ VDC-2 %$ %PLATFORM-2-MOD_PWRUP: Module 4 powered up (Serial number JAF140GGH5T)

2012 Sep 25 22:57:26 switch-Test-switch %$ VDC-2 %$ %PLATFORM-2-MOD_DETECT: Module 7 detected (Serial number JAF144HHVBA) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 22:57:26 switch-Test-switch %$ VDC-2 %$ %PLATFORM-2-MOD_PWRUP: Module 7 powered up (Serial number JAF144HHVBA)

2012 Sep 25 22:57:26 switch-test2 %$ VDC-3 %$ %PLATFORM-2-MOD_DETECT: Module 7 detected (Serial number JAF144HHVBA) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 22:57:26 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 7 detected (Serial number JAF144HHVBA) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 22:57:26 switch-test2 %$ VDC-3 %$ %PLATFORM-2-MOD_PWRUP: Module 7 powered up (Serial number JAF144HHVBA)

2012 Sep 25 22:57:26 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 7 powered up (Serial number JAF144HHVBA)

 Starting Module 10 EPLD Upgrade
Module 10 : Power Manager [Upgrade Started  ]
Module 10 : Power Manager [Erasing          ] : 100.00%
Module 10 : Power Manager [Programming      ] : 100.00% (1247907 of 1247907 total bytes)
Module 10 : IO [Upgrade Started  ]

 Starting Module 1 EPLD Upgrade
Module 1 : Power Manager [Upgrade Started  ]

 Starting Module 4 EPLD Upgrade
Module 4 : Power Manager [Upgrade Started  ]

 Starting Module 7 EPLD Upgrade
Module 7 : Power Manager [Upgrade Started  ]
Module 1 : Power Manager [Erasing          ] : 100.00%
Module 1 : Power Manager [Programming      ] : 100.00% (1247907 of 1247907 total bytes)
Module 1 : IO [Upgrade Started  ]
Module 4 : Power Manager [Erasing          ] : 100.00%
Module 7 : Power Manager [Erasing          ] : 100.00%
Module 4 : Power Manager [Programming      ] : 100.00% (1247907 of 1247907 total bytes)
Module 4 : IO [Upgrade Started  ]
Module 7 : Power Manager [Programming      ] : 100.00% (1247907 of 1247907 total bytes)
Module 7 : IO [Upgrade Started  ]
Module 10 : IO [Erasing          ] : 100.00%
Module 1 : IO [Erasing          ] : 100.00%
Module 4 : IO [Erasing          ] : 100.00%
Module 7 : IO [Erasing          ] : 100.00%
Module 10 : IO [Programming      ] : 100.00% (5718283 of 5718283 total bytes)

 Module 10 Upgrade Done.

Waiting for Module 10 to come online.
Module 1 : IO [Programming      ] : 100.00% (5718283 of 5718283 total bytes)

 Module 1 Upgrade Done.

Waiting for Module 1 to come online.
Module 4 : IO [Programming      ] : 100.00% (5718283 of 5718283 total bytes)

 Module 4 Upgrade Done.

Waiting for Module 4 to come online.
Module 7 : IO [Programming      ] : 100.00% (5718283 of 5718283 total bytes)

 Module 7 Upgrade Done.

Waiting for Module 7 to come online.
2012 Sep 25 23:02:31 switch-Test-switch %$ VDC-2 %$ %PLATFORM-2-MOD_PWRDN: Module 10 powered down (Serial number JAF124567HB)

2012 Sep 25 23:02:31 switch-test2 %$ VDC-3 %$ %PLATFORM-2-MOD_PWRDN: Module 10 powered down (Serial number JAF124567HB)

2012 Sep 25 23:02:31 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRDN: Module 10 powered down (Serial number JAF124567HB)

2012 Sep 25 23:02:39 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 10 detected (Serial number JAF124567HB) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 23:02:39 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 10 powered up (Serial number JAF124567HB)

2012 Sep 25 23:02:39 switch-Test-switch %$ VDC-2 %$ %PLATFORM-2-MOD_DETECT: Module 10 detected (Serial number JAF124567HB) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 23:02:39 switch-Test-switch %$ VDC-2 %$ %PLATFORM-2-MOD_PWRUP: Module 10 powered up (Serial number JAF124567HB)

2012 Sep 25 23:02:39 switch-test2 %$ VDC-3 %$ %PLATFORM-2-MOD_DETECT: Module 10 detected (Serial number JAF124567HB) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 23:02:39 switch-test2 %$ VDC-3 %$ %PLATFORM-2-MOD_PWRUP: Module 10 powered up (Serial number JAF124567HB)

2012 Sep 25 23:02:53 switch-Test-switch %$ VDC-2 %$ %PLATFORM-2-MOD_PWRDN: Module 1 powered down (Serial number JAF144GT5TY)

2012 Sep 25 23:02:53 switch-test2 %$ VDC-3 %$ %PLATFORM-2-MOD_PWRDN: Module 1 powered down (Serial number JAF144GT5TY)

2012 Sep 25 23:02:53 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRDN: Module 1 powered down (Serial number JAF144GT5TY)

2012 Sep 25 23:03:01 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 1 detected (Serial number JAF144GT5TY) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 23:03:02 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 1 powered up (Serial number JAF144GT5TY)

2012 Sep 25 23:03:02 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRDN: Module 4 powered down (Serial number JAF140GGH5T)

2012 Sep 25 23:03:01 switch-Test-switch %$ VDC-2 %$ %PLATFORM-2-MOD_DETECT: Module 1 detected (Serial number JAF144GT5TY) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 23:03:02 switch-Test-switch %$ VDC-2 %$ %PLATFORM-2-MOD_PWRUP: Module 1 powered up (Serial number JAF144GT5TY)

2012 Sep 25 23:03:02 switch-Test-switch %$ VDC-2 %$ %PLATFORM-2-MOD_PWRDN: Module 4 powered down (Serial number JAF140GGH5T)

2012 Sep 25 23:03:01 switch-test2 %$ VDC-3 %$ %PLATFORM-2-MOD_DETECT: Module 1 detected (Serial number JAF144GT5TY) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 23:03:02 switch-test2 %$ VDC-3 %$ %PLATFORM-2-MOD_PWRUP: Module 1 powered up (Serial number JAF144GT5TY)

2012 Sep 25 23:03:02 switch-test2 %$ VDC-3 %$ %PLATFORM-2-MOD_PWRDN: Module 4 powered down (Serial number JAF140GGH5T)

2012 Sep 25 23:03:08 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRDN: Module 7 powered down (Serial number JAF144HHVBA)

2012 Sep 25 23:03:08 switch-Test-switch %$ VDC-2 %$ %PLATFORM-2-MOD_PWRDN: Module 7 powered down (Serial number JAF144HHVBA)

2012 Sep 25 23:03:08 switch-test2 %$ VDC-3 %$ %PLATFORM-2-MOD_PWRDN: Module 7 powered down (Serial number JAF144HHVBA)

2012 Sep 25 23:03:10 switch-Test-switch %$ VDC-2 %$ %PLATFORM-2-MOD_DETECT: Module 4 detected (Serial number JAF140GGH5T) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 23:03:10 switch-Test-switch %$ VDC-2 %$ %PLATFORM-2-MOD_PWRUP: Module 4 powered up (Serial number JAF140GGH5T)

2012 Sep 25 23:03:10 switch-test2 %$ VDC-3 %$ %PLATFORM-2-MOD_DETECT: Module 4 detected (Serial number JAF140GGH5T) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 23:03:10 switch-test2 %$ VDC-3 %$ %PLATFORM-2-MOD_PWRUP: Module 4 powered up (Serial number JAF140GGH5T)

2012 Sep 25 23:03:10 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 4 detected (Serial number JAF140GGH5T) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 23:03:10 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 4 powered up (Serial number JAF140GGH5T)

2012 Sep 25 23:03:16 switch-Test-switch %$ VDC-2 %$ %PLATFORM-2-MOD_DETECT: Module 7 detected (Serial number JAF144HHVBA) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 23:03:16 switch-Test-switch %$ VDC-2 %$ %PLATFORM-2-MOD_PWRUP: Module 7 powered up (Serial number JAF144HHVBA)

2012 Sep 25 23:03:16 switch-test2 %$ VDC-3 %$ %PLATFORM-2-MOD_DETECT: Module 7 detected (Serial number JAF144HHVBA) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 23:03:16 switch-test2 %$ VDC-3 %$ %PLATFORM-2-MOD_PWRUP: Module 7 powered up (Serial number JAF144HHVBA)

2012 Sep 25 23:03:16 switch %$ VDC-1 %$ %PLATFORM-2-MOD_DETECT: Module 7 detected (Serial number JAF144HHVBA) Module-Type 10/100/1000 Mbps Ethernet Module Model N7K-M148GT-11

2012 Sep 25 23:03:16 switch %$ VDC-1 %$ %PLATFORM-2-MOD_PWRUP: Module 7 powered up (Serial number JAF144HHVBA)

Module 10 EPLD upgrade is successful.

Module 1 EPLD upgrade is successful.

Module 4 EPLD upgrade is successful.

Module 7 EPLD upgrade is successful.

EPLD Upgrade Completed.
Module    Type  Upgrade-Result
------    ----  --------------
     1      LC         Success
     4      LC         Success
     7      LC         Success
    10      LC         Success

! Total Time 7 Min

As you can see, if you can afford taking all the linecards in a chassis offline, which is usually the case when you have dual chassis, performing parallel EPLD upgrade can save you a lot of time. However, if you only have one chassis and would like to maintain connectivity for dual-homed hosts between linecards during upgrade, the traditional sequential method would be mandatory.

For our final comment, these timings are only approximate. Our intention is to show you that there is relative reduction in the time required to upgrade/downgrade EPLD on I/O modules. You should not anticipate the exact result in your environment as your hardware type and quantity will most likely be different.  For additional information on EPLD upgrade, please consult Cisco Nexus documentation and release notes.
 

 

About Author

Metha Chiewanichakorn, CCIE#23585 (Ent. Infra, Sec, SP), is a Cisco networking enthusiast with years of experience in the industry. He is currently working as a consulting engineer for a Cisco partner. As a founder of and an instructor at labminutes.com, Metha enjoys learning and challenges himself with new technologies.