In this section:
Upgrading the DSC 8000
Screen captures, images, and code on this page are examples only and are the same between releases with the exception of the software version numbers.
Do not log onto the system using the shared IP addresses on the Management CPUs during the upgrade processes. These addresses are disabled as part of this process.
It is recommended that you perform the upgrade from a console port. A loss of connection while CPUs are being upgraded may require a rollback from the upgraded management CPU.
Workflow
You must upgrade the DSC 8000 system cards in the following order: (1) CPUs, (2) MCH Ethernet Switches, and (3) IO cards.
Upgrade the Software on the CPUs
Start
Log onto the DSC 8000 Management CPU in slot 13 (p19p2.5, Control shelf) or slot 2 (p19p1.3).
NoteYou must log onto the same CPU as the one you connected to upload the _upgrade.sh file.
Run command "upgrade" and press ENTER.
Example::::::::::::::::::::::::::::::: Ribbon DSC :::::::::::::::::::::::::::::::: +-------------------+ ¦DSC8000 CPU Upgrade¦ +-------------------+ _____________________________________________ Type "q" to quit from most prompts or CTRL-C. This process will prepare each CPU for upgrade before rebooting each CPU in order, isolating the reboots to avoid outages. -----------------------------Pre Upgrade Check------------------------------ Current pre-upgrade check lists errors. Type "yes" to re-execute this check (exiting otherwise):
Type "yes", and press ENTER.
Example======== Performing upgrade PRE-checks... ========= --------------------------------------------------- USB device check... --------------------------------------------------- Check USB device status on all the CPU or VM slots reported by cardlist/slotmon SLOT: 2 SLOT:13 SLOT: 3 SLOT:12 PASSED <Enter> to continue
Press ENTER.
Example--------------------------------------------------- Ping connectivity check... --------------------------------------------------- Ping all slots which are CPUS or IOs in /opt/cpu_ss7gw/current/data/slot.conf to check card availability Ping all the slots reported by cardlist/slotmon to check packet loss -Slot: 2 Packets dropped: 0% -Slot: 13 Packets dropped: 0% -Slot: 3 Packets dropped: 0% -Slot: 12 Packets dropped: 0% -Slot: 6 Packets dropped: 0% -Slot: 10 Packets dropped: 0% PASSED <Enter> to continue
One of the following will be displayed on the system depending on if SDA is deployed.
For a system doesn't deploy SDA:
--------------------------------------------------- Checking SDA configuration --------------------------------------------------- flex_slot.conf file doesn't exist ... This is expected if SDA is not configured on the system.
For a system that deploys SDA:
--------------------------------------------------- Checking SDA configuration --------------------------------------------------- Found DRBD 9.0 configuration on your system. PASSED
Press ENTER.
Press ENTER.
Example--------------------------------------------------- Free space check... --------------------------------------------------- -Available RAM space: 10500 MB -Available HDD (/var/log) space: 34159 MB -Available Compact Flash (/opt directory) space: 26564 MB PASSED <Enter> to continue
Press ENTER.
ExampleChecking current Clock Settings... --------------------------------------------------- Current Clock Settings... --------------------------------------------------- TIMEZONE: CPU Slot 2: -05 (EST) CPU Slot 13: -05 (EST) CPU Slot 3: -05 (EST) CPU Slot 12: -05 (EST) IO Slot 6: -05 (EST) IO Slot 10: -05 (EST) HWCLOCK: CPU Slot 2: Fri 09 Oct 2020 04:19:26 AM EST -0.407717 seconds CPU Slot 13: Thu 08 Oct 2020 04:18:34 AM EST -0.485793 seconds CPU Slot 3: Thu 08 Oct 2020 04:18:48 AM EST -0.564361 seconds CPU Slot 12: Thu 08 Oct 2020 04:18:45 AM EST -0.798552 seconds IO Slot 6: IO Slot 10: WALL CLOCK: CPU Slot 2: Fri Oct 9 04:19:29 EST 2020 CPU Slot 13: Fri Oct 9 04:19:30 EST 2020 CPU Slot 3: Fri Oct 9 04:19:30 EST 2020 CPU Slot 12: Fri Oct 9 04:19:30 EST 2020 IO Slot 6: Fri Oct 9 04:19:31 EST 2020 IO Slot 10: Fri Oct 9 04:19:31 EST 2020 <Enter> to continue
Press ENTER.
Example--------------------------------------------------- Validating NEW license keys... --------------------------------------------------- New load release: .. uses the same licensing as the current load release: .., so skipping this check. PASSED <Enter> to continue
Press ENTER.
Example---------------------------------------------------------------- Checking if firmware flashing is recommended... ---------------------------------------------------------------- -CPU Slot: 2 Firmware upgrade to 1.24 or greater recommended. Board Type: AMC124 Current Firmware version: 1.22 -CPU Slot: 13 Firmware upgrade to 1.24 or greater recommended. Board Type: AMC124 Current Firmware version: 1.22 -CPU Slot: 3 Firmware upgrade to 1.24 or greater recommended. Board Type: AMC124 Current Firmware version: 1.22 -CPU Slot: 12 Firmware upgrade to 1.24 or greater recommended. Board Type: AMC124 Current Firmware version: 1.22 -IO Slot: 6 Firmware up to date. Board Type: AMC348 Current Firmware version: 1.04 -IO Slot: 10 Firmware up to date. Board Type: AMC348 Current Firmware version: 1.00 -MCH Slot: 1 Firmware up to date. Board Type: AMC671 Current Firmware version: 1.26 -MCH Slot: 14 Firmware up to date. Board Type: AMC671 Current Firmware version: 1.26 -Chassis 1/cu1: Firmware up to date. Board Type: Cooling Unit Current Firmware version: 1.10 -Chassis 1/cu2: Firmware up to date. Board Type: Cooling Unit Current Firmware version: 1.10 -Chassis 1/pm1: Firmware up to date. Board Type: Power Module Current Firmware version: 1.24 -Chassis 1/pm2: Cannot get firmware version from Power Module. Check that component is inserted. -Chassis 1/pm4: Firmware up to date. Board Type: Power Module Current Firmware version: 1.24 **************************************************** *** FIRMWARE ON ONE OR MORE CARDS IS OUT OF DATE. *** *** IT IS RECOMMENDED THAT THE FIRMWARE BE UPDATED *** PER INSTRUCTIONS FOUND IN THE UPGRADE GUIDE *** AFTER THE UPGRADE IS COMPLETED. *** *** PLEASE CONTACT RIBBON CUSTOMER SUPPORT *** FOR MORE INFORMATION. *************************************************** WARNING <Enter> to continue
Press ENTER.
---------------------------------------------------------------- Pre-setting and verifying new FS volume labels... ---------------------------------------------------------------- -CPU Slot: 2 FS volume labels set and verified -CPU Slot: 13 FS volume labels set and verified -CPU Slot: 3 FS volume labels set and verified -CPU Slot: 12 FS volume labels set and verified PASSED <Enter> to continue
Press ENTER.
Example---------------------------------------------------------------- Checking if CPU Unused SATA Channels are Disabled... ---------------------------------------------------------------- -CPU Slot: 2 Unused SATA Channels are Disabled. Board Type: AMC124 -CPU Slot: 13 Unused SATA Channels are Disabled. Board Type: AMC124 -CPU Slot: 3 Unused SATA Channels are Disabled. Board Type: AMC124 -CPU Slot: 12 Unused SATA Channels are Disabled. Board Type: AMC124 PASSED <Enter> to continue
Press ENTER.
Example--------------------------------------------------- Check Kernel and Mount Points. --------------------------------------------------- No tests to perform. <Enter> to continue
Press ENTER.
Press ENTER.
Example--------------------------------------------------- GWS Incoming Linkset check --------------------------------------------------- No GWS Incoming Linkset check needed for this X511 version <Enter> to continue
Press ENTER.
Example------------------------------------------------------------------------- Checking uniqueness of Linkset Point Codes per NA ------------------------------------------------------------------------- PASSED <Enter> to continue
Press ENTER.
Example------------------------------------------------------------------------- Checking if DB Definition of GTT NA and its LPC registration match ------------------------------------------------------------------------- PASSED <Enter> to continue
Press ENTER.
--------------------------------------------------- Ensure pcs files are in proper locations... --------------------------------------------------- PASSED <Enter> to continue
Press ENTER.
--------------------------------------------------- Ensure correct cluster password... --------------------------------------------------- PASSED <Enter> to continue
Press ENTER.
Example--------------------------------------------------- Audit files check... --------------------------------------------------- Audit status: local copy of /opt/cpu_ss7gw/current/data/mtp.1.3.conf is different from 13, due to blank lines only 0 files were out of sync. Files: 83 Copied: 0 Deleted: 0 PASSED <Enter> to continue
Press ENTER.
Example--------------------------------------------------- Test TIPC bearers... --------------------------------------------------- <Enter> to continue
Press ENTER.
Example--------------------------------------------------- Reminder to take a backup... --------------------------------------------------- -It is highly recommended to take a backup of the system prior to starting the upgrade. Label and keep the backup in a safe place. <Enter> to continue
Press ENTER.
Example====== The results of the PRE upgrade check are stored in /var/log/cpu_ss7gw/upgrade_data/PRE_UPGRADE_DATA.dsc_8000_18_1_0_nb20200612.Fri_Oct__9_04_18_52_EST_2020 ====== Upgrade PRE checks completed. All checks PASSED. You may now proceed with the upgrade. ----------------------------Upgrade Information----------------------------- Using /shared/log/dsc_8000_20_0_0_nb20201008_upgrade.sh Upgrading to: 20_0_0_nb20201008 Requiring update: 2 3 12 13 Up to date: None I/O Cards: 10 6 Uncommissioned/Bad: None Confirmation to proceed with upgrade operations? (yes/no):
Type "yes" and press ENTER.
Type "yes" and press ENTER.
ExampleUpgrade execution order [13, 3, 12, 2]. To continue, press the Enter key:
Press ENTER.
Example-----------------------------Final upgrade step----------------------------- Upgrading peer 13 Backup stats files..............Pass Modify boot file................Pass Setting restore information.....Pass Rebooting.......................Pass Waiting to recover..............Pass Waiting for system processes....Pass Machine 13 is complete, type "yes" to continue.:
The script will upgrade remaining cards one a a time. Respond with "yes" when prompted to continue.
- Continue to upgrade all CPUs. After the software upgrade is completed on the CPUs, ensure that the upgrade was successful and the software was properly installed by continuing to the next section.
Verify the CPU Software has been Properly Installed
If an asterisk appears beside any of the system cards during the verification process, the upgrade for the respective card was unsuccessful. In this case, it is recommended that you contact Customer Support.
Start
- At the Linux prompt, enter startmenu, and press ENTER.
- Select System, and press ENTER.
- Select Software Revisions, and press ENTER.
- Select CPU Versions, and press ENTER
Make sure that the software and OS have been upgraded, all cards are running the same software, and that there are no asterisks beside any of the cards.
TipThe output of the “CPU Versions” command shows that the CPU card has “UPGRADED” status if this is the first time the command is issued after an upgrade. All subsequent “CPU Versions” commands show the number of processes running on each CPU.
ExampleAVAILABLE SOFTWARE VERSIONS -------------------------------------------------------------------------------- No new load detected on system. Upload and run load .sh file on /var/log before attempting upgrade. CPU (current) dsc_8000_20_0_0_nb20201008 OS: Ribbon7.4.18 (Servicepack) [none applied] CPU (previous) dsc_8000_18_1_0_nb20200612 OS: Ribbon7.4.18 (Servicepack) RUNNING SOFTWARE VERSIONS (*=update required, ?=update unknown) CARD BUILD SERVICE O/S -SLOT----TYPE----------RELEASE--VERSION----PACK---IMAGE-------CARD STATUS--- -------------------------------------------------------------------------------- Slot 2 MGMT 20.0.0 (nb20201008) SP: OS: Ribbon7.4.18 18 procs running Slot 13 MGMT 20.0.0 (nb20201008) SP: OS: Ribbon7.4.18 18 procs running Slot 3 ROUTING 20.0.0 (nb20201008) SP: OS: Ribbon7.4.18 21 procs running Slot 12 ROUTING 20.0.0 (nb20201008) SP: OS: Ribbon7.4.18 21 procs running (p=servicepack is partially applied) Select CPU slot number (9) to begin commissioning of individual card(s). Enter slot # or ENTER to cancel: No selection, exiting.
- Press ENTER to cancel.
- Pressing ENTER displays the Main Menu.
Upgrade the Software on the Ethernet (MCH) Cards
Start
- At the Linux prompt, enter startmenu, and press ENTER.
- Select System, and press ENTER.
- Select Software Revisions, and press ENTER.
Select Switch Versions, and press ENTER.
ExampleAVAILABLE SOFTWARE VERSIONS -------------------------------------------------------------------------------- MCH (current) dsc_8000_20_0_0_nb20201008 (Servicepack) [none applied] MCH (previous) dsc_8000_18_1_0_nb20200612 (Servicepack) RUNNING SOFTWARE VERSIONS (*=update required, ?=update unknown) CARD BUILD SERVICE O/S -SLOT----TYPE------RELEASE-VERSION----PACK-----IMAGE------------CARD STATUS----- -------------------------------------------------------------------------------- -- Chassis 1 -- Slot 1 MCH * 18.1.0 (nb20200612) SP: Slot 14 MCH * 18.1.0 (nb20200612) SP: (p=servicepack is partially applied) Status legend: A - Active, S - Standby, ? - Unknown Select MCH slot number (1 14) to begin upgrade of ISM and SWITCH functions on that MCH. VERSION field modifiers (investigate & update): '***' - a mismatch between the two switches within the MCH. '*!!' - one of the two switches within the MCH is unreachable. Enter slot # or ENTER to cancel:
Type "14" and press ENTER.
ExampleNote: flex_slot.conf file doesn't exist ... This is ok if the SDA is not configured on the system. Software Update for Switch Card in Slot #14 Determining running and current software version. Please wait... Running on SWITCH (slot14_0): -Load: dsc_8000_18_1_0_nb20200612 Current SWITCH version (on MGMT CPU): -Load: dsc_8000_20_0_0_nb20201008 -Servicepack: [none applied] 'u' - Update version (update slot14_0 to match the current load): -Load: dsc_8000_20_0_0_nb20201008 Select action to take, or any other key to cancel:
Type "u" and press ENTER.
Exampleavail_switch_current_load is dsc_8000_20_0_0_nb20201008 avail_ism_current_load is Running SWITCH software is out-of-date! You have opted to update/reboot slot #14, thereby loading the current software: -Load: dsc_8000_20_0_0_nb20201008 -Servicepack: [none applied] MCH upgrade pre-step: disable TIPC bearer p19p2 for MCH 1. Updating/rebooting switch card in slot #14. Please wait... Note: The switch status may be unavailable for a few minutes while it performs its upgrade procedures. CPU local tftp is enabled. Running SWITCH slot 14 software is now up-to-date. MCH upgrade post-step: enable TIPC bearer p19p2 for MCH 1 Press <return> to continue.
Navigate to Software Revisions, and press ENTER.
Select Switch Versions, and press ENTER.
ExampleAVAILABLE SOFTWARE VERSIONS MCH (current) dsc_8000_20_0_0_nb20201008 (Servicepack) [none applied] MCH (previous) dsc_8000_18_1_0_nb20200612 (Servicepack) RUNNING SOFTWARE VERSIONS (*=update required, ?=update unknown) CARD BUILD SERVICE O/S -SLOT----TYPE------RELEASE-VERSION----PACK-----IMAGE------------CARD STATUS----- -------------------------------------------------------------------------------- -- Chassis 1 -- Slot 1 MCH * 18.1.0 (nb20200612) SP: Slot 14 MCH 20.0.0 (nb20201008) SP: (p=servicepack is partially applied) Status legend: A - Active, S - Standby, ? - Unknown Select MCH slot number (1 14) to begin upgrade of ISM and SWITCH functions on that MCH. VERSION field modifiers (investigate & update): '***' - a mismatch between the two switches within the MCH. '*!!' - one of the two switches within the MCH is unreachable. Enter slot # or ENTER to cancel:
Type "1" and press ENTER.
ExampleDetermining running and current software version. Please wait... Running on SWITCH (slot1_0): -Load: dsc_8000_18_1_0_nb20200612 Current SWITCH version (on MGMT CPU): -Load: dsc_8000_20_0_0_nb20201008 -Servicepack: [none applied] 'u' - Update version (update slot1_0 to match the current load): -Load: dsc_8000_20_0_0_nb20201008 Select action to take, or any other key to cancel:
Type "u" and press ENTER.
Exampleavail_switch_current_load is dsc_8000_20_0_0_nb20201008 avail_ism_current_load is Running SWITCH software is out-of-date! You have opted to update/reboot slot #1, thereby loading the current software: -Load: dsc_8000_20_0_0_nb20201008 -Servicepack: [none applied] MCH upgrade pre-step: disable TIPC bearer p19p1 for MCH 0. Updating/rebooting switch card in slot #1. Please wait... Note: The switch status may be unavailable for a few minutes while it performs its upgrade procedures. CPU local tftp is enabled. Connection closed by foreign host.
Execute steps 1 to 10 for each shelf (chassis) if you have a multi-shelf system.
The slot numbers for the MCH cards in a multishelf configuration are as follows:
- Expansion Shelf 1 MCH slot numbers are 15 and 28
- Expansion Shelf 2 MCH slot numbers are 29 and 42
- Expansion Shelf 3 MCH slot numbers are 43 and 56
For more informaiton about the DSC 8000 hardware configuration, refer to DSC 8000 Hardware Description.
After the software upgrade is complete, make sure the upgrade was successful and the software was properly installed (see To verify the Ethernet Switch (MCH) software has been properly installed).
Verify the Ethernet Switch (MCH) Software has been Properly Installed
If an asterisk appears beside any of the system cards during the verification process, the upgrade for the respective card was unsuccessful. In this case, is recommended that you contact Customer Support.
Start
- To confirm the Ethernet Switch cards are also running the same software as the CPU cards, do the following:
- Navigate to the Software Revisions screen.
- Select Switch Versions, and press ENTER.
Make sure the software and OS have been upgraded, all cards are running the same software, and there is no asterisk beside any of the cards.
ExampleAVAILABLE SOFTWARE VERSIONS -------------------------------------------------------------------------------- MCH (current) dsc_8000_20_0_0_nb20201008 (Servicepack) [none applied] MCH (previous) dsc_8000_18_1_0_nb20200612 (Servicepack) RUNNING SOFTWARE VERSIONS (*=update required, ?=update unknown) CARD BUILD SERVICE O/S -SLOT----TYPE------RELEASE-VERSION----PACK-----IMAGE------------CARD STATUS----- -------------------------------------------------------------------------------- -- Chassis 1 -- Slot 1 MCH 20.0.0 (nb20201008) SP: Slot 14 MCH 20.0.0 (nb20201008) SP: (p=servicepack is partially applied) Status legend: A - Active, S - Standby, ? - Unknown Select MCH slot number (1 14) to begin upgrade of ISM and SWITCH functions on that MCH. VERSION field modifiers (investigate & update): '***' - a mismatch between the two switches within the MCH. '*!!' - one of the two switches within the MCH is unreachable. Enter slot # or ENTER to cancel: No selection, exiting.
- Pressing ENTER twice displays the Main Menu.
Upgrade the Software on the IO Cards
Execute both of the following procedures in order to upgrade the software on the IO cards.
Verify the Health of the IO Configuration Files
Use this procedure if the system contains IO cards. This procedure executes a health check script that verifies the existence of the mp_mtp2.conf.slotX files on the IO card as well as its synchronization to the management CPU card (X is the IO slot number).
Start
- Log onto a Management CPU.
Enter "health_check_io.sh X" to execute the health check script.
NoteX is the IO number.
This command should be executed for each IO.
- The script produces a health check result, which is either PASS or ERROR.
- If the result is ERROR, proceed to step 4 and 5.
- If the result is PASS, proceed to step 6.
- If the result is ERROR, the issue is either missing or mismatched files on the IO card.
- When an issue is detected, the script allows the user to copy the necessary files from the management CPU card to the IO card. If all the files are retrieved successfully, then the result will be PASS.
If the health check result is PASS, proceed to the next section: To Upgrade the software on the IOs
Only proceed to the upgrade IO card progress if the health check result is PASS.
Upgrade the Software on the IO Cards
Prerequisites
- You are logged onto a Management CPU.
Start
- At the Linux prompt, enter startmenu, and press ENTER.
- Select System, and press ENTER.
- Select Software Revisions, and press ENTER.
Select IO Versions and press ENTER.
ExampleAVAILABLE SOFTWARE VERSIONS -------------------------------------------------------------------------------- IO (current) AMC348 dsc_8000_20_0_0_nb20201008 OS: rel_12_00_p04.x511.img (Servicepack) [none applied] IO (prev) AMC348 dsc_8000_18_1_0_nb20200612 OS: rel_12_00_p04.x511.img (Servicepack) RUNNING SOFTWARE VERSIONS (*=update required, ?=update unknown) CARD BUILD SERVICE O/S -SLOT----TYPE----------RELEASE-VERSION------PACK-----IMAGE------- -------------------------------------------------------------------------------- Slot 6 IO AMC348 * 18.1.0 (nb20200612) SP: OS: rel_12_00_p04.x511.img Slot 10 IO AMC348 * 18.1.0 (nb20200612) SP: OS: rel_12_00_p04.x511.img (p=servicepack is partially applied) Select IO slot number (6 10) to begin upgrade or decommissioning of individual card(s). Enter slot # or ENTER to cancel:
Enter the slot number for the IO card as required (in this example, 6) and press ENTER.
TipYou may be prompted for a password from the IO card. To proceed with the upgrade, enter the root password.
ExampleNote: flex_slot.conf file doesn't exist ... This is ok if the SDA is not configured on the system. Software Update for IO Card in Slot #6 Determining running and current software version. Please wait... Running on IO (slot6_0): -Load: dsc_8000_18_1_0_nb20200612 -OS: rel_12_00_p04.x511.img Current IO version (on MGMT CPU): -Load: dsc_8000_20_0_0_nb20201008 -OS: rel_12_00_p04.x511.img -Servicepack: [none applied] 'u' - Update version (update slot6_0 to match the current load): -Load: dsc_8000_20_0_0_nb20201008 -OS: rel_12_00_p04.x511.img 'd' - Decommission this IO card to prepare it for removal. Select action to take, or any other key to cancel:
Enter "u" and press ENTER.
Exampleavail_switch_current_load is dsc_8000_20_0_0_nb20201008 avail_ism_current_load is Running IO software is out-of-date! You have opted to update/reboot slot #6, thereby loading the current software: -Load: dsc_8000_20_0_0_nb20201008 -OS: rel_12_00_p04.x511.img -Servicepack: [none applied] Pushing image to the IO card in slot #6 Executing verify_io_image.sh script on IO board in slot #6 DO NOT INTERRUPT!! THIS MAY TAKE A FEW MINUTES... Done: IO board was already up-to-date Rebooting IO card in slot #6. Press <return> to continue
Press ENTER and return to the main menu.
Repeat steps 1 to 7 for all other IO cards in the system as required.
- After the software upgrade is complete, make sure the upgrade was successful and the software was properly installed by continuing to the next section.
Verify the IO Software has been Properly Installed
If an asterisk appears beside any of the system cards during the verification process, the upgrade for the respective card was unsuccessful. In this case, is recommended that you contact Customer Support.
Start
- To confirm the IO cards are also running the same software as the CPU cards, do the following:
- Navigate to the Software Revisions screen.
- Select IO Versions, and press ENTER.
Make sure the software and OS have been upgraded, all cards are running the same software, and there is no asterisk beside any of the cards.
TipYou may be prompted to enter the appropriate password.
ExampleAVAILABLE SOFTWARE VERSIONS -------------------------------------------------------------------------------- IO (current) AMC348 dsc_8000_20_0_0_nb20201008 OS: rel_12_00_p04.x511.img (Servicepack) [none applied] IO (prev) AMC348 dsc_8000_18_1_0_nb20200612 OS: rel_12_00_p04.x511.img (Servicepack) RUNNING SOFTWARE VERSIONS (*=update required, ?=update unknown) CARD BUILD SERVICE O/S -SLOT----TYPE----------RELEASE-VERSION------PACK-----IMAGE------- -------------------------------------------------------------------------------- Slot 10 IO AMC348 * 18.1.0 (nb20200612) SP: OS: rel_12_00_p04.x511.img (p=servicepack is partially applied) Select IO slot number (10) to begin upgrade or decommissioning of individual card(s). Enter slot # or ENTER to cancel:
- Pressing ENTER twice displays the Main Menu.