This section provides procedures for replacing an AMC590 HDD.
Assumptions
No USB keys are used for installation of the AMC590 HDD.
Preparation
This section provides the preparation procedure for the AMC590 HDD replacement.
To replace an AMC590 HDD
- Follow step 1 to step 3 of the Scenario 3: Hard Drive is still Mounted to ensure the faulty AMC590 card is properly unmounted.
- Extract the faulty AMC590 card using the procedure Extracting and Inserting an AMC.
- Insert the new AMC590.
- Reboot the AMC121 on the same blade of the replaced AMC590.
- After the reboot is done log on to the AMC121 card that is on the same blade as the AMC590 replacement card.
Make sure that the /dev/sda device is shown in the output.
fdisk -l
Disk /dev/sda: 120.0 GB, 120034123776 bytes
255 heads, 63 sectors/track, 14593 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00000000
Device Boot Start End Blocks Id System
/dev/sda1 1 3648 29302559+ 83 Linux
/dev/sda2 3649 14593 87915712+ 83 Linux
Disk /dev/sdb: 3963 MB, 3963617280 bytes
122 heads, 62 sectors/track, 1023 cylinders
Units = cylinders of 7564 * 512 = 3872768 bytes
Disk identifier: 0x00000000
Device Boot Start End Blocks Id System
/dev/sdb1 1 139 525697+ 83 Linux
/dev/sdb2 140 581 1671644 83 Linux
/dev/sdb3 582 1023 1671644 83 Linux
From an SSH session on the AMC121 CPU that is in the same Carrier blade as the new AMC590 HDD, format the hard drive using the format_hard_drive command.
The prompts encountered depend on the pre-existing mounting/formatting status of the hard drive.
Scenario 1: Hard Drive is not Mounted
Follow the instructions in this procedure to replace an AMC590 HDD if this card is not mounted.
To replace an AMC590 HDD if this card is not mounted
- Do one of the following:
Stop all applications before rebooting the AMC121.
Reboot the respective AMC121.
When the reboot is completed, access the AMC121 CPU command prompt again and execute the format_hard_drive from step 7, To replace an AMC590 HDD.
Do one of the following:
If the format_hard_drive command is successfully completed, proceed to To prepare the AMC590 HDD directories.
If the HDD is still not mounted after executing step 1 for a second time, contact Customer Support.
Follow the instructions in this procedure if an AMC590 HDD is already formatted.
- Perform one of the following:
Enter y and press ENTER.
- Do one of the following:
- If the format fails with the error "The hard drive is still mounted", go to Scenario 3: Hard Drive is still Mounted.
- Otherwise, after successful formatting of the hard drive proceed to To prepare the AMC590 HDD directories.
Scenario 3: Hard Drive is Still Mounted
Follow the instructions in this procedure if an AMC590 HDD is still mounted.
To replace an AMC590 HDD if this card is still mounted
- Do one of the following:
- Do the following to identify and stop the processes running that are preventing the AMC590 HDD from being unmounted.
List the watchdog processes using the command wd.
wd
WID PID STA RPT RHT HTV HTT COM
1 2211 S+ 0 0 10 10 slotmon --platform SP2K -s 24 -g 0 -p /op...
2 4850 S+ 0 0 10 10 pxbr -p /opt/cpu_ss7gw/current/data/ --pl...
3 4858 S+ 0 0 10 10 upp -p /opt/cpu_ss7gw/current/data/ --pla...
4 4865 S+ 0 0 10 10 sca -p /opt/cpu_ss7gw/current/data/
5 4872 S+ 0 0 10 10 sysmon -p /opt/cpu_ss7gw/current/scripts ...
6 4879 S+ 0 0 10 10 hwmon --platform SP2K -c 20
7 4952 S+ 0 0 10 10 snmpd -f -c /opt/cpu_ss7gw/current/data/s...
8 5324 S+ 0 0 10 10 licensed -r -f /opt/cpu_ss7gw/current/dat...
9 5331 S+ 0 0 10 10 snm --platform SP2K -p /opt/cpu_ss7gw/cur...
10 5338 S+ 0 0 10 10 gws --platform SP2K -p /opt/cpu_ss7gw/cur...
11 5397 S+ 0 0 10 10 dre --platform SP2K -p /opt/cpu_ss7gw/cur...
12 5404 S+ 0 0 10 10 sccp --platform SP2K -p /opt/cpu_ss7gw/cu...
13 5418 S+ 0 0 10 10 dinamo --platform SP2K -p /opt/cpu_ss7gw/...
14 5440 S+ 0 0 10 10 pt_route_refreshd --no-daemon
Stop the snmpd process using the watchdog wd -t <wid> command.
Tip
Find the snmpd process from the preceding information and use its WID value in the terminate command:
For example,
Using the fuser command, find out what processes are still accessing the AMC590 HDD:
fuser -m /var/log
/var/log: 2548 5174 26243 30967 <==== NOTE: this may return 1 or more process ids.
Save this output for later use.
Edit the /etc/inittab file and comment out the lm line.
vi /etc/inittab
<... stuff snipped>
l0:0:wait:/etc/rc.d/rc.6 halt
l1:1:wait:/etc/rc.d/rc.6 admin
l3:34:wait:/etc/rc.d/boot_log /etc/rc.d/rc.3
l4:4:wait:/etc/rc.d/boot_log /etc/rc.d/rc.4
l6:6:wait:/etc/rc.d/rc.6 reboot
#lm:4:respawn:/sbin/logmonitor <======= put # at the start of this line.>
nm:4:respawn:/sbin/ntpmonitor
bm:4:respawn:/sbin/blkmonitor
dm:4:respawn:/sbin/dhcpmonitor
rm:4:respawn:/usr/sbin/rmactive
<... stuff snipped>
:wq!
Tip
Make sure to enter ! because this is a read-only file.
Activate the changes.
You may see the following:
INIT: Sending processes the TERM signal
Kill each process ID reported in the output from step D.
kill -9 2548 5174 26243 30967
Make sure that there are no longer any processes accessing the AMC590 HDD mounts by using the fuser command again:
Tip
The /var/log directory should be empty. If this directory contains any process IDs, perform the kill -9 <proc ids> step again with these values.
Unmount the filesystems mounted to the AMC590 HDD.
sync
umount -f /var/log
umount -f /var/stats
...ignore any warnings that /var/log or /var/stats are not mounted.
- Repeat the steps from format_hard_drive from step 7, To replace an AMC590 HDD in the first procedure (format_hard_drive) again.
Read the information that is similar to the following (Format/Reformat the Hard Drive) and proceed to the next step.
Partitioning the hard drive
Hard drive successfully partitioned.
Creating filesystems on the hard drive:
creating ext3 filesystem on /dev/sda1
creating ext3 filesystem on /dev/sda2
Creating directories and mounting the hard drive: Directories successfully created.
Hard drive successfully mounted.
Hard drive formatting successfully completed.
Proceed to the section Prepare the AMC590 HDD Directories.
Prepare the AMC590 HDD Directories
Perform the following procedure to prepare the AMC590 HDD directories.
To prepare the AMC590 HDD directories
- Do one of the following:
If the slot 11 AMC590 HDD was replaced, on slot14 enter the following:
mkdir -p /var/log/cpu_ss7gw/current/load
scp root@slot24_0:/var/log/cpu_ss7gw/current/load/stp* /var/log/cpu_ss7gw/ current/load
mkdir -p /var/log/backups
scp root@slot24_0:/var/log/backups/* /var/log/backups
If the slot 21 AMC590 HDD was replaced, on slot24 enter the following:
mkdir -p /var/log/cpu_ss7gw/current/load
scp root@slot14_0:/var/log/cpu_ss7gw/current/load/stp*
/var/log/cpu_ss7gw/current/load
mkdir -p /var/log/backups
scp root@slot14_0:/var/log/backups/* /var/log/backups
Restore the logging subsystems by doing the following.
Edit the /etc/inittab file and remove the comment character to restore the lm line.
For example:
vi /etc/inittab
<... stuff snipped>
l0:0:wait:/etc/rc.d/rc.6 halt
l1:1:wait:/etc/rc.d/rc.6 admin
l3:34:wait:/etc/rc.d/boot_log /etc/rc.d/rc.3
l4:4:wait:/etc/rc.d/boot_log /etc/rc.d/rc.4
l6:6:wait:/etc/rc.d/rc.6 reboot
lm:4:respawn:/sbin/logmonitor <======= REMOVE the # at the start of this line.
AMC590 (HDD) Replacenm:4:respawn:/sbin/ntpmonitor
bm:4:respawn:/sbin/blkmonitor
dm:4:respawn:/sbin/dhcpmonitor
rm:4:respawn:/usr/sbin/rmactive
<... stuff snipped>
:wq!
Tip
Make sure to enter ! because this is a read-only file.
Activate the changes.
For example,
Tip
You may see the following.
INIT: Sending processes the TERM signal
Restart the log monitor.
Restart any applications that may have been deactivated.
Tip
The new AMC590 HDD is now ready and should be able to process logs and statistics.
Verify this by tailing the debug logs.
tail -f /var/log/ptidbglog
Tip
You should see the debug logs being generated. Make sure that the contents of logs are identical from both slots. If the contents of the logs are not identical from both slots, contact Customer Support.