Cisco ASR 9000 Power-module failure condition raised
We were recently doing some chassis replacements and I got my final ASR 9000 chassis in. We were able to successfully upgrade it and were letting it do its customary hardware burn in when we notice some odd messages hitting the log:
RP/0/RSP0/CPU0:Nov 8 13:44:57.220 CST: pwrmon[381]: %PLATFORM-PWRMON-2-MODULE_FAILURE : Power-module 0/PS0/M0/SP failure condition raised
RP/0/RSP0/CPU0:Nov 8 13:44:58.322 CST: pwrmon[381]: %PLATFORM-PWRMON-2-MODULE_FAIL_REASON : Power-module 0/PS0/M0/SP fail reason: Module shutdown due to no external stable input power feed present
RP/0/RSP0/CPU0:Nov 8 13:44:58.322 CST: pwrmon[381]: %PLATFORM-PWRMON-2-MODULE_FAILURE : Power-module 0/PS0/M1/SP failure condition raised
RP/0/RSP0/CPU0:Nov 8 13:44:59.425 CST: pwrmon[381]: %PLATFORM-PWRMON-2-MODULE_FAIL_REASON : Power-module 0/PS0/M1/SP fail reason: Module shutdown due to no external stable input power feed present
RP/0/RSP0/CPU0:Nov 8 13:44:59.425 CST: pwrmon[381]: %PLATFORM-PWRMON-2-MODULE_FAILURE : Power-module 0/PS0/M2/SP failure condition raised
RP/0/RSP0/CPU0:Nov 8 13:45:00.527 CST: pwrmon[381]: %PLATFORM-PWRMON-2-MODULE_FAIL_REASON : Power-module 0/PS0/M2/SP fail reason: Module shutdown due to no external stable input power feed present
When we tried to examine the modules we got the following:
RP/0/RSP1/CPU0#admin sh env power
Fri Nov 8 12:05:33.672 CST
R/S/I Modules Capacity Status
(W)
0/PS0/M0/*
host PM 0 Unpowered0/PS0/M1/*
host PM 0 Unpowered0/PS0/M2/*
host PM 0 UnpoweredR/S/I Power Supply Voltage Current
(W) (V) (A)
0/PS0/M0/* 0.0 0.0 0.0
0/PS0/M1/* 0.0 0.0 0.0
0/PS0/M2/* 0.0 0.0 0.0
————–
Total: 0.0
Our chassis has 4 horizontal PSUs, and the info above is only showing 3 slots, and none are registering power…but the chassis is up and working. It turns out the chassis comes with several hardware configurations, and the operator can make configuration changes that tell the chassis which it is utilizing. For some reason this chassis decided to default to the wrong configuration.
Check this link for full options.
First the following is run to begin the process to change the PSU configuration:
1 2 3 4 5 6 7 8 9 10 | RP/0/RSP0/CPU0:RO9_P2RSP3# run Wed Jul 4 20:18:58.034 UTC # pwrmod_change Current system: power supply type : AC power supply version 2 chassis type : 10-slot chassis bpid: 0x2fa, PID: ASR-9010-AC UDI name: ASR-9010 AC, UDI desc: ASR-9010 AC |
This chart gives you the options to enter:
Please enter the number that corresponds to the power supply type that is being migrated
to. Do not enter the current power system information, use the future power system type.
1) AC power supply version 1, fits 3 across in single power shelf
2) DC power supply version 1, fits 3 across in single power shelf
3) AC power supply version 2, fits 4 across in single power shelf
4) DC power supply version 2, fits 4 across in single power shelf
5) AC power supply version 3, fits 3 across in single power shelf
6) DC power supply version 3, fits 4 across in single power shelf
ATTENTION: You are about to commit a change in the power system type for the chassis.
Please confirm that the OLD and NEW power system information listed here is correct.
Once the system software change is committed, you must physically remove the OLD power
system and replace it with the NEW power system of the type specified below here. Any
mismatch between the programmed system value and the actual physical installation may
cause boot and power management issues in the system.
From here I just entered the number 3 because I have 4 AC power supplies horizontal on one shelf. Shortly after entering the command everything was showing up properly, and all was right with the world. I hope this helps you out, as it can be a bit obtuse to diagnose.
Happy routing folks 🙂