Unexpect mailbox IRQ on Witherspoon during Power on
gkeishin opened this issue · comments
Noticed this on jenkins HW CI test run : gerrit: https://gerrit.openbmc-project.xyz/#/c/openbmc/openbmc/+/35426/
------------------------------------------------------------------------
APPLICATION DATA : BMC state Executed : /usr/bin/obmcutil state
------------------------------------------------------------------------
CurrentBMCState : xyz.openbmc_project.State.BMC.BMCState.Ready
CurrentPowerState : xyz.openbmc_project.State.Chassis.PowerState.On
CurrentHostState : xyz.openbmc_project.State.Host.HostState.Running
BootProgress : xyz.openbmc_project.State.Boot.Progress.ProgressStages.OSStart
OperatingSystemState: xyz.openbmc_project.State.OperatingSystem.Status.OSStatus.Inactive
SOL log:
73.28880|ISTEP 21. 2 - host_verify_hdat
73.28493|ISTEP 21. 3 - host_start_payload
[ 74.109998065,5] OPAL skiboot-v6.0.14 starting...
[ 74.110001552,7] initial console log level: memory 7, driver 5
[ 74.110003606,6] CPU: P9 generation processor (max 4 threads/core)
[ 74.110005386,7] CPU: Boot CPU PIR is 0x0824 PVR is 0x004e1201
[ 74.110008233,7] OPAL table: 0x30103730 .. 0x30103cf0, branch table: 0x30002000
[ 74.110011273,7] Assigning physical memory map table for nimbus
[ 74.110014072,7] Parsing HDAT...
[ 74.110015337,5] SPIRA-S found.
[ 74.110018167,6] BMC #0: HW version 3, SW version 2, chip DD1.0
[ 74.110397745,6] SP Family is ibm,ast2500,openbmc
[ 74.110403918,7] LPC: IOPATH chip id = 0
[ 74.110405286,7] LPC: FW BAR = f0000000
[ 74.110406772,7] LPC: MEM BAR = e0000000
[ 74.110408218,7] LPC: IO BAR = d0010000
[ 74.110409662,7] LPC: Internal BAR = c0012000
[ 74.110422172,7] LPC UART: base addr = 3f8 (3f8) size = 1 clk = 1843200, baud = 115200
[ 74.110424934,7] LPC: BT [0, 0] sms_int: 0, bmc_int: 0
[ 74.111107125,5] UART: Using UART at 0x60300d00103f8
[ 74.112978360,4] HDAT I2C: found e3p1 - unknown@1a dp:ff (ff:)
[ 74.113074539,4] HDAT I2C: found e3p1 - unknown@1b dp:ff (ff:)
[ 74.113118788,4] HDAT I2C: found e3p0 - unknown@1b dp:ff (ff:)
[ 74.113167271,4] HDAT I2C: found e3p1 - unknown@1c dp:ff (ff:)
[ 74.113209739,4] HDAT I2C: found e3p0 - unknown@1d dp:ff (ff:)
[ 74.113259045,4] HDAT I2C: found e3p1 - unknown@1d dp:ff (ff:)
[ 74.113321029,4] HDAT I2C: found e3p0 - unknown@1c dp:ff (ff:)
[ 74.113379040,4] HDAT I2C: found e3p0 - unknown@1a dp:ff (ff:)
[ 74.113433386,3] DT: dt_attach_root failed, duplicate gpio@50
[ 74.113730112,4] HDAT I2C: found e3p1 - unknown@1a dp:ff (ff:)
[ 74.113819035,4] HDAT I2C: found e3p1 - unknown@1b dp:ff (ff:)
[ 74.113864621,4] HDAT I2C: found e3p0 - unknown@1b dp:ff (ff:)
[ 74.113905755,4] HDAT I2C: found e3p1 - unknown@1c dp:ff (ff:)
[ 74.113953276,4] HDAT I2C: found e3p0 - unknown@1d dp:ff (ff:)
[ 74.113997902,4] HDAT I2C: found e3p1 - unknown@1d dp:ff (ff:)
[ 74.114053788,3] DT: dt_attach_root failed, duplicate gpio@50
[ 74.114113558,4] HDAT I2C: found e3p0 - unknown@1c dp:ff (ff:)
[ 74.114165653,4] HDAT I2C: found e3p0 - unknown@1a dp:ff (ff:)
[ 74.116776551,5] P9 DD2.10 detected
[ 74.116834396,5] CHIP: Chip ID 0000 type: P9N DD2.1
[ 74.116892697,5] P9 DD2.10 detected
[ 74.116926099,5] CHIP: Chip ID 0008 type: P9N DD2.1
[ 74.117881177,5] PLAT: Detected Witherspoon platform
[ 74.117965312,5] PLAT: Detected BMC platform ast2500:openbmc
[ 74.145674875,5] CPU: All 144 processors called in...
[ 75.398891107,5] BT: Interface initialized, IO 0x00e4
[ 75.398961432,7] LPC: Routing irq 10, policy: 0 (r=1)
[ 75.398962492,7] LPC: SerIRQ 10 using route 0 targetted at OPAL
[ 81.203118632,3] HIOMAP: hiomap_get_info failed: -1
[ 81.203171029,3] HIOMAP: Failed to get hiomap parameters
[ 81.203223472,7] LPC: Routing irq 9, policy: 0 (r=1)
[ 81.203224479,7] LPC: SerIRQ 9 using route 1 targetted at OPAL
[ 83.101046546,3] MBOX-FLASH: BMC NOT RESPONDING 1 second wait
[ 84.101167134,3] MBOX-FLASH: BMC NOT RESPONDING 2 second wait
[ 84.203662056,3] MBOX-FLASH: Timeout waiting for BMC
[ 84.203725057,3] MBOX-FLASH: Error waiting for BMC
[ 84.203767185,3] LPC-MBOX: In flight message dropped on the floor
[ 86.101496467,3] MBOX-FLASH: BMC NOT RESPONDING 1 second wait
[ 86.101568355,3] LPC-MBOX: Got a response to a message we no longer care about
[ 87.101692589,3] MBOX-FLASH: BMC NOT RESPONDING 2 second wait
[ 87.101764667,3] LPC-MBOX: Got a response to a message we no longer care about
[ 87.204223683,3] MBOX-FLASH: Timeout waiting for BMC
[ 87.204279259,3] MBOX-FLASH: Error waiting for BMC
[ 87.204310073,3] LPC-MBOX: In flight message dropped on the floor
[ 89.102042885,3] MBOX-FLASH: BMC NOT RESPONDING 1 second wait
[ 89.102123881,3] LPC-MBOX: Got a response to a message we no longer care about
[ 90.102236975,3] MBOX-FLASH: BMC NOT RESPONDING 2 second wait
[ 90.102305800,3] LPC-MBOX: Got a response to a message we no longer care about
[ 90.204775409,3] MBOX-FLASH: Timeout waiting for BMC
[ 90.204833758,3] MBOX-FLASH: Error waiting for BMC
[ 90.204884562,3] PLAT: Failed to open init PNOR driver
[ 91.005687455,4] NVRAM: Query before is done loading
[ 91.005733929,4] NVRAM: Waiting for load
[ 91.005757212,2] NVRAM: Failed to load
[ 91.005781265,4] NVRAM: Query before is done loading
[ 91.005814050,4] NVRAM: Waiting for load
[ 91.005840074,2] NVRAM: Failed to load
[ 91.005875588,5] STB: Found ibm,secureboot-v2
[ 91.005903780,4] NVRAM: Query before is done loading
[ 91.005930742,4] NVRAM: Waiting for load
[ 91.005952237,2] NVRAM: Failed to load
[ 91.005973233,5] STB: secure mode off
[ 91.006000575,4] NVRAM: Query before is done loading
[ 91.006027380,4] NVRAM: Waiting for load
[ 91.006052013,2] NVRAM: Failed to load
[ 91.006079061,5] STB: trusted mode off
[ 91.006101203,5] OPAL: Using OPAL UART console
[ 91.006106928,4] FLASH: Can't load resource id:4. No system flash found
[ 91.006108892,4] FLASH: Can't load resource id:3. No system flash found
[ 91.006209619,4] NVRAM: Query before is done loading
[ 91.006237763,4] NVRAM: Waiting for load
[ 91.006256922,2] NVRAM: Failed to load
[ 91.006280450,7] LPC: Routing irq 4, policy: 0 (r=1)
[ 91.006281313,7] LPC: SerIRQ 4 using route 2 targetted at OPAL
[ 91.006476119,4] NVRAM: Query before is done loading
[ 91.006519582,4] NVRAM: Waiting for load
[ 91.006541125,2] NVRAM: Failed to load
[ 91.006564140,5] SLW: Enabling: stop0_lite
[ 91.006587499,5] SLW: Enabling: stop0
[ 91.006608105,5] SLW: Enabling: stop1
[ 91.006628218,5] SLW: Enabling: stop2
[ 91.006649175,5] SLW: Enabling: stop4
[ 91.006667798,5] SLW: Enabling: stop5
[ 91.006690633,4] NVRAM: Query before is done loading
[ 91.006716064,4] NVRAM: Waiting for load
[ 91.006743771,2] NVRAM: Failed to load
[ 91.006824702,4] FLASH: Can't load resource id:2. No system flash found
[ 91.006884223,4] FLASH: Can't load resource id:0. No system flash found
[ 91.006897458,6] NX RNG[0] pace:2000
[ 91.006904138,6] NX RNG[8] pace:2000
[ 91.006963647,4] FLASH: Can't load resource id:1. No system flash found
[ 91.006964552,3] IMC: IMC Catalog load failed
[ 91.007041483,4] NVRAM: Query before is done loading
[ 91.007071932,4] NVRAM: Waiting for load
[ 91.007098080,2] NVRAM: Failed to load
[ 91.007124136,4] NVRAM: Query before is done loading
[ 91.007175337,4] NVRAM: Waiting for load
[ 91.007201444,2] NVRAM: Failed to load
[ 91.007227079,4] NVRAM: Query before is done loading
[ 91.007254063,4] NVRAM: Waiting for load
[ 91.007275706,2] NVRAM: Failed to load
[ 91.007296710,4] NVRAM: Query before is done loading
[ 91.007322069,4] NVRAM: Waiting for load
[ 91.007343720,2] NVRAM: Failed to load
[ 91.007364822,4] NVRAM: Query before is done loading
[ 91.007397813,4] NVRAM: Waiting for load
[ 91.007422338,2] NVRAM: Failed to load
[ 91.013888419,3] CAPP: Error loading ucode lid. index=201d1
[ 91.022339824,4] NVRAM: Query before is done loading
[ 91.022393816,4] NVRAM: Waiting for load
[ 91.022434885,2] NVRAM: Failed to load
[ 91.022735242,4] NVRAM: Query before is done loading
[ 91.022793715,4] NVRAM: Waiting for load
[ 91.022825814,2] NVRAM: Failed to load
[ 91.033123679,5] PCI: Resetting PHBs and training links...
[ 91.104971338,3] LPC-MBOX: Got a response to a message we no longer care about
[ 91.207504806,3] LPC-MBOX: Got a response to a message we no longer care about
[ 91.310038473,3] LPC-MBOX: Got a response to a message we no longer care about
[ 91.412572449,3] LPC-MBOX: Got a response to a message we no longer care about
[ 92.003106133,3] LPC-MBOX: Got a response to a message we no longer care about
[ 92.069747569,5] PCI: Probing slots...
[ 92.105683638,3] LPC-MBOX: Got a response to a message we no longer care about
[ 92.126191834,5] PHB#0000:00:00.0 [ROOT] 1014 04c1 R:00 C:060400 B:00..00 SLOT=SLOT3
[ 92.126276515,5] PHB#0001:00:00.0 [ROOT] 1014 04c1 R:00 C:060400 B:01..01
[ 92.126330706,5] PHB#0001:01:00.0 [EP ] 104c 8241 R:02 C:0c0330 ( usb-xhci)
[ 92.126385204,5] PHB#0002:00:00.0 [ROOT] 1014 04c1 R:00 C:060400 B:01..02
[ 92.126433929,5] PHB#0002:01:00.0 [ETOX] 1a03 1150 R:04 C:060400 B:02..02
[ 92.126479567,5] PHB#0002:02:01.0 [PCID] 1a03 2402 R:01 C:ff0000 ( device)
[ 92.126548088,5] PHB#0003:00:00.0 [ROOT] 1014 04c1 R:00 C:060400 B:00..00 SLOT=SLOT1
[ 92.126604824,5] PHB#0004:00:00.0 [ROOT] 1014 04c1 R:00 C:060400 B:01..12
[ 92.126656071,5] PHB#0004:01:00.0 [SWUP] 10b5 8725 R:ca C:060400 B:02..12
[ 92.126706777,5] PHB#0004:02:02.0 [SWDN] 10b5 8725 R:ca C:060400 B:03..03 SLOT=S000403
[ 92.126772824,5] PHB#0004:03:00.0 [LGCY] 1b4b 9235 R:11 C:010601 ( sata) LOC_CODE=S000403
[ 92.126837574,5] PHB#0004:02:0a.0 [SWDN] 10b5 8725 R:ca C:060400 B:04..08 SLOT=GPU0
[ 92.126896110,5] PHB#0004:02:0b.0 [SWDN] 10b5 8725 R:ca C:060400 B:09..0d SLOT=GPU1
[ 92.126958043,5] PHB#0004:02:0c.0 [SWDN] 10b5 8725 R:ca C:060400 B:0e..12 SLOT=GPU2
[ 92.127013244,5] PHB#0004:01:00.1 [EP ] 10b5 87d0 R:ca C:088000 (system-peripheral)
[ 92.127064537,5] PHB#0004:01:00.2 [EP ] 10b5 87d0 R:ca C:088000 (system-peripheral)
[ 92.127113899,5] PHB#0004:01:00.3 [EP ] 10b5 87d0 R:ca C:088000 (system-peripheral)
[ 92.127163517,5] PHB#0004:01:00.4 [EP ] 10b5 87d0 R:ca C:088000 (system-peripheral)
[ 92.127215570,5] PHB#0005:00:00.0 [ROOT] 1014 04c1 R:00 C:060400 B:01..01
[ 92.127263901,5] PHB#0005:01:00.0 [EP ] 14e4 1657 R:01 C:020000 ( ethernet)
[ 92.127315967,5] PHB#0005:01:00.1 [EP ] 14e4 1657 R:01 C:020000 ( ethernet)
[ 92.127363082,5] PHB#0006:00:00.0 [EP ] 1014 04ea R:01 C:060400 ( pci)
[ 92.127405318,5] PHB#0006:00:00.1 [EP ] 1014 04ea R:01 C:060400 ( pci)
[ 92.127455665,5] PHB#0006:00:00.2 [EP ] 1014 04ea R:01 C:060400 ( pci)
[ 92.127503731,5] PHB#0006:00:01.0 [EP ] 1014 04ea R:01 C:060400 ( pci)
[ 92.127551670,5] PHB#0006:00:01.1 [EP ] 1014 04ea R:01 C:060400 ( pci)
[ 92.127602540,5] PHB#0006:00:01.2 [EP ] 1014 04ea R:01 C:060400 ( pci)
[ 92.127647974,5] PHB#0007:00:00.0 [EP ] 1014 04ea R:01 C:060400 ( pci)
[ 92.127695730,5] PHB#0007:00:00.1 [EP ] 1014 04ea R:01 C:060400 ( pci)
[ 92.127742196,5] PHB#0007:00:00.2 [EP ] 1014 04ea R:01 C:060400 ( pci)
[ 92.127794344,5] PHB#0007:00:01.0 [EP ] 1014 04ea R:01 C:060400 ( pci)
[ 92.127840820,5] PHB#0007:00:01.1 [EP ] 1014 04ea R:01 C:060400 ( pci)
[ 92.127888966,5] PHB#0007:00:01.2 [EP ] 1014 04ea R:01 C:060400 ( pci)
[ 92.127934960,5] PHB#0030:00:00.0 [ROOT] 1014 04c1 R:00 C:060400 B:00..00 SLOT=SLOT2
[ 92.127987109,5] PHB#0033:00:00.0 [ROOT] 1014 04c1 R:00 C:060400 B:00..00 SLOT=SLOT1
[ 92.128040750,5] PHB#0034:00:00.0 [ROOT] 1014 04c1 R:00 C:060400 B:01..01 SLOT=SLOT0
[ 92.128096895,5] PHB#0034:01:00.0 [EP ] 14e4 1657 R:01 C:020000 ( ethernet) LOC_CODE=SLOT0
[ 92.128155428,5] PHB#0034:01:00.1 [EP ] 14e4 1657 R:01 C:020000 ( ethernet) LOC_CODE=SLOT0
[ 92.128209777,5] PHB#0034:01:00.2 [EP ] 14e4 1657 R:01 C:020000 ( ethernet) LOC_CODE=SLOT0
[ 92.128265338,5] PHB#0034:01:00.3 [EP ] 14e4 1657 R:01 C:020000 ( ethernet) LOC_CODE=SLOT0
[ 92.128362543,5] PHB#0035:00:00.0 [ROOT] 1014 04c1 R:00 C:060400 B:01..11
[ 92.128409983,5] PHB#0035:01:00.0 [SWUP] 10b5 8725 R:ca C:060400 B:02..11
[ 92.128465071,5] PHB#0035:02:04.0 [SWDN] 10b5 8725 R:ca C:060400 B:03..07 SLOT=GPU3
[ 92.128521199,5] PHB#0035:02:05.0 [SWDN] 10b5 8725 R:ca C:060400 B:08..0c SLOT=GPU4
[ 92.128573845,5] PHB#0035:02:0d.0 [SWDN] 10b5 8725 R:ca C:060400 B:0d..11 SLOT=GPU5
[ 92.128805053,4] FLASH: Failed to load VERSION data
[ 92.211963931,3] LPC-MBOX: Got a response to a message we no longer care about
[ 92.314508328,5] IPMI: Resetting boot count on successful boot
[ 92.314593792,5] INIT: Waiting for kernel...
[ 92.314625341,5] INIT: platform wait for kernel load failed
[ 92.314663069,5] INIT: Assuming kernel at 0x20000000
[ 92.314689754,3] INIT: ELF header not found. Assuming raw binary.
[ 92.314728505,5] OCC: All Chip Rdy after 0 ms
[ 92.315523466,4] NVRAM: Query before is done loading
[ 92.315581946,4] NVRAM: Waiting for load
[ 92.315612611,2] NVRAM: Failed to load
[ 92.337045928,5] INIT: Starting kernel at 0x0, fdt at 0x3096f5f0 317566 bytes
[ 92.337133869,0] FATAL: Kernel is zeros, can't execute!
[ 92.337180033,0] Assert fail: core/init.c:587:0
[ 92.337207099,0] Aborting!
CPU 0824 Backtrace:
S: 0000000035d23c40 R: 000000003001a550 ._abort+0x4c
S: 0000000035d23cc0 R: 000000003001a5cc .assert_fail+0x34
S: 0000000035d23d40 R: 000000003001460c .load_and_boot_kernel+0xb54
S: 0000000035d23e30 R: 0000000030014d54 .main_cpu_entry+0x658
S: 0000000035d23f00 R: 0000000030002700 boot_entry+0x1b8
--- OPAL boot ---
[ 92.440039401,3] LPC-MBOX: Got a response to a message we no longer care about
[ 93.035563117,3] LPC-MBOX: Got a response to a message we no longer care about
[ 93.143086813,3] LPC-MBOX: Got a response to a message we no longer care about
[ 93.250611094,3] LPC-MBOX: Got a response to a message we no longer care about
[ 93.358133633,3] LPC-MBOX: Got a response to a message we no longer care about
[ 93.463095303,3] LPC-MBOX: Got a response to a message we no longer care about
[ 94.056056786,3] LPC-MBOX: Got a response to a message we no longer care about
[ 94.161018316,3] LPC-MBOX: Got a response to a message we no longer care about
[ 94.265980031,3] LPC-MBOX: Got a response to a message we no longer care about
[ 94.370941545,3] LPC-MBOX: Got a response to a message we no longer care about
[ 94.475903145,3] LPC-MBOX: Got a response to a message we no longer care about
[ 95.068864688,3] LPC-MBOX: Got a response to a message we no longer care about
[ 95.173826230,3] LPC-MBOX: Got a response to a message we no longer care about
[ 95.278787793,3] LPC-MBOX: Got a response to a message we no longer care about
[ 95.383749416,3] LPC-MBOX: Got a response to a message we no longer care about
[ 95.488710907,3] LPC-MBOX: Got a response to a message we no longer care about
[ 96.081672590,3] LPC-MBOX: Got a response to a message we no longer care about
[ 96.186634164,3] LPC-MBOX: Got a response to a message we no longer care about
[ 96.291595881,3] LPC-MBOX: Got a response to a message we no longer care about
[ 96.396557375,3] LPC-MBOX: Got a response to a message we no longer care about
[ 96.501518800,3] LPC-MBOX: Got a response to a message we no longer care about
[ 97.094480412,3] LPC-MBOX: Got a response to a message we no longer care about
[ 97.199442075,3] LPC-MBOX: Got a response to a message we no longer care about
[ 97.306940897,3] LPC-MBOX: Got a response to a message we no longer care about
[ 97.411902491,3] LPC-MBOX: Got a response to a message we no longer care about
[ 98.004864095,3] LPC-MBOX: Got a response to a message we no longer care about
[ 98.109825627,3] LPC-MBOX: Got a response to a message we no longer care about
[ 98.214787266,3] LPC-MBOX: Got a response to a message we no longer care about
[ 98.319748735,3] LPC-MBOX: Got a response to a message we no longer care about
[ 98.424710330,3] LPC-MBOX: Got a response to a message we no longer care about
[ 99.017671785,3] LPC-MBOX: Got a response to a message we no longer care about
[ 99.122633373,3] LPC-MBOX: Got a response to a message we no longer care about
[ 99.227595039,3] LPC-MBOX: Got a response to a message we no longer care about
[ 99.332556618,3] LPC-MBOX: Got a response to a message we no longer care about
[ 99.437518102,3] LPC-MBOX: Got a response to a message we no longer care about
[ 100.030479711,3] LPC-MBOX: Got a response to a message we no longer care about
[ 100.135441368,3] LPC-MBOX: Got a response to a message we no longer care about
[ 100.240402819,3] LPC-MBOX: Got a response to a message we no longer care about
[ 100.345364472,3] LPC-MBOX: Got a response to a message we no longer care about
[ 100.450325990,3] LPC-MBOX: Got a response to a message we no longer care about
[ 101.043287395,3] LPC-MBOX: Got a response to a message we no longer care about
[ 101.148249050,3] LPC-MBOX: Got a response to a message we no longer care about
[ 101.255748021,3] LPC-MBOX: Got a response to a message we no longer care about
[ 101.360709522,3] LPC-MBOX: Got a response to a message we no longer care about
[ 101.465671175,3] LPC-MBOX: Got a response to a message we no longer care about
[ 102.058632682,3] LPC-MBOX: Got a response to a message we no longer care about
[ 102.163594237,3] LPC-MBOX: Got a response to a message we no longer care about
[ 102.268555800,3] LPC-MBOX: Got a response to a message we no longer care about
[ 102.373517268,3] LPC-MBOX: Got a response to a message we no longer care about
[ 102.478478831,3] LPC-MBOX: Got a response to a message we no longer care about
[ 103.071440397,3] LPC-MBOX: Got a response to a message we no longer care about
[ 103.176402076,3] LPC-MBOX: Got a response to a message we no longer care about
[ 103.281363551,3] LPC-MBOX: Got a response to a message we no longer care about
[ 103.386325114,3] LPC-MBOX: Got a response to a message we no longer care about
[ 103.491286746,3] LPC-MBOX: Got a response to a message we no longer care about
[ 104.084248314,3] LPC-MBOX: Got a response to a message we no longer care about
[ 104.189209747,3] LPC-MBOX: Got a response to a message we no longer care about
[ 104.294171342,3] LPC-MBOX: Got a response to a message we no longer care about
[ 104.399132823,3] LPC-MBOX: Got a response to a message we no longer care about
[ 104.504094435,3] LPC-MBOX: Got a response to a message we no longer care about
[ 105.097056027,3] LPC-MBOX: Got a response to a message we no longer care about
[ 105.204554827,3] LPC-MBOX: Got a response to a message we no longer care about
[ 105.309516409,3] LPC-MBOX: Got a response to a message we no longer care about
[ 105.414477940,3] LPC-MBOX: Got a response to a message we no longer care about
@amboar can u check on it. .Thanks