ESXi 5.1.0
SUN FIRE X4170
Yesterday my ESXi host went down again but there's no log indicating it is powering down or reboot
There are only messages of powering up, only once a few days ago it was powered off.
~ # date
Fri Sep 30 02:58:28 UTC 2016
~ # grep -i power /var/log/vmksummary.log
2016-08-24T21:04:51Z bootstop: Host is powering off
~ # grep -i boot /var/log/vmksummary.log
2016-08-24T18:00:44Z bootstop: Host has booted
2016-08-24T21:04:51Z bootstop: Host is powering off
2016-08-24T21:53:21Z bootstop: Host has booted
2016-08-24T22:24:30Z bootstop: Host has booted
2016-09-20T08:24:39Z bootstop: Host has booted
2016-09-26T07:30:56Z bootstop: Host has booted
2016-09-26T10:59:54Z bootstop: Host has booted
2016-09-27T10:29:36Z bootstop: Host has booted
2016-09-30T02:00:32Z bootstop: Host has booted
~ # grep -i halt /var/log/vmksummary.log
~ # grep -i kernel /var/log/vmksummary.log
~ # esxcfg-advcfg -g /Misc/BlueScreenTimeout
Value of BlueScreenTimeout is 0
~ # grep -i fail /var/log/vmkernel.log | grep "2016-09-30"
ACPI Error (psparse-0621): Method parse/execution failed [\_SB_._OSC] (Node 0x410006676220)2016-09-30T01:59:35.972Z cpu3:4469), AE_AML_BUFFER_LIMIT
2016-09-30T01:59:35.972Z cpu3:4469)VMKAcpi: 161: Failed to evaluate _OSC: AE_AML_BUFFER_LIMIT
2016-09-30T01:59:39.759Z cpu2:4537)VMK_PCI: 1228: device 00:00:01.0 failed to allocate 1 vectors (intrType 1)
2016-09-30T01:59:39.759Z cpu2:4537)VMK_PCI: 1228: device 00:00:02.0 failed to allocate 1 vectors (intrType 1)
2016-09-30T01:59:39.759Z cpu2:4537)VMK_PCI: 1228: device 00:00:03.0 failed to allocate 1 vectors (intrType 1)
2016-09-30T01:59:39.759Z cpu2:4537)VMK_PCI: 1228: device 00:00:07.0 failed to allocate 1 vectors (intrType 1)
2016-09-30T01:59:39.759Z cpu2:4537)VMK_PCI: 1228: device 00:00:09.0 failed to allocate 1 vectors (intrType 1)
2016-09-30T01:59:39.759Z cpu2:4537)VMK_PCI: 1228: device 00:00:13.0 failed to allocate 1 vectors (intrType 1)
2016-09-30T01:59:39.759Z cpu2:4537)VMK_PCI: 1228: device 00:00:1e.0 failed to allocate 1 vectors (intrType 1)
2016-09-30T01:59:39.759Z cpu2:4537)VMK_PCI: 1228: device 00:00:1f.0 failed to allocate 1 vectors (intrType 1)
2016-09-30T01:59:39.759Z cpu2:4537)VMK_PCI: 1228: device 00:00:1f.3 failed to allocate 1 vectors (intrType 1)
2016-09-30T01:59:40.353Z cpu0:4469)WARNING: Team.etherswitch: TeamES_Activate:309:Failed to initialize beaconing on portset 'pps': Not implemented.
2016-09-30T01:59:43.565Z cpu5:4585)ScsiNpiv: 1525: GetInfo for adapter vmhba32, [0x41000c0cac80], max_vports=0, vports_inuse=0, linktype=0, state=0, failreason=0, rv=-1, sts=bad0020
2016-09-30T01:59:44.567Z cpu4:4587)ScsiScan: 1016: Path 'vmhba32:C0:T0:L0' : No standard UID: Failure. ANSI version 'SCSI-2' (0x2).
2016-09-30T01:59:47.619Z cpu1:4593)ScsiNpiv: 1525: GetInfo for adapter vmhba0, [0x41000c0ccf40], max_vports=0, vports_inuse=0, linktype=0, state=0, failreason=0, rv=-1, sts=bad0020
2016-09-30T01:59:47.619Z cpu1:4593)ScsiNpiv: 1525: GetInfo for adapter vmhba33, [0x41000c0cd540], max_vports=0, vports_inuse=0, linktype=0, state=0, failreason=0, rv=-1, sts=bad0020
2016-09-30T01:59:47.619Z cpu1:4593)ScsiNpiv: 1525: GetInfo for adapter vmhba34, [0x41000c0cdb40], max_vports=0, vports_inuse=0, linktype=0, state=0, failreason=0, rv=-1, sts=bad0020
2016-09-30T01:59:47.619Z cpu1:4593)ScsiNpiv: 1525: GetInfo for adapter vmhba35, [0x41000c0ce140], max_vports=0, vports_inuse=0, linktype=0, state=0, failreason=0, rv=-1, sts=bad0020
2016-09-30T01:59:47.619Z cpu1:4593)ScsiNpiv: 1525: GetInfo for adapter vmhba36, [0x41000c0ce740], max_vports=0, vports_inuse=0, linktype=0, state=0, failreason=0, rv=-1, sts=bad0020
2016-09-30T01:59:47.619Z cpu1:4593)ScsiNpiv: 1525: GetInfo for adapter vmhba37, [0x41000c0ced40], max_vports=0, vports_inuse=0, linktype=0, state=0, failreason=0, rv=-1, sts=bad0020
2016-09-30T01:59:47.878Z cpu4:4600)ScsiScan: 1016: Path 'vmhba1:C0:T0:L0' : No standard UID: Failure. ANSI version 'SCSI-2' (0x2).
2016-09-30T01:59:47.886Z cpu4:4600)WARNING: ScsiScan: 1276: Failed to add path vmhba1:C1:T0:L0 : Not found
2016-09-30T01:59:47.887Z cpu4:4600)WARNING: ScsiScan: 1276: Failed to add path vmhba1:C1:T1:L0 : Not found
2016-09-30T01:59:47.986Z cpu4:4600)ScsiScan: 1016: Path 'vmhba1:C3:T0:L0' : No standard UID: Failure. ANSI version 'SCSI-3 SPC3' (0x5).
2016-09-30T01:59:48.079Z cpu4:4600)ScsiScan: 1016: Path 'vmhba1:C3:T1:L0' : No standard UID: Failure. ANSI version 'SCSI-3 SPC3' (0x5).
2016-09-30T01:59:48.127Z cpu4:4600)ScsiNpiv: 1525: GetInfo for adapter vmhba1, [0x41000c0cf340], max_vports=0, vports_inuse=0, linktype=0, state=0, failreason=0, rv=-1, sts=bad0020
2016-09-30T01:59:53.419Z cpu7:4602)ScsiNpiv: 1525: GetInfo for adapter vmhba2, [0x41000c404ac0], max_vports=0, vports_inuse=0, linktype=0, state=1, failreason=0, rv=0, sts=0
2016-09-30T01:59:53.419Z cpu7:4602)ScsiNpiv: 1525: GetInfo for adapter vmhba3, [0x41000c0d0080], max_vports=0, vports_inuse=0, linktype=0, state=0, failreason=0, rv=-2, sts=bad0020
2016-09-30T02:00:01.657Z cpu0:4469)ScsiDeviceIO: 7065: Get VPD 80 Inquiry for device "mpx.vmhba1:C0:T0:L0" from Plugin "NMP" failed. Not supported
2016-09-30T02:00:01.657Z cpu0:4469)ScsiDeviceIO: 7075: Get VPD 83 Inquiry for device "mpx.vmhba1:C0:T0:L0" from Plugin "NMP" failed. Not supported
2016-09-30T02:00:01.657Z cpu7:4469)ScsiDeviceIO: 5880: Could not detect setting of QErr for device mpx.vmhba1:C0:T0:L0. Error Failure.
2016-09-30T02:00:01.805Z cpu7:4469)ScsiDeviceIO: 7065: Get VPD 80 Inquiry for device "mpx.vmhba1:C3:T0:L0" from Plugin "NMP" failed. Not supported
2016-09-30T02:00:01.805Z cpu7:4469)ScsiDeviceIO: 7075: Get VPD 83 Inquiry for device "mpx.vmhba1:C3:T0:L0" from Plugin "NMP" failed. Not supported
2016-09-30T02:00:01.926Z cpu7:4469)ScsiDeviceIO: 7065: Get VPD 80 Inquiry for device "mpx.vmhba1:C3:T1:L0" from Plugin "NMP" failed. Not supported
2016-09-30T02:00:01.926Z cpu7:4469)ScsiDeviceIO: 7075: Get VPD 83 Inquiry for device "mpx.vmhba1:C3:T1:L0" from Plugin "NMP" failed. Not supported
2016-09-30T02:00:03.147Z cpu0:4469)ScsiDeviceIO: 6394: Could not detect setting of sitpua for device naa.600a0b800051249c000004204b599146. Error Failure.
2016-09-30T02:00:03.153Z cpu0:4469)ScsiDeviceIO: 6394: Could not detect setting of sitpua for device naa.600a0b80003ac78400007b3b54aca949. Error Failure.
2016-09-30T02:00:03.160Z cpu0:4469)ScsiDeviceIO: 6394: Could not detect setting of sitpua for device naa.600a0b80003ac6fe0000786b54aca240. Error Failure.
2016-09-30T02:00:03.191Z cpu3:4469)ScsiDeviceIO: 6394: Could not detect setting of sitpua for device naa.600a0b80003ac6fe00007771548136d2. Error Failure.
2016-09-30T02:00:03.199Z cpu3:4469)ScsiDeviceIO: 7065: Get VPD 80 Inquiry for device "mpx.vmhba32:C0:T0:L0" from Plugin "NMP" failed. Not supported
2016-09-30T02:00:03.199Z cpu3:4469)ScsiDeviceIO: 7075: Get VPD 83 Inquiry for device "mpx.vmhba32:C0:T0:L0" from Plugin "NMP" failed. Not supported
2016-09-30T02:00:03.210Z cpu3:4469)ScsiDeviceIO: 6394: Could not detect setting of sitpua for device naa.600a0b8000511fe600001df253fbca51. Error Failure.
2016-09-30T02:00:03.221Z cpu3:4469)ScsiDeviceIO: 6394: Could not detect setting of sitpua for device naa.600a0b800051249c00001ec053fbc9b2. Error Failure.
2016-09-30T02:00:10.458Z cpu5:4823)WARNING: ScsiScan: 1276: Failed to add path vmhba1:C1:T0:L0 : Not found
2016-09-30T02:00:10.460Z cpu5:4823)WARNING: ScsiScan: 1276: Failed to add path vmhba1:C1:T1:L0 : Not found
2016-09-30T02:00:20.957Z cpu3:4099)NMP: nmp_ThrottleLogForDevice:2346: Cmd 0x85 (0x412400802b00, 5256) to dev "mpx.vmhba1:C0:T0:L0" on path "vmhba1:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE
2016-09-30T02:00:20.957Z cpu3:4099)ScsiDeviceIO: 2342: Cmd(0x412400802b00) 0x85, CmdSN 0x0 from world 5256 to dev "mpx.vmhba1:C0:T0:L0" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.
2016-09-30T02:00:20.957Z cpu3:4099)NMP: nmp_ThrottleLogForDevice:2346: Cmd 0x4d (0x412400802b00, 5256) to dev "mpx.vmhba1:C0:T0:L0" on path "vmhba1:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE
2016-09-30T02:00:20.957Z cpu3:4099)ScsiDeviceIO: 2358: Cmd(0x412400802b00) 0x4d, CmdSN 0x1 from world 5256 to dev "mpx.vmhba1:C0:T0:L0" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.
2016-09-30T02:04:27.398Z cpu0:4104)NMP: nmp_ThrottleLogForDevice:2346: Cmd 0x1a (0x4124007e3a40, 0) to dev "mpx.vmhba32:C0:T0:L0" on path "vmhba32:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE
2016-09-30T02:04:27.398Z cpu0:4104)ScsiDeviceIO: 2342: Cmd(0x4124007e3a40) 0x1a, CmdSN 0x82c from world 0 to dev "mpx.vmhba32:C0:T0:L0" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.
2016-09-30T02:30:20.664Z cpu6:4670)NMP: nmp_ThrottleLogForDevice:2346: Cmd 0x85 (0x4124007e6840, 5256) to dev "mpx.vmhba1:C0:T0:L0" on path "vmhba1:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE
2016-09-30T02:30:20.664Z cpu6:4670)ScsiDeviceIO: 2358: Cmd(0x4124007e6840) 0x4d, CmdSN 0x4 from world 5256 to dev "mpx.vmhba1:C0:T0:L0" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.
2016-09-30T02:34:27.438Z cpu0:4603)NMP: nmp_ThrottleLogForDevice:2346: Cmd 0x1a (0x4124007cd0c0, 0) to dev "mpx.vmhba32:C0:T0:L0" on path "vmhba32:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE
2016-09-30T02:54:27.458Z cpu5:4101)ScsiDeviceIO: 2342: Cmd(0x4124007abbc0) 0x1a, CmdSN 0x9a6 from world 0 to dev "mpx.vmhba32:C0:T0:L0" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.
2016-09-30T03:00:20.724Z cpu7:4103)NMP: nmp_ThrottleLogForDevice:2346: Cmd 0x85 (0x4124007f0900, 5256) to dev "mpx.vmhba1:C0:T0:L0" on path "vmhba1:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE
2016-09-30T03:00:20.725Z cpu7:4103)ScsiDeviceIO: 2358: Cmd(0x4124007f0900) 0x4d, CmdSN 0x7 from world 5256 to dev "mpx.vmhba1:C0:T0:L0" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.
2016-09-30T03:09:27.471Z cpu0:4104)NMP: nmp_ThrottleLogForDevice:2346: Cmd 0x1a (0x41240078bbc0, 0) to dev "mpx.vmhba32:C0:T0:L0" on path "vmhba32:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE
~ # grep -i error /var/log/vmkernel.log | grep "2016-09-30"
ACPI Error (dsopcode-0718): Field [CDW3] at 96 exceeds Buffer [NULL] size 64 (bits)2016-09-30T01:59:35.972Z cpu3:4469) [20080926]
ACPI Error (psparse-0621): Method parse/execution failed [\_SB_._OSC] (Node 0x410006676220)2016-09-30T01:59:35.972Z cpu3:4469), AE_AML_BUFFER_LIMIT
2016-09-30T02:00:01.657Z cpu7:4469)ScsiDeviceIO: 5880: Could not detect setting of QErr for device mpx.vmhba1:C0:T0:L0. Error Failure.
2016-09-30T02:00:01.813Z cpu4:4100)WARNING: LinScsi: SCSILinuxProcessCompletions:772:Error BytesXferred > Requested Length Marking transfer length as 0 - vmhba = vmhba1, Driver Name = AAC, Requested length = 16, Resid = -16
2016-09-30T02:00:01.813Z cpu7:4469)ScsiDeviceIO: 5880: Could not detect setting of QErr for device mpx.vmhba1:C3:T0:L0. Error Not supported.
2016-09-30T02:00:01.935Z cpu4:4100)WARNING: LinScsi: SCSILinuxProcessCompletions:772:Error BytesXferred > Requested Length Marking transfer length as 0 - vmhba = vmhba1, Driver Name = AAC, Requested length = 16, Resid = -16
2016-09-30T02:00:01.935Z cpu7:4469)ScsiDeviceIO: 5880: Could not detect setting of QErr for device mpx.vmhba1:C3:T1:L0. Error Not supported.
2016-09-30T02:00:01.936Z cpu2:4469)ScsiDeviceIO: 6394: Could not detect setting of sitpua for device naa.6005076300808109400000000000000d. Error Not supported.
2016-09-30T02:00:02.595Z cpu6:4469)ScsiDeviceIO: 6394: Could not detect setting of sitpua for device naa.6005076300808109400000000000000c. Error Not supported.
2016-09-30T02:00:02.604Z cpu0:4469)ScsiDeviceIO: 6394: Could not detect setting of sitpua for device naa.6005076300808109400000000000000b. Error Not supported.
2016-09-30T02:00:02.616Z cpu0:4469)ScsiDeviceIO: 6394: Could not detect setting of sitpua for device naa.60050763008081094000000000000009. Error Not supported.
2016-09-30T02:00:03.132Z cpu0:4469)ScsiDeviceIO: 6394: Could not detect setting of sitpua for device naa.6005076300808109400000000000000a. Error Not supported.
2016-09-30T02:00:03.147Z cpu0:4469)ScsiDeviceIO: 6394: Could not detect setting of sitpua for device naa.600a0b800051249c000004204b599146. Error Failure.
2016-09-30T02:00:03.153Z cpu0:4469)ScsiDeviceIO: 6394: Could not detect setting of sitpua for device naa.600a0b80003ac78400007b3b54aca949. Error Failure.
2016-09-30T02:00:03.160Z cpu0:4469)ScsiDeviceIO: 6394: Could not detect setting of sitpua for device naa.600a0b80003ac6fe0000786b54aca240. Error Failure.
2016-09-30T02:00:03.191Z cpu3:4469)ScsiDeviceIO: 6394: Could not detect setting of sitpua for device naa.600a0b80003ac6fe00007771548136d2. Error Failure.
2016-09-30T02:00:03.199Z cpu3:4469)ScsiDeviceIO: 5880: Could not detect setting of QErr for device mpx.vmhba32:C0:T0:L0. Error Medium not found.
2016-09-30T02:00:03.210Z cpu3:4469)ScsiDeviceIO: 6394: Could not detect setting of sitpua for device naa.600a0b8000511fe600001df253fbca51. Error Failure.
2016-09-30T02:00:03.221Z cpu3:4469)ScsiDeviceIO: 6394: Could not detect setting of sitpua for device naa.600a0b800051249c00001ec053fbc9b2. Error Failure.