My Config: DELL R300 with 64GB SSD just for ESXi and 4TB RAID 10 on a Superstor Appliance by iSCSI.
Hi all! I´m having a problem with one of our ESXi servers. For some reason both ESXI and Virtual Machines stop responding. I have googled for the answer but found nothing related to this error:
Here is the time at the error was logged:
2012-11-15T22:54:40.843Z cpu0:2584)WARNING: iscsi_vmk: iscsivmk_ConnCommandResponse: Sess [ISID: 00023d000001 TARGET: iqn.2010-01.com.superstorappliance:BFE2199.SUN TPGT: 1 TSIH: 0]
2012-11-15T22:54:40.843Z cpu0:2584)WARNING: iscsi_vmk: iscsivmk_ConnCommandResponse: Conn [CID: 0 L: 192.168.0.27:55667 R: 192.168.0.180:3260]
2012-11-15T23:28:24.293Z cpu2:4363)WARNING: VmMemCow: vm 3810: 651: hint lookup failed: status = Not found, pgNum = 0x82ef, mpn = 0x1332ef, hintWorld = 70105352, hintPgNum = 0x4180, key = 0x4122042db908
2012-11-15T23:28:24.293Z cpu2:4363)WARNING: World: vm 3810: 10619: vmm0:TESTSERVER:vmk: vcpu-0:pshare hint lookup failed for mpn = 0x1332ef
2012-11-15T23:28:24.293Z cpu2:4363)World: 10622: vmm group leader = 3810, members = 2
2012-11-15T23:28:24.293Z cpu2:4363)Backtrace for current CPU #2, worldID=4363, ebp=0x4122042db668
2012-11-15T23:28:24.294Z cpu2:4363)0x4122042db668:[0x418018b00269]World_Panic@vmkernel#nover+0x184 stack: 0x323130326d375b1b, 0x412204
2012-11-15T23:28:24.294Z cpu2:4363)0x4122042db888:[0x418018b00269]World_Panic@vmkernel#nover+0x184 stack: 0x4122042db908, 0x4180000041
2012-11-15T23:28:24.295Z cpu2:4363)0x4122042db908:[0x418018aca31b]VmMemCow_PShareRemoveHint@vmkernel#nover+0xa2 stack: 0x4122042db928,
2012-11-15T23:28:24.295Z cpu2:4363)0x4122042db9b8:[0x418018aea5f8]VmMemPin_GetMainMemRange@vmkernel#nover+0x22f stack: 0x310, 0x417fd8
2012-11-15T23:28:24.296Z cpu2:4363)0x4122042dba48:[0x418018a77ea0]P2MCache_Get@vmkernel#nover+0x1ab stack: 0x4122042dba7c, 0x4122042db
2012-11-15T23:28:24.296Z cpu2:4363)0x4122042dbaa8:[0x418018a781f3]P2MCache_GetPages@vmkernel#nover+0x46 stack: 0x0, 0x4122042dbae0, 0x
2012-11-15T23:28:24.297Z cpu2:4363)0x4122042dbc68:[0x418018b53d54]Vmxnet2VMKDevPollTxRing@vmkernel#nover+0x5d3 stack: 0x4122042dbcb8,
2012-11-15T23:28:24.297Z cpu2:4363)0x4122042dbce8:[0x418018b5595b]Vmxnet2VMKDev_AsyncTx@vmkernel#nover+0xb6 stack: 0x4122042dbd28, 0x4
2012-11-15T23:28:24.297Z cpu2:4363)0x4122042dbd58:[0x418018b518a3]NetWorldletPerVMCB@vmkernel#nover+0xae stack: 0x4122042dbde8, 0x4180
2012-11-15T23:28:24.298Z cpu2:4363)0x4122042dbed8:[0x418018b0af2b]WorldletProcessQueue@vmkernel#nover+0x486 stack: 0x4122042dbf18, 0xb
2012-11-15T23:28:24.298Z cpu2:4363)0x4122042dbf18:[0x418018b0b5a5]WorldletBHHandler@vmkernel#nover+0x60 stack: 0x1004122042dbf98, 0x41
2012-11-15T23:28:24.299Z cpu2:4363)0x4122042dbf98:[0x418018a207fa]BH_Check@vmkernel#nover+0x185 stack: 0x418018bb84f9, 0x41001b03c188,
2012-11-15T23:28:24.299Z cpu2:4363)0x4122042dbfe8:[0x418018af3763]VMMVMKCall_Call@vmkernel#nover+0x27a stack: 0x0, 0x0, 0x0, 0x0, 0x0
2012-11-15T23:28:24.299Z cpu2:4363)0x418018ac77d8:[0xfffffffffc223a12]<unknown> stack: 0x0, 0x0, 0x0, 0x0, 0x0
2012-11-15T23:28:24.299Z cpu2:4363)WARNING: VmMemCow: vm 3810: 651: hint lookup failed: status = Not found, pgNum = 0x82f0, mpn = 0x1332f0, hintWorld = 70105352, hintPgNum = 0x4180, key = 0x4122042db908
2012-11-15T23:28:24.299Z cpu2:4363)WARNING: World: vm 3810: 10717: Simultaneous panic! :vmk: vcpu-0:pshare hint lookup failed for mpn = 0x1332f0
2012-11-15T23:28:24.299Z cpu2:4363)WARNING: VmMemCow: vm 3810: 651: hint lookup failed: status = Not found, pgNum = 0x82f1, mpn = 0x1332f1, hintWorld = 70105352, hintPgNum = 0x4180, key = 0x4122042db908
2012-11-15T23:28:24.299Z cpu2:4363)WARNING: World: vm 3810: 10717: Simultaneous panic! :vmk: vcpu-0:pshare hint lookup failed for mpn = 0x1332f1
2012-11-15T23:28:24.299Z cpu2:4363)WARNING: VmMemCow: vm 3810: 651: hint lookup failed: status = Not found, pgNum = 0x82f2, mpn = 0x1332f2, hintWorld = 70105352, hintPgNum = 0x4180, key = 0x4122042db908
2012-11-15T23:28:24.299Z cpu2:4363)WARNING: World: vm 3810: 10717: Simultaneous panic! :vmk: vcpu-0:pshare hint lookup failed for mpn = 0x1332f2
2012-11-15T23:28:24.299Z cpu2:4363)WARNING: VmMemCow: vm 3810: 651: hint lookup failed: status = Not found, pgNum = 0x82f3, mpn = 0x1332f3, hintWorld = 70105352, hintPgNum = 0x4180, key = 0x4122042db908
2012-11-15T23:28:24.299Z cpu2:4363)WARNING: World: vm 3810: 10717: Simultaneous panic! :vmk: vcpu-0:pshare hint lookup failed for mpn = 0x1332f3
2012-11-15T23:28:24.299Z cpu2:4363)WARNING: VmMemCow: vm 3810: 651: hint lookup failed: status = Not found, pgNum = 0x82f4, mpn = 0x1332f4, hintWorld = 70105352, hintPgNum = 0x4180, key = 0x4122042db908
2012-11-15T23:28:24.299Z cpu2:4363)WARNING: World: vm 3810: 10717: Simultaneous panic! :vmk: vcpu-0:pshare hint lookup failed for mpn = 0x1332f4
2012-11-15T23:28:24.299Z cpu2:4363)WARNING: VmMemCow: vm 3810: 651: hint lookup failed: status = Not found, pgNum = 0x82f5, mpn = 0x1332f5, hintWorld = 70105352, hintPgNum = 0x4180, key = 0x4122042db908
2012-11-15T23:28:24.299Z cpu2:4363)WARNING: VmMemCow: vm 3810: 651: hint lookup failed: status = Not found, pgNum = 0x82f6, mpn = 0x1332f6, hintWorld = 70105352, hintPgNum = 0x4180, key = 0x4122042db908
2012-11-15T23:28:24.299Z cpu2:4363)WARNING: VmMemCow: vm 3810: 651: hint lookup failed: status = Not found, pgNum = 0x82f7, mpn = 0x1332f7, hintWorld = 70105352, hintPgNum = 0x4180, key = 0x4122042db908
2012-11-15T23:28:24.299Z cpu2:4363)WARNING: VmMemCow: vm 3810: 651: hint lookup failed: status = Not found, pgNum = 0x82f8, mpn = 0x1332f8, hintWorld = 70105352, hintPgNum = 0x4180, key = 0x4122042db908
2012-11-15T23:28:24.299Z cpu2:4363)WARNING: VmMemCow: vm 3810: 651: hint lookup failed: status = Not found, pgNum = 0x82f9, mpn = 0x1332f9, hintWorld = 70105352, hintPgNum = 0x4180, key = 0x4122042db908
2012-11-15T23:28:24.299Z cpu2:4363)WARNING: VmMemCow: vm 3810: 651: hint lookup failed: status = Not found, pgNum = 0x82fa, mpn = 0x1332fa, hintWorld = 70105352, hintPgNum = 0x4180, key = 0x4122042db908
2012-11-15T23:28:24.299Z cpu2:4363)WARNING: VmMemCow: vm 3810: 651: hint lookup failed: status = Not found, pgNum = 0x82fb, mpn = 0x1332fb, hintWorld = 70105352, hintPgNum = 0x4180, key = 0x4122042db908
2012-11-15T23:28:24.299Z cpu2:4363)WARNING: VmMemCow: vm 3810: 651: hint lookup failed: status = Not found, pgNum = 0x82fc, mpn = 0x1332fc, hintWorld = 70105352, hintPgNum = 0x4180, key = 0x4122042db908
2012-11-15T23:28:24.299Z cpu2:4363)WARNING: VmMemCow: vm 3810: 651: hint lookup failed: status = Not found, pgNum = 0x82fd, mpn = 0x1332fd, hintWorld = 70105352, hintPgNum = 0x4180, key = 0x4122042db908
2012-11-15T23:28:24.299Z cpu2:4363)WARNING: VmMemCow: vm 3810: 651: hint lookup failed: status = Not found, pgNum = 0x82fe, mpn = 0x1332fe, hintWorld = 70105352, hintPgNum = 0x4180, key = 0x4122042db908
2012-11-15T23:28:24.523Z cpu0:2584)WARNING: iscsi_vmk: iscsivmk_ConnCommandResponse: SCSI response overflow: residual 1048064
2012-11-15T23:28:24.523Z cpu0:2584)WARNING: iscsi_vmk: iscsivmk_ConnCommandResponse: Sess [ISID: 00023d000001 TARGET: iqn.2010-01.com.superstorappliance:BFE2199.SUN TPGT: 1 TSIH: 0]
2012-11-15T23:28:24.523Z cpu0:2584)WARNING: iscsi_vmk: iscsivmk_ConnCommandResponse: Conn [CID: 0 L: 192.168.0.27:55667 R: 192.168.0.180:3260]
2012-11-15T23:28:25.300Z cpu0:2078)NetPort: 1574: disabled port 0x200000b
2012-11-15T23:28:25.300Z cpu0:2078)Net: 2475: disconnected client from port 0x200000b
VMB: 49: mbMagic: 2badb002, mbInfo 0x100e3c
VMB: 54: flags a6d
VMB: 57: mem: lower 0x280, upper 0x33e680
VMB: 62: cmdline: /useropts.gz vmbTrustedBoot=false tboot=0x0x101a000 no-auto-partition bootUUID=7a4ede487cde79b042f04f107264220f
VMB: 67: 70 boot modules @ 0x1009bc
VMB: 74: mmap_addr 0x100eb0 (252b)
VMB: 80: VBE Mode: 0x123
VMB: 81: VBE Mode Info Block: 0x1011f4
Best Regards