We have recently started testing with FCoE in our lab. We are running 2 HP DL380 G8 servers, one with OmniOS as the FC SAN and ESXi 5.5 as the FCoE initiator. The Omni box is using a QLogic 8Gb FC card to connect to a Cisco Nexus switch. From the switch we go to the ESXi box via an Emulex OCe11102-f FCoE CNA card. We have created the vsan and zones as required to get the two working together, and I am able to see the LUNs that I created. When I attempted to format the LUN as VMFS 5, it shortly ended with the following error:
Call "HostDatastoreSystem.CreateVmfsDatastore" for object "ha-datastoresystem" on ESXi "10.5.99.80" failed.
Operation failed, diagnostics report: Unable to create Filesystem, please see VMkernel log for more details: No such device
We have been able to recreate this several times using both 5.5 and 5.1. We added a RHEL 6.4 server to the lab and were able to view the LUNs as well, but we were able to format them using EXT3 and EXT4. This has validated our FC target configuration in COMSTAR as well as our switch configuration. After doing some command line work on the ESXi box, I can see that the LUN is being partitioned, but it looks to me as though it fails when attempting to write the file system. In order to recreate this, I was able to delete the failed partition using 'partedUtil delete "/vmfs/devices/disks/naa.xxx" 1' with no issues, as well as recreating the partition using partedUtil again. But when I issue the command to create the partition in VMFS 5 and VMFS 3, I receive the same errors. Below I have listed what I can see when tailing /var/log/vmkernel.log. I have limited experience with SCSI commands and codes, but if I'm reading this correctly, it looks like the host is attempting to read the partition (Cmd 0x28) and is failing (H:0x2 D:0x0 P:0x0), and after a few failures is timing out (H:0x5 D:0x0 P:0x0). Lastly, we removed the Emulex card and installed an Intel X520 card using software FCoE initiator and are experiencing the same issue. This has been done using the same installation and a clean installation with the same error.
I'm hoping someone has experienced this or has experience troubleshooting FCoE and can give some advise. Thanks community for your help.
~ # tail -f /var/log/vmkernel.log
2014-03-14T12:29:26.458Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412e80416080, 34097) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:29:26.609Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412e80416080, 34097) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:29:26.759Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412e80416080, 34097) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:29:26.909Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412e80416080, 34097) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:29:27.060Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412e80416080, 34097) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:29:27.060Z cpu0:32821)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:29:27.209Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412e80416080, 34097) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:29:30.384Z cpu10:32831)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:29:30.384Z cpu10:32831)ScsiDeviceIO: 2337: Cmd(0x412e80416080) 0x28, CmdSN 0x4 from world 34097 to dev "naa.600144f004076a0300005321912f0002" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:29:38.060Z cpu0:219602)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:651: Path "vmhba2:C0:T0:L1" (UP) command 0xa3 failed with status Timeout. H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:30:16.712Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:16.712Z cpu0:32821)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:30:16.712Z cpu0:32821)ScsiDeviceIO: 2324: Cmd(0x412fc2a12c40) 0x28, CmdSN 0x3 from world 34101 to dev "naa.600144f004076a0300005321912f0002" failed H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:30:16.859Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:17.009Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:17.068Z cpu0:32821)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:30:17.158Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:17.308Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:17.457Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:17.607Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:17.667Z cpu20:33539)lpfc: lpfc_change_queue_depth:186: 0:(0):3295 lun queue depth changed [0:0:0] old=25, new=24
2014-03-14T12:30:17.667Z cpu20:33539)lpfc: lpfc_change_queue_depth:186: 0:(0):3295 lun queue depth changed [0:0:1] old=25, new=24
2014-03-14T12:30:28.060Z cpu27:214923)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:651: Path "vmhba2:C0:T0:L1" (UP) command 0xa3 failed with status Timeout. H:0x5 D:0x0 P:0x0 Possible sense data: 0x2 0x3a 0x2.
2014-03-14T12:30:28.704Z cpu0:32821)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:30:28.794Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:28.944Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:29.065Z cpu0:32821)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:30:29.095Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:29.245Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:29.390Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:29.536Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:40.060Z cpu34:219576)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:651: Path "vmhba2:C0:T0:L1" (UP) command 0xa3 failed with status Timeout. H:0x5 D:0x0 P:0x0 Possible sense data: 0x5 0x20 0x0.
2014-03-14T12:30:40.688Z cpu0:32821)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:30:40.718Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:40.868Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:41.018Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:41.063Z cpu0:32821)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:30:41.168Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:41.318Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:41.468Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:41.615Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:52.060Z cpu24:219579)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:651: Path "vmhba2:C0:T0:L1" (UP) command 0xa3 failed with status Timeout. H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:30:52.682Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:52.682Z cpu0:32821)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:30:52.832Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:52.979Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:53.069Z cpu0:32821)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:30:53.128Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:53.278Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:53.428Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:53.572Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc2a12c40, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:30:56.713Z cpu10:32831)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:30:56.713Z cpu10:32831)ScsiDeviceIO: 2337: Cmd(0x412fc2a12c40) 0x28, CmdSN 0x3 from world 34101 to dev "naa.600144f004076a0300005321912f0002" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:30:56.714Z cpu26:34101)FSS: 5051: No FS driver claimed device 'naa.600144f004076a0300005321912f0002:6': Not supported
2014-03-14T12:30:56.714Z cpu26:34101)Vol3: 714: Couldn't read volume header from control: Not supported
2014-03-14T12:30:56.714Z cpu26:34101)Vol3: 714: Couldn't read volume header from control: Not supported
2014-03-14T12:30:56.714Z cpu26:34101)FSS: 5051: No FS driver claimed device 'control': Not supported
2014-03-14T12:31:04.060Z cpu26:214916)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:651: Path "vmhba2:C0:T0:L1" (UP) command 0xa3 failed with status Timeout. H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:31:04.680Z cpu26:34101)FSS: 5051: No FS driver claimed device 'naa.600144f004076a0300005321912f0002:2': Not supported
2014-03-14T12:31:04.686Z cpu0:32821)ScsiDeviceIO: 2324: Cmd(0x412fc3795700) 0x28, CmdSN 0x3 from world 34101 to dev "naa.600144f004076a0300005321912f0002" failed H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:31:04.757Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:04.905Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:05.052Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:05.068Z cpu0:32821)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:31:05.203Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:05.353Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:05.503Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:05.638Z cpu20:33539)lpfc: lpfc_change_queue_depth:186: 0:(0):3295 lun queue depth changed [0:0:0] old=24, new=23
2014-03-14T12:31:05.638Z cpu20:33539)lpfc: lpfc_change_queue_depth:186: 0:(0):3295 lun queue depth changed [0:0:1] old=24, new=23
2014-03-14T12:31:16.060Z cpu27:214923)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:651: Path "vmhba2:C0:T0:L1" (UP) command 0xa3 failed with status Timeout. H:0x5 D:0x0 P:0x0 Possible sense data: 0x2 0x3a 0x2.
2014-03-14T12:31:16.670Z cpu0:32821)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:31:16.685Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:16.834Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:16.985Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:17.060Z cpu4:32825)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:31:17.073Z cpu26:32847)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x1a (0x412e828eea80, 0) to dev "mpx.vmhba32:C0:T0:L0" on path "vmhba32:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE
2014-03-14T12:31:17.073Z cpu26:32847)ScsiDeviceIO: 2337: Cmd(0x412e828eea80) 0x1a, CmdSN 0x1463 from world 0 to dev "mpx.vmhba32:C0:T0:L0" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.
2014-03-14T12:31:17.134Z cpu1:32822)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:17.285Z cpu1:32822)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:17.435Z cpu1:32822)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:17.585Z cpu1:32822)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:28.060Z cpu0:219602)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:651: Path "vmhba2:C0:T0:L1" (UP) command 0xa3 failed with status Timeout. H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:31:28.672Z cpu1:32822)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:28.672Z cpu1:32822)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:31:28.823Z cpu1:32822)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:28.973Z cpu1:32822)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:29.063Z cpu1:32822)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:31:29.123Z cpu1:32822)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:29.270Z cpu1:32822)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:29.419Z cpu1:32822)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:29.570Z cpu1:32822)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:40.060Z cpu32:214613)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:651: Path "vmhba2:C0:T0:L1" (UP) command 0xa3 failed with status Timeout. H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:31:40.674Z cpu1:32822)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:31:40.765Z cpu1:32822)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:40.915Z cpu1:32822)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:41.065Z cpu1:32822)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:41.065Z cpu1:32822)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:31:41.215Z cpu1:32822)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:41.366Z cpu1:32822)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:41.514Z cpu1:32822)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795700, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:31:44.686Z cpu10:32831)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:31:44.686Z cpu10:32831)ScsiDeviceIO: 2337: Cmd(0x412fc3795700) 0x28, CmdSN 0x3 from world 34101 to dev "naa.600144f004076a0300005321912f0002" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:31:44.687Z cpu26:34101)FSS: 5051: No FS driver claimed device 'naa.600144f004076a0300005321912f0002:5': Not supported
2014-03-14T12:31:52.060Z cpu34:219576)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:651: Path "vmhba2:C0:T0:L1" (UP) command 0xa3 failed with status Timeout. H:0x5 D:0x0 P:0x0 Possible sense data: 0x5 0x20 0x0.
2014-03-14T12:32:22.387Z cpu1:32822)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3795480, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:22.387Z cpu1:32822)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:32:22.387Z cpu1:32822)ScsiDeviceIO: 2324: Cmd(0x412fc3795480) 0x28, CmdSN 0x3 from world 34101 to dev "naa.600144f004076a0300005321912f0002" failed H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:32:22.525Z cpu26:34101)FSS: 5051: No FS driver claimed device 'mpx.vmhba32:C0:T0:L0': Not supported
2014-03-14T12:32:22.529Z cpu26:34101)VC: 1958: Device rescan time 37 msec (total number of devices 11)
2014-03-14T12:32:22.529Z cpu26:34101)VC: 1961: Filesystem probe time 125823 msec (devices probed 10 of 11)
2014-03-14T12:32:22.529Z cpu26:34101)VC: 1963: Refresh open volume time 0 msec
2014-03-14T12:32:22.668Z cpu26:34101)LVM: 2907: [naa.600144f004076a030000532191280001:1] Device expanded (actual size 104855519 blocks, stored size 104847953 blocks)
2014-03-14T12:32:22.721Z cpu26:34101)FSS: 5051: No FS driver claimed device 'mpx.vmhba32:C0:T0:L0': Not supported
2014-03-14T12:32:22.733Z cpu2:32823)ScsiDeviceIO: 2324: Cmd(0x412fc3270200) 0x28, CmdSN 0x3 from world 34101 to dev "naa.600144f004076a0300005321912f0002" failed H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:32:22.807Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:22.958Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:23.060Z cpu2:32823)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:32:23.105Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:23.255Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:23.404Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:23.552Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:23.555Z cpu11:34049)<4>hpsa 0000:02:00.0: cp 0x410a74e20000 has status 0x2 Sense: 0x5, ASC: 0x20, ASCQ: 0x0, Returning result: 0x2
2014-03-14T12:32:23.555Z cpu28:33153)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x85 (0x412fc2b60440, 34614) to dev "naa.600508b1001c5f7dd7bd6a7d78735ffe" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE
2014-03-14T12:32:23.555Z cpu28:33153)ScsiDeviceIO: 2337: Cmd(0x412fc2b60440) 0x85, CmdSN 0x63 from world 34614 to dev "naa.600508b1001c5f7dd7bd6a7d78735ffe" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.
2014-03-14T12:32:23.555Z cpu11:34049)<4>hpsa 0000:02:00.0: cp 0x410a74e20000 has status 0x2 Sense: 0x5, ASC: 0x20, ASCQ: 0x0, Returning result: 0x2
2014-03-14T12:32:23.555Z cpu28:33153)ScsiDeviceIO: 2337: Cmd(0x412fc2b60440) 0x4d, CmdSN 0x64 from world 34614 to dev "naa.600508b1001c5f7dd7bd6a7d78735ffe" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.
2014-03-14T12:32:23.672Z cpu20:33539)lpfc: lpfc_change_queue_depth:186: 0:(0):3295 lun queue depth changed [0:0:0] old=23, new=22
2014-03-14T12:32:23.672Z cpu20:33539)lpfc: lpfc_change_queue_depth:186: 0:(0):3295 lun queue depth changed [0:0:1] old=23, new=22
2014-03-14T12:32:33.710Z cpu2:32823)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:32:34.060Z cpu39:213539)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:651: Path "vmhba2:C0:T0:L1" (UP) command 0xa3 failed with status Timeout. H:0x5 D:0x0 P:0x0 Possible sense data: 0x2 0x3a 0x2.
2014-03-14T12:32:34.730Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:34.879Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:35.028Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:35.058Z cpu2:32823)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:32:35.178Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:35.328Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:35.477Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:35.626Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:45.693Z cpu2:32823)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:32:46.060Z cpu26:214916)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:651: Path "vmhba2:C0:T0:L1" (UP) command 0xa3 failed with status Timeout. H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:32:46.802Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:46.952Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:47.070Z cpu2:32823)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:32:47.100Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:47.250Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:47.400Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:47.550Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:57.678Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:57.678Z cpu2:32823)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:32:58.060Z cpu27:214923)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:651: Path "vmhba2:C0:T0:L1" (UP) command 0xa3 failed with status Timeout. H:0x5 D:0x0 P:0x0 Possible sense data: 0x2 0x3a 0x2.
2014-03-14T12:32:58.815Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:58.964Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:59.069Z cpu2:32823)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:32:59.114Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:59.264Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:59.414Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:32:59.562Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270200, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:33:02.734Z cpu10:32831)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:33:02.734Z cpu10:32831)ScsiDeviceIO: 2337: Cmd(0x412fc3270200) 0x28, CmdSN 0x3 from world 34101 to dev "naa.600144f004076a0300005321912f0002" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:33:02.735Z cpu26:34101)FSS: 5051: No FS driver claimed device 'naa.600144f004076a0300005321912f0002:6': Not supported
2014-03-14T12:33:09.664Z cpu26:34101)FSS: 5051: No FS driver claimed device 'naa.600144f004076a0300005321912f0002:2': Not supported
2014-03-14T12:33:09.664Z cpu26:34101)Vol3: 714: Couldn't read volume header from control: Not supported
2014-03-14T12:33:09.664Z cpu26:34101)Vol3: 714: Couldn't read volume header from control: Not supported
2014-03-14T12:33:09.664Z cpu26:34101)FSS: 5051: No FS driver claimed device 'control': Not supported
2014-03-14T12:33:09.669Z cpu2:32823)lpfc0 log compression on target 0 ending, messages have quiesced with 1269 compressed.
2014-03-14T12:33:09.669Z cpu2:32823)lpfc: lpfc_scsi_cmd_iocb_cmpl:2157: 0:(0):3271: FCP cmd x28 failed <0/1> sid xe90001, did xe90040, oxid x8f Local Reason x40 Returning Host Busy
2014-03-14T12:33:09.669Z cpu2:32823)ScsiDeviceIO: 2324: Cmd(0x412fc3270fc0) 0x28, CmdSN 0x3 from world 34101 to dev "naa.600144f004076a0300005321912f0002" failed H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:33:10.687Z cpu2:32816)lpfc: lpfc_scsi_cmd_iocb_cmpl:2157: 0:(0):3271: FCP cmd x28 failed <0/1> sid xe90001, did xe90040, oxid x6e Local Reason x40 Returning Host Busy
2014-03-14T12:33:10.687Z cpu2:32823)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:33:10.700Z cpu2:32816)lpfc: lpfc_scsi_cmd_iocb_cmpl:2157: 0:(0):3271: FCP cmd x28 failed <0/1> sid xe90001, did xe90040, oxid x97 Local Reason x40 Returning Host Busy
2014-03-14T12:33:10.715Z cpu2:32816)lpfc: lpfc_scsi_cmd_iocb_cmpl:2157: 0:(0):3271: FCP cmd x28 failed <0/1> sid xe90001, did xe90040, oxid x87 Local Reason x40 Returning Host Busy
2014-03-14T12:33:10.730Z cpu2:32816)lpfc: lpfc_scsi_cmd_iocb_cmpl:2157: 0:(0):3271: FCP cmd x28 failed <0/1> sid xe90001, did xe90040, oxid x7f Local Reason x40 Returning Host Busy
2014-03-14T12:33:10.744Z cpu2:32816)lpfc: lpfc_scsi_cmd_iocb_cmpl:2157: 0:(0):3271: FCP cmd x28 failed <0/1> sid xe90001, did xe90040, oxid xa1 Local Reason x40 Returning Host Busy
2014-03-14T12:33:10.744Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270fc0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:33:10.759Z cpu2:33523)lpfc: lpfc_scsi_cmd_iocb_cmpl:2157: 0:(0):3271: FCP cmd x28 failed <0/1> sid xe90001, did xe90040, oxid x95 Local Reason x40 Returning Host Busy
2014-03-14T12:33:10.774Z cpu2:33410)lpfc: lpfc_scsi_cmd_iocb_cmpl:2157: 0:(0):3271: FCP cmd x28 failed <0/1> sid xe90001, did xe90040, oxid x6d Local Reason x40 Returning Host Busy
2014-03-14T12:33:10.789Z cpu2:33410)lpfc: lpfc_scsi_cmd_iocb_cmpl:2157: 0:(0):3271: FCP cmd x28 failed <0/1> sid xe90001, did xe90040, oxid x77 Local Reason x40 Returning Host Busy
2014-03-14T12:33:10.804Z cpu2:32897)lpfc: lpfc_scsi_cmd_iocb_cmpl:2157: 0:(0):3271: FCP cmd x28 failed <0/1> sid xe90001, did xe90040, oxid x6a Local Reason x40 Returning Host Busy
2014-03-14T12:33:10.819Z cpu2:33410)lpfc: lpfc_scsi_cmd_iocb_cmpl:2157: 0:(0):3271: FCP cmd x28 failed <0/1> sid xe90001, did xe90040, oxid x8c Local Reason x40 Returning Host Busy
2014-03-14T12:33:10.834Z cpu2:33410)lpfc0:(0) log compression on target 0 starting.
2014-03-14T12:33:10.894Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270fc0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:33:11.044Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270fc0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:33:11.074Z cpu2:32823)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:33:11.194Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270fc0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:33:11.344Z cpu4:32825)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270fc0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:33:11.494Z cpu4:32825)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270fc0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:33:21.668Z cpu4:32825)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:33:22.060Z cpu1:219602)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:651: Path "vmhba2:C0:T0:L1" (UP) command 0xa3 failed with status Timeout. H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:33:22.673Z cpu4:32825)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270fc0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:33:22.823Z cpu4:32825)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270fc0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:33:22.970Z cpu4:32825)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270fc0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:33:23.060Z cpu4:32825)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:33:23.120Z cpu4:32825)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270fc0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:33:23.270Z cpu4:32825)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270fc0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:33:23.420Z cpu4:32825)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270fc0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:33:23.570Z cpu4:32825)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270fc0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:33:24.134Z cpu22:33538)lpfc: lpfc_rportStats:3764: 0:(0) Compression log for fcp target 0, path is ok, IO errors: busy 2062, retry 0, no_connect 0, fcperr 6, tmo 3
2014-03-14T12:33:24.134Z cpu22:33538)lpfc: lpfc_rportStats:3801: 0:(0) Compression log for fcp target 0, path is ok, LCLRJT: norsc 0, rpi 0, rjt 6270
2014-03-14T12:33:24.134Z cpu22:33538)lpfc: lpfc_rportStats:3814: 0:(0) Compression log for fcp target 0, path is ok, FRAME: drops=38, under=0, over=0
2014-03-14T12:33:33.060Z cpu26:214916)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:651: Path "vmhba2:C0:T0:L1" (UP) command 0xa3 failed with status Timeout. H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:33:34.060Z cpu4:32825)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270fc0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:33:34.060Z cpu4:32825)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:33:34.700Z cpu4:32825)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270fc0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:33:34.850Z cpu4:32825)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270fc0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:33:35.000Z cpu4:32825)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270fc0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:33:35.060Z cpu4:32825)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:33:35.150Z cpu4:32825)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270fc0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:33:35.300Z cpu4:32825)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270fc0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:33:35.450Z cpu4:32825)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3270fc0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:33:45.060Z cpu27:214923)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:651: Path "vmhba2:C0:T0:L1" (UP) command 0xa3 failed with status Timeout. H:0x5 D:0x0 P:0x0 Possible sense data: 0x2 0x3a 0x2.
2014-03-14T12:33:46.060Z cpu4:32825)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:33:49.670Z cpu10:32831)ScsiDeviceIO: 2337: Cmd(0x412fc3270fc0) 0x28, CmdSN 0x3 from world 34101 to dev "naa.600144f004076a0300005321912f0002" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:33:49.670Z cpu26:34101)FSS: 5051: No FS driver claimed device 'naa.600144f004076a0300005321912f0002:5': Not supported
2014-03-14T12:33:56.060Z cpu34:219576)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:651: Path "vmhba2:C0:T0:L1" (UP) command 0xa3 failed with status Timeout. H:0x5 D:0x0 P:0x0 Possible sense data: 0x5 0x20 0x0.
2014-03-14T12:34:19.326Z cpu4:33594)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc0405ac0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:19.326Z cpu4:33594)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:34:19.326Z cpu4:33594)ScsiDeviceIO: 2324: Cmd(0x412fc0405ac0) 0x28, CmdSN 0x3 from world 34101 to dev "naa.600144f004076a0300005321912f0002" failed H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:34:19.415Z cpu2:33032)WARNING: iodm: vmk_IodmEvent:193: vmhba2: FRAME DROP event has been observed 6 times in the last one minute. This suggests a problem with Fibre Channel link/switch!.
2014-03-14T12:34:19.475Z cpu4:33594)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc0405ac0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:19.621Z cpu4:33594)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc0405ac0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:19.758Z cpu4:33594)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc0405ac0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:19.907Z cpu4:33594)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc0405ac0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:20.055Z cpu4:33594)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc0405ac0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:20.070Z cpu4:33594)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a0300005321912f0002" state in doubt; requested fast path state update...
2014-03-14T12:34:20.204Z cpu4:33594)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc0405ac0, 34101) to dev "naa.600144f004076a0300005321912f0002" on path "vmhba2:C0:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:20.224Z cpu26:34101)VC: 1958: Device rescan time 29 msec (total number of devices 11)
2014-03-14T12:34:20.224Z cpu26:34101)VC: 1961: Filesystem probe time 117554 msec (devices probed 10 of 11)
2014-03-14T12:34:20.224Z cpu26:34101)VC: 1963: Refresh open volume time 0 msec
2014-03-14T12:34:20.229Z cpu26:34101)LVM: 2907: [naa.600144f004076a030000532191280001:1] Device expanded (actual size 104855519 blocks, stored size 104847953 blocks)
2014-03-14T12:34:20.231Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:20.231Z cpu0:32821)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:34:20.231Z cpu0:32821)ScsiDeviceIO: 2324: Cmd(0x412fc04342c0) 0x28, CmdSN 0x4 from world 34101 to dev "naa.600144f004076a030000532191280001" failed H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:34:20.375Z cpu6:32827)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:20.524Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:20.670Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:20.819Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:20.963Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:21.060Z cpu37:33539)lpfc: lpfc_change_queue_depth:186: 0:(0):3295 lun queue depth changed [0:0:0] old=22, new=21
2014-03-14T12:34:21.060Z cpu37:33539)lpfc: lpfc_change_queue_depth:186: 0:(0):3295 lun queue depth changed [0:0:1] old=22, new=21
2014-03-14T12:34:31.060Z cpu1:219602)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:651: Path "vmhba2:C0:T0:L0" (UP) command 0xa3 failed with status Timeout. H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:34:31.060Z cpu39:213539)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:651: Path "vmhba2:C0:T0:L1" (UP) command 0xa3 failed with status Timeout. H:0x5 D:0x0 P:0x0 Possible sense data: 0x2 0x3a 0x2.
2014-03-14T12:34:31.603Z cpu2:32823)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:34:31.648Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:32.286Z cpu2:32823)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:34:32.301Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:32.450Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:32.601Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:32.750Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:32.900Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:33.552Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:33.552Z cpu2:32823)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:34:43.060Z cpu32:214613)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:651: Path "vmhba2:C0:T0:L0" (UP) command 0xa3 failed with status Timeout. H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:34:43.220Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:44.060Z cpu0:32821)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:34:44.164Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:44.314Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:44.464Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:44.615Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:44.765Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:45.060Z cpu0:32821)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:34:54.360Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:54.510Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:56.046Z cpu0:32821)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:34:56.060Z cpu0:32821)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:34:56.165Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:56.314Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:56.465Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:56.615Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:56.763Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc04342c0, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:34:57.060Z cpu0:32821)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:35:00.231Z cpu10:32831)ScsiDeviceIO: 2337: Cmd(0x412fc04342c0) 0x28, CmdSN 0x4 from world 34101 to dev "naa.600144f004076a030000532191280001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:35:06.345Z cpu26:34101)LVM: 2907: [naa.600144f004076a030000532191280001:1] Device expanded (actual size 104855519 blocks, stored size 104847953 blocks)
2014-03-14T12:35:06.346Z cpu0:32821)ScsiDeviceIO: 2324: Cmd(0x412fc3909e80) 0x28, CmdSN 0x4 from world 34101 to dev "naa.600144f004076a030000532191280001" failed H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:35:06.420Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:08.030Z cpu0:32821)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:35:08.060Z cpu0:32821)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:35:08.075Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:08.225Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:08.375Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:08.525Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:08.674Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:09.060Z cpu0:32821)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:35:17.840Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:17.990Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:20.012Z cpu0:32821)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:35:20.070Z cpu0:32821)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:35:20.143Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:20.287Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:20.434Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:20.580Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:20.726Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:21.060Z cpu2:32823)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:35:29.284Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:29.434Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:31.972Z cpu2:32823)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:35:32.060Z cpu2:32823)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:35:32.090Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:32.237Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:32.383Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:32.532Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:32.680Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:33.060Z cpu2:32823)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:35:41.347Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:43.944Z cpu2:32823)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:35:44.004Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:44.064Z cpu2:32823)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:35:44.155Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:44.303Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:44.453Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:44.604Z cpu2:32823)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3909e80, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:46.347Z cpu10:32831)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:35:46.347Z cpu10:32831)ScsiDeviceIO: 2337: Cmd(0x412fc3909e80) 0x28, CmdSN 0x4 from world 34101 to dev "naa.600144f004076a030000532191280001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:35:53.258Z cpu26:34101)LVM: 2907: [naa.600144f004076a030000532191280001:1] Device expanded (actual size 104855519 blocks, stored size 104847953 blocks)
2014-03-14T12:35:54.544Z cpu26:34101)LVM: 7525: Initialized naa.600144f004076a030000532191280001:1, devID 5322f7aa-b558036f-67e4-38eaa78e1f00
2014-03-14T12:35:54.552Z cpu26:34101)LVM: 7613: Zero volumeSize specified: using available space (53668199936).
2014-03-14T12:35:54.999Z cpu12:32833)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:35:54.999Z cpu12:32833)ScsiDeviceIO: 2324: Cmd(0x412fc35b4500) 0x28, CmdSN 0x3 from world 34101 to dev "naa.600144f004076a030000532191280001" failed H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:35:55.014Z cpu12:32833)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:55.073Z cpu12:32833)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:35:55.163Z cpu12:32833)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:55.177Z cpu20:33539)lpfc: lpfc_change_queue_depth:186: 0:(0):3295 lun queue depth changed [0:0:0] old=21, new=20
2014-03-14T12:35:55.177Z cpu20:33539)lpfc: lpfc_change_queue_depth:186: 0:(0):3295 lun queue depth changed [0:0:1] old=21, new=20
2014-03-14T12:35:55.814Z cpu12:32833)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:55.964Z cpu12:32833)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:56.069Z cpu12:32833)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:35:56.113Z cpu12:32833)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:56.264Z cpu12:32833)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:56.414Z cpu12:32833)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:35:57.549Z cpu26:33111)LVM: 13082: One or more LVM devices have been discovered.
2014-03-14T12:36:06.499Z cpu12:32833)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:36:06.499Z cpu12:32833)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:36:06.649Z cpu12:32833)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:36:07.060Z cpu12:32833)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:36:07.759Z cpu12:32833)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:36:07.909Z cpu12:32833)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:36:08.060Z cpu12:32833)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:36:08.060Z cpu12:32833)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:36:08.210Z cpu12:32833)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:36:08.359Z cpu12:32833)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:36:17.950Z cpu12:32833)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:36:17.957Z cpu8:32829)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x1a (0x412e828eea80, 0) to dev "mpx.vmhba32:C0:T0:L0" on path "vmhba32:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE
2014-03-14T12:36:17.957Z cpu8:32829)ScsiDeviceIO: 2337: Cmd(0x412e828eea80) 0x1a, CmdSN 0x1683 from world 0 to dev "mpx.vmhba32:C0:T0:L0" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.
2014-03-14T12:36:18.035Z cpu12:32833)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:36:18.064Z cpu12:32833)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:36:19.060Z cpu12:32833)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:36:20.060Z cpu12:32833)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:36:20.090Z cpu12:32833)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:36:20.236Z cpu12:32833)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:36:20.380Z cpu12:32833)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:36:20.523Z cpu0:32821)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:36:20.670Z cpu6:32827)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:36:27.060Z cpu27:214923)VMW_SATP_ALUA: satp_alua_issueCommandOnPath:651: Path "vmhba2:C0:T0:L1" (UP) command 0xa3 failed with status Timeout. H:0x5 D:0x0 P:0x0 Possible sense data: 0x2 0x3a 0x2.
2014-03-14T12:36:29.571Z cpu6:32827)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:36:29.616Z cpu6:32827)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:36:30.237Z cpu6:32827)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:36:30.268Z cpu6:32827)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:36:31.789Z cpu6:32827)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:36:31.924Z cpu6:32827)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:36:32.060Z cpu6:32827)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:36:32.075Z cpu6:32827)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:36:32.225Z cpu6:32827)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:36:32.374Z cpu6:32827)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:36:35.000Z cpu10:32831)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc35b4500, 34101) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL
2014-03-14T12:36:35.000Z cpu10:32831)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:36:35.000Z cpu10:32831)ScsiDeviceIO: 2337: Cmd(0x412fc35b4500) 0x28, CmdSN 0x3 from world 34101 to dev "naa.600144f004076a030000532191280001" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
2014-03-14T12:36:35.001Z cpu26:34101)LVM: 4257: PE grafting failed for device naa.600144f004076a030000532191280001:1, vol 5322f7a9-f65fea46-5207-38eaa78e1f00/6939764741478787561: Timeout
2014-03-14T12:36:39.554Z cpu6:32827)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3276240, 215401) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x2 0x3a 0x2. Act:EVAL
2014-03-14T12:36:39.554Z cpu6:32827)ScsiDeviceIO: 2324: Cmd(0x412fc3276240) 0x28, CmdSN 0x4 from world 215401 to dev "naa.600144f004076a030000532191280001" failed H:0x2 D:0x0 P:0x0 Possible sense data: 0x2 0x3a 0x2.
2014-03-14T12:36:41.576Z cpu6:32827)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:36:41.707Z cpu6:32827)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3276240, 215401) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x2 0x3a 0x2. Act:EVAL
2014-03-14T12:36:43.787Z cpu6:32827)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:36:43.863Z cpu6:32827)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3276240, 215401) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x2 0x3a 0x2. Act:EVAL
2014-03-14T12:36:44.013Z cpu6:32827)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3276240, 215401) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x2 0x3a 0x2. Act:EVAL
2014-03-14T12:36:44.058Z cpu6:32827)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.600144f004076a030000532191280001" state in doubt; requested fast path state update...
2014-03-14T12:36:44.163Z cpu6:32827)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3276240, 215401) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x2 0x3a 0x2. Act:EVAL
2014-03-14T12:36:44.314Z cpu6:32827)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3276240, 215401) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x2 0x3a 0x2. Act:EVAL
2014-03-14T12:36:44.463Z cpu6:32827)NMP: nmp_ThrottleLogForDevice:2321: Cmd 0x28 (0x412fc3276240, 215401) to dev "naa.600144f004076a030000532191280001" on path "vmhba2:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x2 0x3a 0x2. Act:EVAL
~ #