Installation of Windows Server 2012 RTM Datacenter Core failed on ESXi 5.0.0U1 (821926) until I resolved a contradiction in the VMware documentation. In the VMware Compatibility Guide for this configuration, the VMXNET3 NIC is said to be supported, but based on trial and error, it is not. The E1000E NIC does work properly.
With the VMXNET3 NIC, the symptoms are that Windows Server 2012 Setup completes the file copying phase and reboots. It goes through "Getting Devices Ready" and then hangs indefinitely on a black splash screen with the spinning wheel of white dots (WDOD?) and the caption "Getting Ready".
The compatibility guide refers to three KB articles, including KB 2006859: Windows 8 / Windows Server 2012 Operating System does not boot or install on ESXi or ESX, KB 2021887: Windows 8 Release Preview and Windows Server 2012 Release Candidate fail when starting for the first time after the installation, and one other. The first of these states near the bottom that the VMXNET3 NIC does not work, contradicting the compatibility guide. The second article refers to the need for EFI virtual firmware, which I found to be true, and the need for a VMX setting vmGenCounter.enable = False, which I found not to be necessary.
I have not yet tested ESXi 5.1 due to its current incompatibilty with VMware View. Hopefully this experience will save others some time and effort meanwhile.
Jeffry A. Spain
Network Administrator
Cincinnati Country Day School