Glad I'm not alone!
I think I am coming to the idea that I will be compliant, even when using the smartcard server. My solution is isolated (it's a POC) and will have no physical hardware with the exception of the ESXi hosts, which will run the entire virtual infrastructure.
I am hearing the same responses from one of our VMware partners so as long as you are purely VDI, you are ok with vSphere/vCenter for Desktops.
Thanks for the comments - perhaps someday EULAs will be legible to mere mortals such as I