I deleted a VM directly from the ESXi host and it left it orphaned in vSphere. I followed the article as described here - Deleting an orphaned virtual machine when the Remove option is not available (1011468) | VMware KB
No dice. The solution was to use PowerCLI to permanently delete the VM from the vSphere environment.