I also found a more easier solution to get rid of hang at "Uninstalling..." in Host Preparation.
You can go to vCenter > Home > vCenter Solutions Manager > vSphere ESX Agent Manager > Management tab.
If the VMware Network Fabric status is "Uninstalled" "Normal" you can try to right click on the item and "Resolve" / "Sync" and "Delete" that agent.
By doing this, we expect the Network Fabric agent being deleted.