I had the same problem, I found that I had to pass the -Server parameter of the source vCenter in the Move-VM Cmdlet.
eg:
Move-VM -Server $SourceVCConn -vm $drvm -Destination $destcluster -VMotionPriority High -Datastore $destinationDatastore -PortGroup $targetPort