If you connect to another USB port, you have to install the USB drivers on windows from scratch. Windows sees it as an entirely different device.
I personally just stick with the same port all of the time. I'm honestly not sure if I ever really got it to work on another port. I know I installed the drivers again for each port, but I may have given up after that.
I've had other USB devices do this same thing to me on Windows, so it seems like a Windows issue.