I've found, for whatever reason - probably lousy driver support, Installing new Magic devices to be a lousy experience. I'm assuming you've installed the BootCamp Support drivers. Yeah, whereas older Apple Bluetooth Keyboards and mice are flawless in installation - apple hasn't done the best job with the Magic devices.
Try restarting, connect both via lightning to the Mac, and reinstall Apple's Boot Camp support files. That worked for me.