I am a god damned fool and was installing the iOS beta config profile to my watch, rather than the separate and completely different watchOS beta config profile.
It would be nice if Apple would take away the pop up that asked you if you want to install the iOS beta config file to either phone or watch. Definitely would help makes things clearer. It should be smarter about which config file should be applied to which device.