Even a clean install of iOS 11 didn't resolve it for me.
Back to iOS 10 for now...
I did "Erase All" through settings. With a clean wipe (no restore from backup), Apple Music worked. Forgot to check App Store, but I'm assuming that would work since they use the same backend.
I'm doing a clean install and then an iCloud backup to see if I get lucky.