I solved this by removing a second, older Google entry in my Internet accounts. Even though no services were checked inside it, removing it seemed to do the trick.