That's not an acceptable solution to me. But according to the 2 comments above, if you don't use FileVault the problem goes away, and I don't. So that is all I need if that indeed solves the problem.Wow, this is the thing I wanted to move away from.
I'm now running a Hackintosh and have 2 cables connected to my screen, one that starts from my motherboard (equivalent off plugging a cable into the Mac Mini), and one that starts from my GPU (equivalent of plugging it in an eGPU). I always have to switch my screen to the first one, after boot go to the second one. Sad that this would still be the case with a Mac Mini.