You’ll have to manually delete the windows efi partition. There’s a good article here on how to do it through terminal:Hi I have a question , I have a 2012 mac mini with Big Sur 11.0 installed , it has worked great ever since install a few weeks back , the SSD originally came from a Windows machine and I used mac utilities to erase it and format it . The BS 11.0 option key boot EFI has a yellow color EFI and there is also a grey color EFI , but the problem is when I shut down computer or restart it will not boot unless I use option key and manually select the Mac HD to get it to boot then all is fine . I have tried selecting the yellow EFI but has no effect on restart .
I also have a drive with BS 11.1 and when selecting it at option key and it has a red EFI choice but it has no effect either .....is there a way to resolve this to get it to start and restart without having to use option key to manually select the Mac HD ?
When I try to boot normally it comes up with the Windows BSOD, this machine does not have Windows OS on it , this is strange since I used Mac utilities to erase it and format it

macOS: Getting Rid of the Windows EFI Boot Entry - The Mac Observer
When you delete your Windows partition from your Mac manually, it leaves its EFI Boot entry. Let's get rid of that, shall we?

I would do the following:
1. Delete the Windows EFI first
2. Reset NVRAM
3. Re-patch the system by booting off the “EFI Boot” partition on the micropatched usb
4. Set the Startup Disk to 11.1 installation