Nope, its past sunset in my area and it hasn't gone dark.
when you set it to Dark, does yr Safari window have a black background immediately?
if yes, then the issue you have is one related to time.
btw, apple seems to use a non-standard definition of sunset timing (apple's sunset is a bit later than precise sunset time), but at any rate, i have also found that after setting to Auto it might take at least one full reboot and at least a few days in that time zone for it to take affect routinely.
Auto took around 2 weeks on my machine to reliably kick in automatically (if I reboot after sunset it would go Dark immediately however).
if you are traveling make sure you have Timezone set to auto based on Location.
also, on my machine, even though i use the auto change default desktop wallpaper, the desktop picture as well would not reliably change throughout the day until about 2 weeks after setting it to Auto.
i am traveling constantly so i just figured it had to do with that;
but actually now both desktop and app window are consistently catching up with me no matter which timezone i am in, so its working really well now. it did take time however.