Really? My Apple Watch never drains battery due to time in daylight measurement. It only matters when it comes to brightness and the always on display.LTE connectivity (if you don't bring your phone and use it) can drain a lot if network conditions are poor.
Another important factor is sun exposition. In very bright conditions, watchOS pushes luminosity to keep the watch readable, and it also eats a lot.