OK. I've figured it out. If you start the media (Podcast or music) from the Apple Watch, then Apple Watch notifications play on the AirPods. Looks like this is as intended by Apple. I would have expected that both iPhone and Apple Watch notifications get played in the AirPods regardless of where I started the media.