Ok, I have no idea what happened this time.
The first time I did this - basically shortly before I posted here - what I saw was a half-loaded Fitness+ page. This was with airplane mode on and WiFi disconnected.
I just tried it again. Now offline mode properly works.