Thanks. Right now High Sierra is installing, but I'll try installing Catalina again after.Wait for the re-boot phase (2nd stage of the installation), press and hold ALT key to get the boot selector. Then choose the "install macOS" drive instead of your previous drive. Make sure your iMac is APFS ready (either off the shelf by previously installing High Sierra or by APFS ROM patcher method).
By the way, after the first part of the Catalina installation, when it rebooted but to the boot-from-drive mode rather than continuing the Catalina installation, I turned the machine off, removed the USB stick, and turned the machine on. Would this be effectively the same as the method you are suggesting? Or do I need to hold the alt key and choose "install macOS", like you are saying, but keep the USB stick in? I saw a black screen with some script running for a few seconds, then I saw a black screen with a white apple logo and a progress bar and it looked like it might have been installing. I left it for about an hour and I came back and it was a white screen with a black apple logo and a black progress bar that was finished, but not doing anything. Maybe it was taking awhile, so I just let it keep going over night. But when I woke up this morning it was still stuck like that so I just forced shutdown.