I use Affinity Photo/Designer/Publisher on my M1 MacBook Air (Downloaded from the website, not the AppStore ones), and they have been slow as molasses in January since I got my M1 in December.
However, with the latest 1.9.1 updates, which came out at the end of February, the launch speed is no longer an issue for me.
They have been launching so quickly that until now I hadn't bothered even thinking about the time it took. But as we are specifically discussing it, I just whipped out my timer to do a test and each of the apps now launches in under 2.5 seconds.
So, if you haven't already I'd suggest updating to 1.9.1, it's made a massive improvement to mine.