I had been fighting this issue for several years, and I got to the bottom of it, so I thought I would share. (I see there are no shortage of similar reports in forums across the 'net.)
I have an "iMac (Retina 5K, 27-inch, 2017)" that is the mid-level configuration; it is a 3.5GHz quad-core i5...