again, show me an independent review showing a huge difference between the 24 Gb and the 128 Gb version of Fusion Drive and I will agree with you ....
The minute you fill up the SSD portion of the Fusion drive, it means everything from now on is going to go to the HD portion. If the iMac was running a 15k RPM HDD, that might be slightly better, but with the 7.2k RPM HDD you're gonna feel the slowness. Apps will take longer to open. Files will take much longer to read and transfer.
It's not just about transfer rates. It's also about I/O. For example with a fusion drive, especially if you have your media stored on the same drive as your OS and your apps, your fusion drive is already working hard to run your apps and OS, and then on top of that once you start accessing media (audio/video/images), it's simply not going to have the I/O capacity to give you the same speeds as SSD.
Especially if you're doing any kind of real work (i.e. media production), you're almost far better off going with the SSD vs the Fusion, or at least going with the 128 Gb SSD vs the 24 Gb SSD.