I don't know you...but at least based on this post...I don't think you're crazy?I have a 2020 27" iMac. I'v since purchased and returned two of the new 24" versions which I like for various reasons, like speed and such, but returned because I had some trouble getting them setup properly and I noticed that the screens seemed much foggier, less sharp, less contrasty, and somehow less attractive to work on (for me). At first I thought nah, can't be. Then I studied pretty carefully and there seemed to be a distinct difference to the disadvantage of the newer model. Maybe you get accustomed to the new screen, but at the moment I'm still happier with the old 27". Am I crazy? It's possible.
I just bought a M1 iMac to replace my late 2015 27 inch iMac (i5, 2TB fusion). I created a post on my observations about the move to the M1 a couple of days ago. In that post I stated the only downgrade in this move to the M1 for me is the display. Not only is the size of the 23.5 inch display of the M1 noticeably smaller when working in Lightroom and FCP, but when I compare the displays side-by-side (2015 27 inch 5K & M1 iMac) the 27 inch display is in another league (more contrast, deeper blacks, much better viewing angles). The M1 display is really nice, but the viewing angles are not good. If you view it from anywhere other than straight on....gets washed out looking quickly.
Personally, I don't think we're gonna see another larger iMac. I hope I'm wrong. If so, this sure leaves a huge gap between the 24 M1 iMac and the base Studio with Studio Monitor (approaching $4,000 with keyboard & mouse/trackpad).
I got the M1 iMac from Apple Refurbished ($1,600 for 16GB and 512GB SSD). I've got about 10 days left in the 15 day window to live with it. I'll likely keep it as it is a real upgrade from the 2015 27 inch in every way other than the display (IMO) and it does everything I will likely need for the next 2-3 yrs at least.