I would encourage you to grab a Mac or PC, and perform a clean install of 26.5 using a USB cable.
iOS 26 is apparently much more refined now and 26.5 seems to have a better battery management on certain models, or similar in others. The iPhone 15 is the only one who has been negatively impacted by 26.5 battery wise.
Also, give it at least a couple of days and be aware of the apps you install, as certain apps such as Spotify or Instagram are well known to drain the battery.
I use an iPhone SE 3, which has an A15 with 4GB of RAM, and it works flawlessly, so I doubt the 4GB of RAM is the problem. The amount of RAM will probably be an issue for next iOS iterations such as iOS 27 or 28, but at least in my SE 2022, iOS 26 runs great. Not that you have to worry about upcoming iOS release’s performance, because A13 devices will likely lose support for iOS 27.
I know it’s a dilemma, but can’t you keep both devices and manually exchange the battery from the new to your old iPhone 11? And sell the new device to recover some of the money…