Changes to Firewall settings do not stick. So, for example, changing the "Block incoming connections" setting for any individual processes is not saved. Confirmed by making change; quitting System Settings; re-opening System Settings; navigate to Firewall options.
Also, changes to Firewall settings do not require Admin credentials. This includes when "Require an administrator password to access system-wide settings" is ON. Lucky, then, that no changes stick.
I have had this bug since Ventura 13.1 and maybe earlier.
It is not due to any security software e.g. LittleSnitch; Objective See; Malwarebytes.
There are some reports of this issue in Apple Discussions e.g.:
discussions.apple.com