If you can still access those accounts, you can remove the checking account with them and then close the account. The email on file cannot be reused, though. However, in any case, you can try an online only financial institution that's certified by your nation's federal banking standards authority. Transfer some money into it as most if not all do not require a minimum amount and carry no monthly fees, and use that for PayPal. I personally find that much more smart and safe than a brick and mortar bank when it comes to PayPal.
It's almost like an air gap between PayPal and your day to day checking account, instead using a online only bank that has a very small amount of money in it. I feel PayPal will come under immense scrutiny in the next 5-10 years since they skirt the law by not operating as a bank. It's one of the many loopholes that allow them to operate as they do.
In addition, you can link the debit or account of that online institution to your Apple Apps store, even though I believe PayPal is available for linking. Do as you please, really.