Yes, that would work.
But if financial institutions are the only thing keeping you on those, I would wind down and close those accounts. If you don't want to go with a traditional bank, I would recommend Wealthfront for savings and X1 for a credit card. Very similar to Apple's offerings, but platform independent.
You can also manage the Apple Card in browser from any device:
https://card.apple.com/