Got ya covered! Swiping left-to-right on any track collection (like an Artist, or composer, playlist, whatever) will reveal the Collection Control options. The left icon will play all tracks in the collection. For an artist it will do this by album according to how artist albums are set to be sorted (chronologically up or down, or alphabetically).
So basically, ensure you have artist albums set to sort the way you prefer, swipe and tap!
Perfect! My new favorite app. Thanks!