That's the way it's supposed to work, if I'm understanding this correctly. If Face ID fails, just enter the password, it'll help improve the facial recognition of the phone, and as time goes by, it should fail less and less as it learns to scan your face from different angles.