There's a lot that chart misses in just listing pure specs, for example between XS and X: Larger camera sensor for much improved dark light photos, higher speed video recording, background NFC, faster Face ID for example.
Add in more memory, slightly faster, much faster GPU/Metal, bigger display, slightly more battery time, dual SIM, all US bands on 1 phone vs. 2, and there is going to be a list of advantages that really appeal to a lot of people vs. the price difference when comparing these two phones.