Hmm, not having a problem with the caps lock. I did some research about this, apparently the key or keyboard needs to be replaced for this, as it is a hardware error (I tried resetting the PRAM and changing the key repeat settings to no avail). I'm going to take it to the genius real quick and see what they say.
The reason I'm concerned is that the MBA is a bitch to open and repair, and I assume the keyboard is no different. I wonder if they're just going to give me a new one rather than deal with it.