Gently slide your thumb across the damaged area. If there is no sharp edge or burr then leave it as is.
If there is a sharp area that could scratch your skin and/or other surfaces then you might consider very gently filing or sanding that one small spot with very fine (~1000 grit) wet/dry sandpaper or a very fine diamond file. Do this very gently and only enough to smooth/polish the sharp edge/burr to the point that it won't scratch or cut something.