Is there any easy way for the close up lenses to tell which would be better to buy? A lot of people say you have to buy the EF 50mm f/1.8 II.
That's not a close-up lens. It's a prime (ie, non zoom) lens.
I see it is also pretty cheap. If I do buy that, what advantage does it have over the 18-55 kit lens?
It's faster - it lets more light in. That lets you increase shutter speed, or decrease ISO - so it can give you options to take higher quality photos.
It should be sharper than your zoom.
If you use it at f 1.8 or a similarly wide aperture and focus on something close up (say a portrait), then the background just beyond the subject will be out of focus. This can make pictures look almost 3D - it's a great effect.