You've been watching too many spy movies.
Keyloggers are installed by malicious software that you unwittingly downloaded, not by some ninja hacker sneaking into your house when you aren't home.
Run something like malware scan on your machine to see if you even have a key logger. Or, if you are truly paranoid, wipe the hard drive and reinstall the OS anew. That will get rid of everything. Literally.