I ran into the same problem recently, when I added several audiobooks to iTunes. I noticed that when I didn't use the "add to iTunes automatically" folder, the delete option was grayed out. I manually deleted the folder like you did, and ITunes still showed the book. I deleted the lts and library files and then used the auto add folder. Annoying problem solved.