I would say absolutely yes, delete away, but just to be sure we're on the same page open up your music folder and then in another finder window open up your iTunes Music folder (usually in your music folder > iTunes > iTunes Music). As long as there's two separate files for your music delete the music files from your Music folder (just not the ones in the iTunes etc folders).