I too am thinking about going back to Mavericks, simply because Mavericks was way, way faster and Yosemite does not offer any additional features that I actually use. The new design is good and all, but I liked the old design just as much, and I'd rather take a very fast system over a very slow one.
I do have a Time Machine backup from Mavericks, but since then I have created files all over the place. How can I make sure after restoring to the latest Mavericks backup, that I know what files have changed and been created since then? Is there a way to do this automatically, or do I just have to manually copy/paste the contents of each folder in my home folder (with the exception of Library I'd guess)? This doesn't sound very fool-proof, what if 3 months down the line I remember that there was a file somewhere that I forgot to copy, and all my backups have been overwritten since then? Can't I use Migration Assistant to "migrate" my Yosemite setting/files/etc... to Mavericks?