Just have separate bootable partitions for Yosemite and Mavericks and select via holding the option key when booting the machine.
You can use Bootcamp for Windows (sorry I don't use Win at all)
http://en.wikipedia.org/wiki/Boot_Camp_(software)
How can I do this? I tried this once by making a new drive for Yosemite but failed horribly. Does anyone know how? I plan to use Yosemite as my main os but I want to keep mavericks for software and nostalgic purposes.
I'd be surprised, you can always create a bootable external with Mavericks on and boot off that as required.