I've experienced slow-downs, such as the text not keeping up.
Simply because there is a program in the background that is leaking memory. The Mac Bittorent program Transmission is an example of this (although it was updated today, so not sure if the new build has fixed that).
What programs do you have running? Have you installed any hacks, such as extra OSX themes?