I've only got 2GB in my old MacBook. Safari loads in one bounce, as does Mail and iTunes takes only two. Scrolling is fluid, although sometimes pages with a lot of images (such as the picture threads on this site) take a couple of seconds to fully load before you can scroll.
I've not heard my fans come on, apart from when on Flash and video heavy websites.