I've bought factory refurbs from Apple and Nikon... both with no problems at all. The thing is, with Nikon the factory refurbs you only get a 90 day warranty, although the cameras are indistinguishable from what you'd get brand new. Similar deal as buying Apple refurbs, although Apple usually gives refurbs the same warranty as new. It's something to think about. What I've usually done is add a 3 or 5 yr. Mack warranty onto any refurb I buy through the local store I buy through. Even though the Mack warranty is good nationally, it help to have the local retailer back it up. I've never had to make a claim at all on my Nikon gear, so it's mainly been peace of mind.
I have no experience with refurbs from Canon.
The main thing is to make sure any refurbs you are looking at are the actual factory refurbs, not third-party refurbs. I've seen a few of those, so be sure of what you're looking at.