Didn't realise you still needed an answer. I'll have another crack at it - never say die.
Have you tried adjusting the amount of Top Sites in your preferences to see if that makes any difference to them reloading? I find that whenever I delete a panel, it's repopulated from either my past/history or the Safari defaults.