OK I got it. I had to drag the ToolbarItems.nib from the Safari package onto the desktop in order to open it remove the toolbar then drag it back into the package.
I think Safari 2 is only available with Tiger. But you can download Pacifist and you might be able to remove safari 2 from a copy of tiger, but I'm not sure if that is legal or not.