For the next few weeks everyone is going to be using Siri a lot as we get used to "how" we can interact with it. I did have it go down a couple times but it's been working very well for the most part.
Once the hype dwindles and we stop "playing" with it I'd imagine it won't crash so much.
Also, it's still in beta so I forgive all of this right now.