I went to the Apple store to see if they would help me. They wanted $150 for a replacement phone since I'm out of warranty. I would have considered paying it if that would have corrected the problem for sure. Since it only started doing it after I updated to iOS5 I hardly think it's the actual phone. I did a restore to new and still happens. Restored from a backup from last April and again, still doing it. It will also not charge when I plug it in sometimes, even when left overnight. I will have to unplug and try it again. Sometimes when I do unplug it, the phone will just turn off again. And not the little spinning thing like it's powering down, just a black screen instantly like it crashed.
I think it's BS that Apple won't help me in this matter seeing as it's no fault of mine it doesn't work correctly. It was just fine before the new OS was installed. I love the phone and features, I just want it to work like it's supposed to. Not randomly crash while sitting in my pocket.