Holding down Power + Home Button for ~15 seconds worked for me, it just turned on.
EDIT: I might add, I don't think this was in DFU mode. I tried it in DFU mode (showing the connect to iTunes stuff) and it didn't work.
EDIT: I might add, I don't think this was in DFU mode. I tried it in DFU mode (showing the connect to iTunes stuff) and it didn't work.