Not sure about this one but I'd like to believe it doesn't get delivered. Although, the way things are going for iMessage these days, it probably gets delivered to millions of phones.
As a sidebar, if you dictate a text using the mic (4S only, obviously), and press Send before the "little pink dots" materialize into words, you'll get an empty bubble and a "Sending..." status indefinitely.