I've seen it occasionally happen but that could be caused by the encoding of the video files in the first place. I believe Apple knows about this issue and they could provide a firmware upgrade to correct this issue.
Make sure the original 320x240 video in .MP4 format does not exceed 768 kbps data rate, though.