What happened when you tried using handbrake? I just converted some m2ts files using handbrake the other day. Used the normal preset and just changed the resolution and deinterlacing options for what i needed and it worked fine.
Did you get errors? Do you have the latest version?