That does seem a little odd. I can play 1440p YouTube videos on my 2016 without the fan coming on. Since owning the machine, I think I've heard the fan once.
If you use safari, google streams you h264 which is hardware accelerated. But viewing new 4K videos requires VP9 on youtube. VP9 is the "free" version about equal to h265 (you get either better image quality at same bitrate or half the bandwith required at same image quality of h264).