I suspect that a big chunk of YouTube’s audience puts it on and lets it auto play, the same way one might turn on a tv channel and see whatever is on. This audience has more tolerance for ads, and so is more lucrative than people seeking short, information-dense videos. And so they are what gets optimised for.