Why can’t these kinds of improvements be made to jpg itself? Media format sprawl is already exhausting.

but there's a limit on what can be done with the primitives that jpeg offers. for example, jpeg is stuck with the older huffman coding for the entropy encoding part, instead of the better arithmetic coding or asymetric numeral systems