I can't tell if the algorithm used for placing tiles is less sophisticated or if removing the numbers makes me a better player.

It's exactly the same under the hood as Gabriele's original 2048 from https://github.com/gabrielecirulli/2048