Prefer the simplest explanation.

While searching for explanation, the one with the least number of elements should be constructed. However, in the modern deep learning interpolation regime, having more parameters seems to generalize better.