Aside from looking at things with our heads tilted, yes, it matters in another way, too.
If our benches are not level, neither are the pots that sit on them. When we water, pools will then form on one side of the pot. There the roots will be well watered.
What about the rest of the pot, the non-pooled areas?
It’s likely that soil will not get enough water.
When roots consistently don’t get enough water, they get weak. And then they die. And then you can find a non-level bench reality staring at you: dead branches on one side of the tree.
After many years our benches can shift. Boards can warp. If leveling the benches is a big bother, something for another day, at least look to your pots. One thin piece of wood under the right side of this pot corrected the level, and ensures water will seep into all parts of the soil.