That's roughly the case when we're talking about objects thousands or even millions of light years away.
With very distant objects there's another factor we're then looking back to the very early universe and the expansion of the universe (space and time that is , not just what's in it) has carried us all further apart too.
The usual analogie is currants in a loaf in an oven getting further apart as the dough expands.
The other thing is you do have to be careful about using words like position. The universe has no central pole that you measure things from, everything is moving at different rates and directions and you have to be careful to say position relative to something (like the center of our galaxy for example) to make sense.
We're not even sure that the universe is "open" it could be "closed" which would mean that if you could shoot off in one direction fast enough and long enough you'd come back to where you started (remembering of course what I said earler about positions :c) )