So, is space infinite if you try to get higher instead of moving forward?

Answer 1

And what would be the difference in a spatial dimension.

Answer 2

If "higher" means "farther from the earth," then "forward" motion also means "farther from the earth," so there is no difference.