Astronomers observed that light from distant objects in the universe is redshifted (shift in the frequency of light towards red color), which tells us that the objects are all receding away from us. This is true in whatever direction you look at: all the distant galaxies are going away from us.