Blue line shows abundance of Iron in Universe; Orange line shows abundance of Gold.
Gold is 106.5 times less common than Iron. In ordinary representation, that is a factor of about 3,000,000.
Also, Gold is an ODD numbered element (79), and odd numbered elements are generally significantly less common than nearby EVEN numbered elements, due to the lower stability of ODD numbered elements.
However, in Earth's crust, Gold is far rarer than it is in the Universe, because gold forms few compounds and is highly soluble in molten Iron, which comprises the core of the Earth. Its abundance in asteroids is comparable to its universal abundance, which is why it may be cheaper to obtain Gold from asteroids than from the Earth's crust if and when space travel becomes inexpensive.
Besides, Gold is a very poor material for paving, since its softness means that it polishes readily to a smooth and slippery surface after rain.