In all of history, only 161,000 tons of gold have been mined, barely enough to fill two Olympic-size swimming pools. More than half of that has been extracted in the past 50 years.