Over eons the huge sand layers were compacted and cemented into rock, called sandstone. Then, under the tremendous heat and pressures of mountain building, the sandstone was transformed into quartzite. The Tallulah River, flowing to the Savannah River, carved most of the gorge from the quartzite over millions of years.