You understate the magnitude of the task. It's 30TB of data per night.
Thanks, that was a typo.
For comparison sake, this past weekend, I copied about 2 TB of data to new drives on the same server. The server is a PowerEdge 2950, which is a nearly state of the technology, enterprise class server, and it uses RAID5 drive config and 7.2K RPM SATA drives. This “mere” 2 TB of data took nearly 2 days for a complete copy. These folks are producing 30 TB of data storage (15 times what I worked with) per night suggests a whole lot of parallel processing and/or a new generation of processing hardware, or perhaps both.