vendredi 15 décembre 2017

Breaking data records bit by bit












CERN - European Organization for Nuclear Research logo.

Dec. 15, 2017


Image above: Magnetic tapes, retrieved by robotic arms, are used for long-term storage (Image: Julian Ordan/CERN).

This year CERN’s data centre broke its own record, when it collected more data than ever before.

During October 2017, the data centre stored the colossal amount of 12.3 petabytes of data. To put this in context, one petabyte is equivalent to the storage capacity of around 15,000 64GB smartphones. Most of this data come from the Large Hadron Collider’s experiments, so this record is a direct result of the outstanding LHC performance, the rest is made up of data from other experiments and backups.

“For the last ten years, the data volume stored on tape at CERN has been growing at an almost exponential rate. By the end of June we had already passed a data storage milestone, with a total of 200 petabytes of data permanently archived on tape,” explains German Cancio, who leads the tape, archive & backups storage section in CERN’s IT department.

The CERN data centre is at the heart of the Organization’s infrastructure. Here data from every experiment at CERN is collected, the first stage in reconstructing that data is performed, and copies of all the experiments’ data are archived to long-term tape storage.

Most of the data collected at CERN will be stored forever, the physics data is so valuable that it will never be deleted and needs to be preserved for future generations of physicists.

“An important characteristic of the CERN data archive is its longevity,” Cancio adds. “Even after an experiment ends all recorded data has to remain available for at least 20 years, but usually longer. Some of the archive files produced by previous CERN experiments have been migrated across different hardware, software and media generations for over 30 years. For archives like CERN’s, that do not only preserve existing data but also continue to grow, our data preservation is particularly challenging.”

While tapes may sound like an outdated mode of storage, they are actually the most reliable and cost-effective technology for large-scale archiving of data, and have always been used in this field. One copy of data on a tape is considered much more reliable than the same copy on a disk.

CERN currently manages the largest scientific data archive in the High Energy Physics (HEP) domain and keeps innovating in data storage,” concludes Cancio.

Note:

CERN, the European Organization for Nuclear Research, is one of the world’s largest and most respected centres for scientific research. Its business is fundamental physics, finding out what the Universe is made of and how it works. At CERN, the world’s largest and most complex scientific instruments are used to study the basic constituents of matter — the fundamental particles. By studying what happens when these particles collide, physicists learn about the laws of Nature.

The instruments used at CERN are particle accelerators and detectors. Accelerators boost beams of particles to high energies before they are made to collide with each other or with stationary targets. Detectors observe and record the results of these collisions.

Founded in 1954, the CERN Laboratory sits astride the Franco–Swiss border near Geneva. It was one of Europe’s first joint ventures and now has 22 Member States.

Related links:

CERN’s data centre: https://home.cern/about/computing

Outstanding LHC performance: http://orbiterchspacenews.blogspot.ch/2017/11/record-luminosity-well-done-lhc.html

Data storage milestone: http://orbiterchspacenews.blogspot.ch/2017/07/cern-data-centre-passes-200-petabyte.html

For more information about European Organization for Nuclear Research (CERN), Visit: http://home.cern/

Image (mentioned), Text, Credits: CERN/Harriet Jarlett.

Best regards, Orbiter.ch