NERSCPowering Scientific Discovery for 50 Years

Reading the Cosmic Writing on the Wall

NERSC Key to Planck’s Revision of Universal Recipe

March 21, 2013

By Margie Wylie

Color map showing the oldest light in our universe

This map shows the oldest light in our universe, as detected with the greatest precision yet by the Planck mission. The ancient light, called the cosmic microwave background, was imprinted on the sky when the universe was 370,000 years old. (Image credit: ESA and the Planck Collaboration)

Thanks to a supersensitive space telescope and some sophisticated supercomputing, scientists from the international Planck collaboration have made the closest reading yet of the most ancient story in our universe: the cosmic microwave background (CMB).

Today, the team released preliminary results based on the Planck observatory’s first 15 months of data. Using supercomputers at the U.S. Department of Energy’s (DOE) National Energy Research Scientific Computing Center (NERSC) Planck scientists have created the most detailed and accurate maps yet of the relic radiation from the big bang. They reveal that the universe is about 100 million years older than we thought with more matter and less dark energy and a slower expansion rate.

“These maps are proving to be a goldmine containing stunning confirmations and new puzzles,” says Martin White, a Planck scientist and physicist with University of California Berkeley and at Lawrence Berkeley National Laboratory (Berkeley Lab). “This data will form the cornerstone of our cosmological model for decades to come and spur new directions in research.”

Decoding the Cosmos

Written in light shortly after the big bang, the CMB is a faint glow that permeates the cosmos. Studying it can help us understand how our universe was born, its nature, composition and eventual fate. “Encoded in its fluctuations are the parameters of all cosmology, numbers that describe the universe in its entirety,” says Julian Borrill, a Planck collaborator and cosmologist in the Computational Research Division at Berkeley Lab.

However, CMB surveys are complex and subtle undertakings. Even with the most sophisticated detectors, scientists still need supercomputing to sift the CMB’s faint signal out of a noisy universe and decode its meaning.

Hundreds of scientists from around the world study the CMB using supercomputers at NERSC, a DOE user facility based at Berkeley Lab. “NERSC supports the entire international Planck effort,” says Borrill. A co-founder of the Computational Cosmology Center (C3) at the lab, Borrill has been developing supercomputing tools for CMB experiments for over a decade. The Planck observatory, a mission of the European Space Agency with significant participation from NASA, is the most challenging yet.

 

4 members of the Computational Cosmology Center pose in front of a visualization

From left, Reijo Keskitalo, Aaron Collier, Julian Borrill, and Ted Kisner of the Computational Cosmology Center (C³) with some of the many thousands of simulations for analyzing Planck data.
(Photo by Roy Kaltschmidt)

 

Parked in an artificial orbit about 800,000 miles away from Earth, Planck’s 72 detectors complete a full scan of the sky once every six months or so. Observing at nine different frequencies, Planck gathers about 10,000 samples every second, or a trillion samples in total for the 15 months of data included in this first release. In fact, Planck generates so much data that, unlike earlier CMB experiments, it’s impossible to analyze exactly, even with NERSC’s powerful supercomputers.

Instead, CMB scientists employ clever workarounds. Using approximate methods, they can handle the Planck data volume, but then they need to understand the uncertainties and biases their approximations have left in the results.

One particularly challenging bias comes from the instrument itself. The position and orientation of the observatory in its orbit, the particular shapes and sizes of detectors (these vary) and even the overlap in Planck’s scanning pattern affect the data.

To account for such biases and uncertainties, researchers generate a thousand synthetic (or simulated) copies of the Planck data and apply the same analysis to these. Measuring how the approximations affect this simulated data allows the Planck team to account for their impact on the real data.

Growing Challenges

With each generation of NERSC supercomputers, the Planck team has adapted its software to run on more and more processors, pushing the limits of successive systems while reducing the time it takes to run a greater number of complex calculations.

“By scaling up to tens of thousands of processors, we’ve reduced the time it takes to run these calculations from an impossible 1,000 years down to a few weeks,” says Ted Kisner, a C3 member at Berkeley Lab and Planck scientist. In fact, the team’s codes are so demanding that they’re often called on to push the limits of new NERSC systems.

Photo of the Hopper, a NERSC supercomputer

Planck scientists used three Cray supercomputers to create the 250,000 maps necessary to this release of Planck data: Hopper, a Cray XE6 (show here), Franklin, a Cray XT5 (now retired) and Edison, a Cray XE30 (still in testing). NERSC names its systems in honor of prominent scientists. Grace Hopper was an American computer scientist whose photo appears on the cabinets of this machine. (Photo of Grace Hopper courtesy of the Hagley Museum Library, PC20100423_201. Photo: Roy Kaltschmidt, LBNL)


Access to the NERSC Global Filesystem and vast online and offline storage has also been key. “CMB data over the last 15 years have grown with Moore’s Law, so we expect a two-magnitude increase in data in the coming 15 years, too,” said Borrill.

In 2007 NASA and DOE negotiated a formal interagency agreement that guaranteed Planck access to NERSC for the duration of its mission. “Without the exemplary interagency cooperation between NASA and DOE, Planck would not be doing the science it’s doing today,” said Charles Lawrence of NASA’s Jet Propulsion Laboratory (JPL). A Planck project scientist, Lawrence leads the U.S. team for NASA.

NASA's Planck Project Office is based at JPL. JPL contributed mission-enabling technology for Planck's science instruments. European, Canadian and U.S. Planck scientists work together to analyze the Planck data.


About NERSC and Berkeley Lab
The National Energy Research Scientific Computing Center (NERSC) is a U.S. Department of Energy Office of Science User Facility that serves as the primary high performance computing center for scientific research sponsored by the Office of Science. Located at Lawrence Berkeley National Laboratory, NERSC serves almost 10,000 scientists at national laboratories and universities researching a wide range of problems in climate, fusion energy, materials science, physics, chemistry, computational biology, and other disciplines. Berkeley Lab is a DOE national laboratory located in Berkeley, California. It conducts unclassified scientific research and is managed by the University of California for the U.S. Department of Energy. »Learn more about computing sciences at Berkeley Lab.