Skip to content
LIVE
The Executives BriefThe Executives Brief

NASA data finds hidden pulsar in 10 hours, not 600 years

A cryptography-inspired algorithm and 15 years of Fermi data turned an impossible search into a laptop-scale calculation, opening a hunt for hundreds of unseen pulsars.

BySalman Al-AmriSenior Correspondent, The Executives Brief
·4 min read
NASA data finds hidden pulsar in 10 hours, not 600 years
Executive summary

An international team including lead author Daniel Pook-Kolb and Weizmann Institute scientists Dotan Gazith and Barak Zackay used 15 years of NASA Fermi data to find pulsar PSR J1622-7204 about a million times faster than prior methods. For decision-makers, the result is a case study in how open data plus algorithms from another field can collapse compute costs and unlock discoveries at scale.

An international team has turned 15 years of publicly available NASA data into a pulsar-finding machine that is roughly a million times faster than previous methods. The work, published Thursday in Physical Review Letters, used NASA's Fermi Gamma-ray Space Telescope archive and a cryptography-inspired algorithm developed by Dotan Gazith and Barak Zackay of the Weizmann Institute of Science in Israel. The payoff was immediate: the team found PSR J1622-7204, an isolated pulsar spinning 261 times per second, using the equivalent of 10 hours of computing time on a standard computer processor.

That 10-hour figure is the number to sit with. The previous best method failed to find the pulsar even though it used enough computing power that a standard processor would need 600 years to perform the calculation. Lead author Daniel Pook-Kolb, a scientist at the Max Planck Institute for Gravitational Physics (Albert Einstein Institute) in Germany, explained why the search is so brutal: "We don't see every rotation from the pulsar, and we can't just count the rotations to work out where the photon came from." He added: "We have a four-dimensional grid, and we must search each direction with millions of trials in it. There's just not enough computing power on Earth to do it."

A pulsar is the rapidly spinning core of a dead star, a neutron star that sweeps beams of radiation toward Earth like a cosmic lighthouse. Finding one in gamma-ray data is not like spotting a bright dot. Fermi detects only a tiny number of photons from a given pulsar, mixed with background noise from other gamma-ray sources and the wider universe. To isolate the signal, researchers must guess several unknowns at once: how fast the star spins, how quickly the spin is slowing down, and exactly where it sits in the sky. Searching every combination would require an impossible number of computations. Traditionally, scientists broke Fermi data into smaller chunks and crowdsourced computing power from volunteers around the world. Even with that help, it typically took the equivalent of hundreds of computer-years to identify a single pulsar.

Gazith and Zackay saw a different path. They transformed the search into a geometry problem: finding the shortest vector in a high-dimensional lattice, a regularly spaced array of points. The technique draws on algorithms developed by cryptographers trying to break encryption systems designed to resist code-breaking by future quantum computers. The same math has also been used to make satellite navigation systems more efficient. "We have nothing to do with cryptography in our analysis here, but those algorithms can help us solve the problem of searching for pulsars in our data," Gazith said. Each trial run took about five minutes on a single computer core, easily doable on a standard laptop, which usually has between two and eight cores. Once the lattice method flagged a candidate, the researchers confirmed it by feeding in the full Fermi data set. The signal was so strong it could not be a chance occurrence.

The team is now aiming at a harder target: pulsars in binary systems, where a pulsar orbits another star. These discoveries have long been considered out of reach because the companion star's gravity distorts the signal in ways that have made these pulsars essentially impossible to find with traditional methods. "We know that there are probably tens or maybe even hundreds of these pulsars in the data set that we just couldn't find," said Colin Clark, an astrophysicist at the Max Planck Institute who co-authored the study. "The next goal is to extend the searches and use the combination of the new algorithm and the crowdsourced computing power from volunteers in our Einstein@Home program to hopefully find many new pulsars that we think should be there."

None of this would have happened without a deliberate policy choice. NASA has a longstanding Gold Standard Science policy of making its science data freely available. Fermi launched in 2008 and surveys the entire sky every three hours, observing the universe in gamma rays, the highest-energy form of light. After an initial one-year calibration period, all Fermi data became fully public and continues to be released as soon as it is processed. "The nice thing about NASA data is it's all open," Clark said. "All 18 years of Fermi data have been made public, and the data just keeps growing." That openness allowed researchers from outside the Fermi mission, including the cryptography-inspired team, to apply a completely new approach to the same dataset. NASA's Fermitools helped the team prepare the data. The Fermi catalog has grown from a few hundred gamma-ray sources to thousands as scientists apply fresh ideas to the archive.

The strategic lesson is not that one pulsar was found. It is how it was found. The breakthrough did not come from buying more compute. It came from reframing the search, borrowing algorithms from a field with no obvious connection to astrophysics, and running that math against open data that anyone could access. "Any search that one team is doing, another team can just go and do that and check the search," said Elizabeth Hays, Fermi project scientist at NASA's Goddard Space Flight Center in Greenbelt, Maryland. "It's made all of the science better." For leaders in any data-heavy field, the pattern is worth studying: public archives lower the barrier to entry, cross-domain talent can bend the cost curve, and reproducible data lets more teams attack the same problem. The next test is the binary-pulsar hunt, where the team plans to combine the new algorithm with volunteer computing power. If it works, the same archive that just yielded one hidden pulsar could yield many more.

Executive ActionsLocked

This story's Key Insights and Take-aways are locked.

Create a free account to unlock Executive Actions for one credit.

Register to Unlock

Always free for Executives Club members. Join the Club

More in Science