Solar Energy News  
TIME AND SPACE
Machine learning accelerates cosmological simulations
by Staff Writers
Pittsburgh PA (SPX) May 05, 2021

The leftmost simulation ran at low resolution. Using machine learning, researchers upscaled the low-res model to create a high-resolution simulation (right). That simulation captures the same details as a conventional high-res model (middle) while requiring significantly fewer computational resources.

A universe evolves over billions upon billions of years, but researchers have developed a way to create a complex simulated universe in less than a day. The technique, published in this week's Proceedings of the National Academy of Sciences, brings together machine learning, high-performance computing and astrophysics and will help to usher in a new era of high-resolution cosmology simulations.

Cosmological simulations are an essential part of teasing out the many mysteries of the universe, including those of dark matter and dark energy. But until now, researchers faced the common conundrum of not being able to have it all - simulations could focus on a small area at high resolution, or they could encompass a large volume of the universe at low resolution.

Carnegie Mellon University Physics Professors Tiziana Di Matteo and Rupert Croft, Flatiron Institute Research Fellow Yin Li, Carnegie Mellon Ph.D. candidate Yueying Ni, University of California Riverside Professor of Physics and Astronomy Simeon Bird and University of California Berkeley's Yu Feng surmounted this problem by teaching a machine learning algorithm based on neural networks to upgrade a simulation from low resolution to super resolution.

"Cosmological simulations need to cover a large volume for cosmological studies, while also requiring high resolution to resolve the small-scale galaxy formation physics, which would incur daunting computational challenges. Our technique can be used as a powerful and promising tool to match those two requirements simultaneously by modeling the small-scale galaxy formation physics in large cosmological volumes," said Ni, who performed the training of the model, built the pipeline for testing and validation, analyzed the data and made the visualization from the data.

The trained code can take full-scale, low-resolution models and generate super-resolution simulations that contain up to 512 times as many particles. For a region in the universe roughly 500 million light-years across containing 134 million particles, existing methods would require 560 hours to churn out a high-resolution simulation using a single processing core. With the new approach, the researchers need only 36 minutes.

The results were even more dramatic when more particles were added to the simulation. For a universe 1,000 times as large with 134 billion particles, the researchers' new method took 16 hours on a single graphics processing unit. Using current methods, a simulation of this size and resolution would take a dedicated supercomputer months to complete.

Reducing the time it takes to run cosmological simulations "holds the potential of providing major advances in numerical cosmology and astrophysics," said Di Matteo. "Cosmological simulations follow the history and fate of the universe, all the way to the formation of all galaxies and their black holes."

Scientists use cosmological simulations to predict how the universe would look in various scenarios, such as if the dark energy pulling the universe apart varied over time. Telescope observations then confirm whether the simulations' predictions match reality.

"With our previous simulations, we showed that we could simulate the universe to discover new and interesting physics, but only at small or low-res scales," said Croft. "By incorporating machine learning, the technology is able to catch up with our ideas."

Di Matteo, Croft and Ni are part of Carnegie Mellon's National Science Foundation (NSF) Planning Institute for Artificial Intelligence in Physics, which supported this work, and members of Carnegie Mellon's McWilliams Center for Cosmology.

"The universe is the biggest data sets there is - artificial intelligence is the key to understanding the universe and revealing new physics," said Scott Dodelson, professor and head of the department of physics at Carnegie Mellon University and director of the NSF Planning Institute. "This research illustrates how the NSF Planning Institute for Artificial Intelligence will advance physics through artificial intelligence, machine learning, statistics and data science."

"It's clear that AI is having a big effect on many areas of science, including physics and astronomy," said James Shank, a program director in NSF's Division of Physics. "Our AI planning Institute program is working to push AI to accelerate discovery. This new result is a good example of how AI is transforming cosmology."

To create their new method, Ni and Li harnessed these fields to create a code that uses neural networks to predict how gravity moves dark matter around over time. The networks take training data, run calculations and compare the results to the expected outcome. With further training, the networks adapt and become more accurate.

The specific approach used by the researchers, called a generative adversarial network, pits two neural networks against each other. One network takes low-resolution simulations of the universe and uses them to generate high-resolution models. The other network tries to tell those simulations apart from ones made by conventional methods. Over time, both neural networks get better and better until, ultimately, the simulation generator wins out and creates fast simulations that look just like the slow conventional ones.

"We couldn't get it to work for two years," Li said, "and suddenly it started working. We got beautiful results that matched what we expected. We even did some blind tests ourselves, and most of us couldn't tell which one was 'real' and which one was 'fake.'"

Despite only being trained using small areas of space, the neural networks accurately replicated the large-scale structures that only appear in enormous simulations.

The simulations didn't capture everything, though. Because they focused on dark matter and gravity, smaller-scale phenomena - such as star formation, supernovae and the effects of black holes - were left out. The researchers plan to extend their methods to include the forces responsible for such phenomena, and to run their neural networks 'on the fly' alongside conventional simulations to improve accuracy.

Research paper


Related Links
Carnegie Mellon University
Understanding Time and Space


Thanks for being here;
We need your help. The SpaceDaily news network continues to grow but revenues have never been harder to maintain.

With the rise of Ad Blockers, and Facebook - our traditional revenue sources via quality network advertising continues to decline. And unlike so many other news sites, we don't have a paywall - with those annoying usernames and passwords.

Our news coverage takes time and effort to publish 365 days a year.

If you find our news sites informative and useful then please consider becoming a regular supporter or for now make a one off contribution.
SpaceDaily Contributor
$5 Billed Once


credit card or paypal
SpaceDaily Monthly Supporter
$5 Billed Monthly


paypal only


TIME AND SPACE
Small galaxies likely played important role in evolution of the Universe
Minneapolis MN (SPX) May 04, 2021
A new study led by University of Minnesota astrophysicists shows that high-energy light from small galaxies may have played a key role in the early evolution of the Universe. The research gives insight into how the Universe became reionized, a problem that astronomers have been trying to solve for years. The research is published in The Astrophysical Journal, a peer-reviewed scientific journal of astrophysics and astronomy. After the Big Bang, when the Universe was formed billions of years a ... read more

Comment using your Disqus, Facebook, Google or Twitter login.



Share this article via these popular social media networks
del.icio.usdel.icio.us DiggDigg RedditReddit GoogleGoogle

TIME AND SPACE
Will your future clothes be made of algae?

Incentives could turn costs of biofuel mandates into environmental benefits

Dominating fungus could be solution to producing more biofuels and chemicals

Hydrocracking our way to recycling plastic waste

TIME AND SPACE
Robotic solution for disinfecting food production plants wins agribusiness prize

Artificial intelligence can boost power, efficiency of even the best microscopes

New brain-like computing device mimics associative learning

AI, captain! First autonomous ship prepares for maiden voyage

TIME AND SPACE
Vertical turbines could be the future for wind farms

Researchers working to further develop monopile production for offshore wind farms

Blowing in the wind: Fishermen threaten South Korea carbon plans

In Texas, a rancher swaps his oil pumps for wind turbines

TIME AND SPACE
Uber loss narrows as it hopes to rev shared rides

China's transition to electric vehicles

Simulation tests for the certification of automated veicles

Daimler and Volvo promise fuel-cell trucks by 2025

TIME AND SPACE
Electric vehicle batteries: The older they get, the safer they are

Renewable energy sources: On the way towards large-scale thermal storage systems

Denmark's largest battery - one step closer to storing green power in stones

On course to create a fusion power plant

TIME AND SPACE
Seeking enhanced materials for nuclear reactors

India closer to building world's biggest nuclear plant: EDF

Sri Lanka expels ship carrying nuclear material for China

Czechs ban Rosatom from nuclear tender, rule out Sputnik vaccine

TIME AND SPACE
French parliament to vote new climate law criticised by green groups

Germany's struggling Social Democrats push green credentials

Germany sets more ambitious climate goals after landmark ruling

Reducing methane emissions by 45% can achieve Paris goals

TIME AND SPACE
Deforestation of Brazilian Amazon hits record in April

Supermarkets threaten Brazil boycott over deforestation

Brazilian Amazon released more carbon than it stored in 2010s

Forest measuring satellite passes tests with flying colours









The content herein, unless otherwise known to be public domain, are Copyright 1995-2024 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. All articles labeled "by Staff Writers" include reports supplied to Space Media Network by industry news wires, PR agencies, corporate press officers and the like. Such articles are individually curated and edited by Space Media Network staff on the basis of the report's information value to our industry and professional readership. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. General Data Protection Regulation (GDPR) Statement Our advertisers use various cookies and the like to deliver the best ad banner available at one time. All network advertising suppliers have GDPR policies (Legitimate Interest) that conform with EU regulations for data collection. By using our websites you consent to cookie based advertising. If you do not agree with this then you must stop using the websites from May 25, 2018. Privacy Statement. Additional information can be found here at About Us.