Subscribe free to our newsletters via your
. Solar Energy News .




SKY NIGHTLY
Automation offers big solution to big data in astronomy
by Staff Writers
Madison WI (SPX) Mar 26, 2015


Artist's impression of the full Square Kilometer Array at night. The SKA, consisting of several thousand dishes located in the deserts of South Africa and Australia, is expected to start full operation about 2025. Image courtesy SKA Organisation.

It's almost a rite of passage in physics and astronomy. Scientists spend years scrounging up money to build a fantastic new instrument. Then, when the long-awaited device finally approaches completion, the panic begins: How will they handle the torrent of data?

That's the situation now, at least, with the Square Kilometer Array (SKA), a radio telescope planned for Africa and Australia that will have an unprecedented ability to deliver data - lots of data points, with lots of details - on the location and properties of stars, galaxies and giant clouds of hydrogen gas.

In a study published in The Astronomical Journal, a team of scientists at the University of Wisconsin-Madison has developed a new, faster approach to analyzing all that data.

Hydrogen clouds may seem less flashy than other radio telescope targets, like exploding galaxies. But hydrogen is fundamental to understanding the cosmos, as it is the most common substance in existence and also the "stuff" of stars and galaxies.

As astronomers get ready for SKA, which is expected to be fully operational in the mid-2020s, "there are all these discussions about what we are going to do with the data," says Robert Lindner, who performed the research as a postdoctoral fellow in astronomy and now works as a data scientist in the private sector. "We don't have enough servers to store the data. We don't even have enough electricity to power the servers. And nobody has a clear idea how to process this tidal wave of data so we can make sense out of it."

Lindner worked in the lab of Associate Professor Snezana Stanimirovic, who studies how hydrogen clouds form and morph into stars, in turn shaping the evolution of galaxies like our own Milky Way.

In many respects, the hydrogen data from SKA will resemble the vastly slower stream coming from existing radio telescopes. The smallest unit, or pixel, will store every bit of information about all hydrogen directly behind a tiny square in the sky. At first, it is not clear if that pixel registers one cloud of hydrogen or many - but answering that question is the basis for knowing the actual location of all that hydrogen.

People are visually oriented and talented in making this interpretation, but interpreting each pixel requires 20 to 30 minutes of concentration using the best existing models and software. So, Lindner asks, how will astronomers interpret hydrogen data from the millions of pixels that SKA will spew? "SKA is so much more sensitive than today's radio telescopes, and so we are making it impossible to do what we have done in the past."

In the new study, Lindner and colleagues present a computational approach that solves the hydrogen location problem with just a second of computer time.

For the study, UW-Madison postdoctoral fellow Carlos Vera-Ciro helped write software that could be trained to interpret the "how many clouds behind the pixel?" problem. The software ran on a high-capacity computer network at UW-Madison called HTCondor. And "graduate student Claire Murray was our 'human,'" Lindner says. "She provided the hand-analysis for comparison."

Those comparisons showed that as the new system swallows SKA's data deluge, it will be accurate enough to replace manual processing.

Ultimately, the goal is to explore the formation of stars and galaxies, Lindner says. "We're trying to understand the initial conditions of star formation - how, where, when do they start? How do you know a star is going to form here and not there?"

To calculate the overall evolution of the universe, cosmologists rely on crude estimates of initial conditions, Lindner says. By correlating data on hydrogen clouds in the Milky Way with ongoing star formation, data from the new radio telescopes will support real numbers that can be entered into the cosmological models.

"We are looking at the Milky Way, because that's what we can study in the greatest detail," Lindner says, "but when astronomers study extremely distant parts of the universe, they need to assume certain things about gas and star formation, and the Milky Way is the only place we can get good numbers on that."

With automated data processing, "suddenly we are not time-limited," Lindner says. "Let's take the whole survey from SKA. Even if each pixel is not quite as precise, maybe, as a human calculation, we can do a thousand or a million times more pixels, and so that averages out in our favor."


Thanks for being here;
We need your help. The SpaceDaily news network continues to grow but revenues have never been harder to maintain.

With the rise of Ad Blockers, and Facebook - our traditional revenue sources via quality network advertising continues to decline. And unlike so many other news sites, we don't have a paywall - with those annoying usernames and passwords.

Our news coverage takes time and effort to publish 365 days a year.

If you find our news sites informative and useful then please consider becoming a regular supporter or for now make a one off contribution.
SpaceDaily Contributor
$5 Billed Once


credit card or paypal
SpaceDaily Monthly Supporter
$5 Billed Monthly


paypal only


.


Related Links
University of Wisconsin-Madison
Astronomy News from Skynightly.com






Comment on this article via your Facebook, Yahoo, AOL, Hotmail login.

Share this article via these popular social media networks
del.icio.usdel.icio.us DiggDigg RedditReddit GoogleGoogle




Memory Foam Mattress Review
Newsletters :: SpaceDaily :: SpaceWar :: TerraDaily :: Energy Daily
XML Feeds :: Space News :: Earth News :: War News :: Solar Energy News





SKY NIGHTLY
Far from home: Wayward cluster is both tiny and distant
Hilo HI (SPX) Mar 05, 2015
Like the lost little puppy that wanders too far from home, astronomers have found an unusually small and distant group of stars that seems oddly out of place. The cluster, made of only a handful of stars, is located far away, in the Milky Way's "suburbs." It is located where astronomers have never spotted such a small cluster of stars before. The new star cluster was discovered by Dongwon ... read more


SKY NIGHTLY
Weltec Biopower Builds 500-kW Biogas Plant for Vegetable Producer

Chinese airline completes cooking oil fuel flight

Supercomputers help solve puzzle-like bond for biofuels

Scientists engineer faster-growing trees ideal for biofuel

SKY NIGHTLY
Snake robots learn to turn by following the lead of real sidewinders

Robot finds bodily posture may affect memory and learning

USAF funds sense-and-avoid technology development

Robotic materials: Changing with the world around them

SKY NIGHTLY
U.S. to fund bigger wind turbine blades

Gamesa and AREVA create the joint-venture Adwen

Time ripe for Atlantic wind, advocates say

Wind energy: TUV Rheinland supervises Senvion sale

SKY NIGHTLY
Uber ramps up safety efforts after criticism

Pirelli future, and calanders, safe in Chinese hands

Pirelli boss attacks 'nationalist' China deal critics

Chinese takeover of Pirelli met with resignation in Italy

SKY NIGHTLY
New technology converts packing peanuts to battery components

Superconductivity breakthroughs

You can't play checkers with charge ordering

Researchers increase energy density of lithium storage materials

SKY NIGHTLY
Japan's NRA confirms fault line under nuclear reactor on west coast active

Jordan, Russia ink deal on nuclear reactor plant

N. Korea denies hacking nuclear plants in South

NE China nuclear plant generator operational

SKY NIGHTLY
New Zealand breaks renewable energy record

Energy company Eneco is heating homes with computer servers

Polish Power Exchange hosts 18th AFM Annual Conference

Reducing emissions with a more effective carbon capture method

SKY NIGHTLY
Forests for water in eastern Amazonia

Study: Only two intact forests left on Earth

Amazon's carbon uptake declines as trees die faster

Conifers' helicoptering seeds are result of long evolutionary experiment




The content herein, unless otherwise known to be public domain, are Copyright 1995-2014 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. Privacy Statement All images and articles appearing on Space Media Network have been edited or digitally altered in some way. Any requests to remove copyright material will be acted upon in a timely and appropriate manner. Any attempt to extort money from Space Media Network will be ignored and reported to Australian Law Enforcement Agencies as a potential case of financial fraud involving the use of a telephonic carriage device or postal service.