Help solve big data problems of the future by participating in Microsoft Research’s Naiad Project

Chew on this for just a moment: In this decade, we will collect more scientific data than we’ve collected in human history, writes Tara Grumm on the Openness@Microsoft blog. But how do we analyze all that data, coming from sources like satellites, Internet-connected sensors and massive computer simulations, so we can figure out what it all means?

Michael Isard, Derek Murray and Frank McSherry of Microsoft Research are working to address the data deluge with Naiad, an open source, .NET-based platform for high-throughput, low-latency data analysis, including tools built atop Microsoft Azure to deliver interactive analyses of huge data sets. But they want interested programmers and analysts to get involved, too.

In a Q-and-A with the team, they say they’d like to see Naiad “in broad use, as part of the standard toolkit for processing big data. Naiad should raise the bar for performance expectations, and at the same time lower the barrier to entry for new programmers. We also designed Naiad to be transparent enough that you can see its moving parts, and it would make for a great system for teaching some of the principles of distributed, data-parallel computing.”

To read the entire Q-and-A, and to learn more about Naiad, head over to the Openness@Microsoft blog.

You might also be interested in:

· Out of beta! Status.modern.ie is launched to help the Web work for everyone – users, developers and businesses
· Updates to the Bing Maps Apps for Windows 8.1 includes new features and cities
· App of the Week: Get in on the web-slinging action in “The Amazing Spider-Man 2” for Windows Phone

Suzanne Choney
Microsoft News Center Staff