[email protected]

Big Data Challenge: Data Wrangling

One of the well-known difficulties for data analytics is data wrangling. Essentially, the process of “data wrangling”—sometimes lovingly referred to as janitor work—is transforming raw data into something that can actually be analyzed by algorithms and data scientists. When you have totally raw data it is very difficult to process, especially with natural language. Think […]

The NFL, HPC, and Big Data

On July 30th the NFL announced a partnership with Zebra Technologies with the mission to get more advanced, precise tickets for each player in a game, and to log this information in real-time. These advanced statistics will then be made available almost immediately for the purpose–at least for the 2014-2015 season–of enhancing the viewing experience. To […]

Big Paring – Data Center Journal

David Beer September 2, 2014 I think a lot about big data and the challenges it proposes. I guess I started thinking about big data a long time before I ever heard the term. I began to think about it when I heard and read one of the conclusions of the postmortem for the events […]

Women in Computer Science: My Mother’s Experience

In 1971, Congress designated today, August 26th, as National Women’s Equality Day to commemorate the passing of the 19th Amendment. The 19th Ammendment prohibited any United States citizen from being denied the right to vote based on gender; in other words, it gave women the right to vote. In honor of this day I wanted to […]

Lincoln Ascent: Communicating Between Moab and TORQUE

One of the major development projects for TORQUE 5.0 and Moab 8.0 was the Ascent project. We were extremely pleased with the progress made during this effort, so we’re continuing the effort into the next release (codename: Lincoln), and I’d like to take this chance to introduce it. The purpose of Ascent is to rapidly […]

Reviewing The Gauntlet – The Impact of New Standards Developing Code

Previously, I introduced The Gauntlet to you explaining some of our new standards for developing code. As we have now been through our first release using The Gauntlet it seems appropriate to review the changes and discuss how its affected our development. For those that haven’t read the prior piece, essentially we have started following […]

HPC and Summer Blockbusters

More and more, any summer blockbuster—probably any movie in general—owes a lot to High Performance Computing (HPC). As I watch more and more movies I notice how much more convincing CGI is becoming, and this is largely due to the amount of computational power used to render the films. We’ve seen several examples over the […]

OpenStack Summit – An Adaptive Computing Report

Adaptive Computing was on site at this year’s OpenStack Summit in Atlanta, Georgia. By the time this post arrives on Adaptive Computing’s blog, many will have read all the juicy details, but we wanted to point out a few items from this year’s summit that we believe are indicators to OpenStack’s permanent success. Number of Conference Attendees – […]

Kilby’s Net Effect on TORQUE

Overall, the Kilby release of TORQUE (TORQUE 5.0) should provide a faster, more stable TORQUE with some important new features. TORQUE should be more stable as we’ve expanded the breadth and depth of tests; it is significantly faster as a result of the work done for the Ascent Initiative; finally, several new features have been […]

How Adaptive Computing uses CCM in Moab and TORQUE

Previously, we discussed CCM as it relates to engineering in general; now, we’re going to discuss how we apply this to Moab and TORQUE. For specific code discussion I’m going to focus on TORQUE, but the policies and procedures I’m going to describe show how we identify issues and solve them for both. First, we […]