Stone Ridge, IBM and Nvidia Revolutionize Large-Scale Data Modeling

Datamation content and product recommendations are editorially independent. We may make money when you click on links to our partners. Learn More.

Data modeling and simulation create the foundation for tactics and strategies tied to difficult problems ranging from military action to health care. Stone Ridge recently announced the first billion-cell engineering data simulation completed entirely on GPUs. While this breakthrough focused on the petrochemical market and oil fields, the potential it represents for virtually every major industry is nothing short of world-shattering.

The previous world record for the problem that Stone Ridge and its partners solved was 20 hours, and it required a massive supercomputer. They accomplished the same feat with 30 IBM servers in just over an hour and a half. This is a massive jump in performance and an even more massive reduction in plant cost, power and complexity.

I spent some time talking to Stone Ridge last week, and I think these results represent what could be a massive disruption in the status quo for modeling and simulation.

GPU Computing

The Stone Ridge effort is one of the first big showcases for IBM’s Minsky high-performance computer (HPC), which has two Power8 CPUs and four Nvidia Tesla P100 GPUs. What makes this server unique is that it is the joint brainchild of IBM and Nvidia. It represented one of the most powerful and targeted efforts to change the way we compute, and it focused on the concept of cognitive computing, which both companies have embraced massively.

At the heart of these systems is NVLink which connects the CPU and GPU. IBM worked with Nvidia to optimize performance across this link, which resulted in far fewer bottlenecks and conflicts. The solution appears to have come from one company rather than two, and it is here that you find the strongest system advantage.

This very unique system has a near clean-slate design focused very tightly on the kinds of problems standing in the way of thinking computers. To deal with problems with an increasingly human-like competency, you first have to convert those problems, which are often defined with massive amounts of visual data, into some kind of data model. it And these new servers are absolutely outstanding in how they can model and analyze data.

Stone Ridge Echelon

Stone Ridge’s Echelon is a high-performance petroleum reservoir simulator. Large oil companies use it to analyze an oil field and plan how to extract the oil most cost effectively. With oil prices falling, the need to contain costs while increasing yields from these oil fields has never been higher. Data input for the test was from 1,000 wells in a Middle East carbonate oil field, and the simulation used 1.01 billion cells.

Before Stone Ridge could get this phenomenal performance, it did have to modify Echelon to favor GPU-based analysis and to utilize the NVLink fully. What I think is particularly interesting is that much of the performance advantage actually came from memory bandwidth, which shouldn’t be surprising given the massive amount of data being analyzed. Apparently Nvidia’s P100 has nine times the memory bandwidth of Intel’s current Xeon. The difference in the solution architecture also appears to contribute to the advantage with the Minsky systems because of a massive reduction in system complexity. Solving this kind of a problem on a similar Intel system requires the problem be divided into 360 domains, while on the Minsky using Power and a GPU it requires only four domains. According to the companies, one Minsky node using Echelon performs in line with 18 Xeon server nodes.

In the end, doing this kind of simulation on a supercomputer is simply unaffordable to most firms managing oil fields — particularly now with revenues and profits falling sharply. However, using the IBM- and Nvidia-based Minsky server approach, it was both viable and affordable, particularly when using Stone Ridge’s Echelon product.

The Future of Simulation

One of the big components of the coming wave of smart cognitive computers is simulation, increasingly at massive scale. It is this scale of simulation that will help future top executives, political leaders, generals, lawyers, doctors and scientists find the answers they need to advance their organizations’ agendas. It will also form the basis for future cognitive computers to provide the focused assistance to allow the most successful of these folks to scale to levels and scope we can’t now imagine.

This announcement showcases that we have advanced massively in our capability to model and analyze massive amounts of data. We can only hope these tools, as in this case, will be used for and not against us.

Photo courtesy of Shutterstock.