Blog Archives

Ed Note

A Trillion Triangles and a Few Multicore Processors

Solving an old mathematic problem seems a lot like picking at a scab. But then I'm not a mathematician. Still, it's hard not to be impressed when mathematicians solve a problem that's stumped other mathematicians for hundreds of years.

One Man's Parallelism is Another Man's Breakfast

The product was absolutely cool and the breakfast spread impressive but I still felt snookered.

Supercomputer Debugging: More Than Just Breakpoints

There's no question you could set a boatload of breakpoints with a 20-petaflop supercomputer, but you probably need more than that when developing parallelized software for it. You might also resort to fast conditional watchpoints, compiled expressions, asynchronous thread control, and full post-mortem debugging capabilities, and that's just for starters.

Defining Cloud Computing

If you've been trying figure out what "cloud computing" is, you're not alone -- and coming to the rescue is the National Institute of Standards and Technology. But as nice as the NIST folks are, they didn't have you in mind when they decided to put together an understandable definition of cloud computing.

Data Center Power Consumption Can Be a FAWNy Business

I'm a sucker for a good pun. (Of course, some would say that there's no such thing as a "good" pun.) So when I came across a paper entitled FAWNdamentally Power-efficient Clusters, I had to read it. And you know what? Not only did I enjoy reading the paper, I actually learned a thing or two about a very important topic.

Intel's Parallel (Near Term) Roadmap

In wrapping up this year's Intel Software Conference, James Reinders shared a sneak peek of what software developers can look forward to seeing from the company over the coming months, at least in terms of parallel programming tools.

Nehalem Benchmarks Make For Happy HPC

It's little surprise that attendees at this week's Intel HPC Summit in Salzburg, Austria, were more interested in benchmarks than your average group of developers. After all, benchmarking is all about the numbers, and HPC developers tend to be uber-number crunchers.

Accelerating Critical Sections

"Critical sections" are parts of the software for multicore architectures in which only one thread can execute at a given time, causing other threads needing access to shared data to wait for the current thread to complete the critical section.


Larrabee's New Instructions In C++: A Prototype

So you've read the article and watched the video, and you're chomping at the bit to start playing around with Larrabee, Intel's multicore architecture that boasts many cores, many threads, and a new vector instruction set -- all in the name of pushing performance. You have everything you need except -- a Larrabee.

OpenMP vs. OpenMP

If you're a fan of Seinfeld's Cosmo Kramer, you know there's no better way to start the day than with a good old-fashioned catfight. I don't know that if it rises to that level, but I do think that the OpenMP back-and-forth between Charles Leiserson, coauthor of Introduction to Algorithms and cofounder of Cilk Arts, and Ruud van der Pas, a senior staff engineer at Sun and coauthor of Using OpenMP, makes for some fascinating reading.

So How Are We Doin', One Programmer Asks Another

"So how are we doing?" James Reinders rhetorically asked a roomful of programmers at SD West 2009 when referring to his Eight Rules for Parallel Programming for Multicore.

Multicore and Power Consumption: Ask James About It

Power naps. Now there's something I can relate to. No, not because I get a few minutes of shut-eye in the middle of the afternoon, but because I was just reading about this topic in The Problem of Power Consumption in Servers. The problem, of course, is that data centers are energy hogs, costing money and squander resources.

When Seeing Is Believing

So you aren't ready to buy into this multicore and parallelization stuff until you're able to see its benefits with your own eyes? If that's the case, then take a couple of minutes to watch this pair of YouTube videos that Gaston Hillar has prepared as part of his book C# 2008 and 2005 Threaded Programming: Beginner's Guide.

Security Reminder, or Who's That Looking Over Your Shoulder?

It doesn't matter which coffee shop -- Henry's, Z's, or the Bourgeois Pig -- I end up at, it's always the same ever since free WiFi came on the scene. There are more laptops than coffee mugs, and never enough places to sit. But I'm as bad as the rest. What with free wireless Internet access and a cell phone, well, I haven't been in the office for year or so now, and even the concept of a home-office is becoming more remote.

Larrabee: Gamer or Game Changer?

Wouldn't you know it. Just as we're starting to wrap our minds around the idea of parallel programming and multicore processors, Intel ups the ante with Larrabee, a many-core architecture that has the potential to change the game. This doesn't mean that the concepts of multithreading and parallel programming can be ignored. Quite the contrary. If anything, thinking parallel and having a firm grasp on multithreading will be more critical than ever -- especially if you intend on tackling Larrabee.

Cloud Computing, Coming Down the Stretch?

Just because the term "cloud computing" has been ridden hard and put away wet doesn't mean there isn't any "there" there. Hype aside, cloud computing appears to be for real. The promise that cloud computing offers developers with great ideas but little cash execute those ideas is reason enough to hop on the bandwagon.

Multicore Workshop: Who Said the Free Lunch Is Over?

Every now and then one of those don't-miss workshops pops up. Alas, I usually don't make it to them because the boss and I have a different definition of what "don't miss" means. But we see eye-to-eye on the upcoming Workshop on Directions in Multicore Programming Education to be held on March 8, 2009, in Washington DC. When I told him about it, the boss said "Sounds great. What time does your bus leave?" Hmmm, California to DC on a Greyhound bus for an 8-hour workshop? Darn, sounds like another great event I'll miss. But that doesn't mean you have to miss it, particularly if you're in the neighborhood.

An Upside to a Down Economy?

There's not much good that we can say when it comes to the economy. Still, there are those among us who see the bottle half full, rather than half empty.

Herb Sutter Isn't Missing; He's On His Way to Sweden

Now I know why Dr. Dobb's columnist and concurrency expert Herb Sutter hasn't turned in his column -- he's been preparing for his upcoming Effective Concurrency seminar on March 16-18, 2009 in Stockholm, Sweden.

PetraVM and DMP

The goal of PetraVM, a startup launched by University of Washington computer science professors Mark Oskin and Luis Ceze, is to develop technology for writing more reliable multi-threaded code for multi-core architectures.

A Few Minutes with James Reinders

James Reinders, author of Intel Threading Building Blocks: Outfitting C++ for Multi-core Processors, recently took a few minutes to talk about going parallel.

Q: James, are software developers ready for parallelization, or are we lacking the fundamental building blocks -- parallel algorithms, compilers, tools, and the like -- needed to effectively build concurrent applications?

How About 'iGramps' Instead?

You can always tell when the developers roll out something before marketing has a crack at "preparing" it. And that ususally starts with the name of the product or the title of the paper. Take, for instance, the programming model for graphics pipelines created and described a team of researchers from Stanford University and Microsoft Research.

Multi-core in 3-D, or is it 3-D in Multi-core?

I don't know about you, but I'm stoked about the Super Bowl. No, I haven't stocked up on chips, queso dip, and beer. Heck, I'm not even much of a pro football fan. But with the news that Dreamworks Animation, Intel, Pepsi, and NBC are planning a big 3-D movie promotion around the Super Bowl, I didn't waste any time dusting off the 3-D glasses that Intel and Dreamworks Animation handed out at the Intel Developer's Forum last August.

Parallel Programming and Computer Science 101

It's been said more than once that parallel programming is hard, which suggests that the sooner you get a jump on concurrency, the better off you'll be. So when and how should programmers be introduced to parallalism?

Parallel@Illinois

The goal of the Universal Parallel Computing Research Center at the University of Illinois at Urbana-Champaign (UPCRC) is to make client parallel programming synonymous with programming. To that end, their key themes are a transformative change from current low-level bug-prone programming models to a disciplined parallel programming ecosystem, and a broad-based attack on parallelism at all levels of the stack that focuses on enabling performance, scalability, and support for programmability. For a complete and most interesting discussion of how UPCRC tackles parallel programming, see Parallel@Illinois: Pioneering and Promoting Parallel Computing.

Calendar

November 2009
October 2009
September 2009
August 2009
July 2009
June 2009
May 2009
April 2009
March 2009
February 2009
January 2009
December 2008

Real World Parallelism Webinar Series
  • November 17, 2009
    Visual Effects for Animation - presented by DreamWorks Animation
    Speaker: Ron Henderson (Bio)

    Ron Henderson manages the FX Tools group at DreamWorks Animation, where he is responsible for developing physical simulation and procedural modeling tools. These systems have been used for key visual effects in recent films such as Kung Fu Panda and Monsters vs. Aliens (March 2009).

    Prior to joining DreamWorks in 2002 he was a senior scientist at Caltech with a joint appointment to the Applied Math and Aeronautics departments, where he worked on efficient techniques for the direct numerical simulation of fluid turbulence.

    Abstract:
    In this webinar, Ron Henderson will show examples of visual effects, from hair and feathers to smoke and fire, from a variety of DreamWorks Animation feature films. He will discuss in general terms the kinds of techniques used to achieve particular visual effects. Finally, Henderson will show a detailed breakdown of the dam-breaking scene from Madagascar: Escape 2 Africa, demonstrating how different elements of key frame animation, simulation, and rendering are combined in a real production shot.

  • December 1, 2009
    A Quick and Easy Way to Parallelize a Legacy Codebase with Intel® Threading Building Blocks (TBBs)
    Speaker: Bernard Laberge, Avid, Senior Principal Engineer (Bio)

    Bernard Laberge is a senior principal engineer in the video editors division at Avid. During his seven years with the company he has been actively involved in the replacement of the legacy video processing engines used by Avid editors with a common hardware-abstracted, component-based video processing engine currently running on the CPU with SIMD optimized code, GPU, and dedicated hardware.

    Abstract:
    Learn how to overcome the limitations of a thread-based scheduler, including dealing with the absence of recursive parallelism support and the inefficient handling of unbalanced processing load. Bernard Laberge addresses how Avid resolved the expensive refactoring of their thread-based scheduler into a task-based solution by choosing Intel® Threading Building Blocks (TBBs). He explores how Avid was able to easily integrate the Intel TBBs into their video editor applications and more than 5 million lines of code.

  • December 15, 2009
    How to Use Intel® Parallel Studio to Streamline Code Development in a Multicore Environment
    Speaker: Matt Dunbar, Director for Performance Technology, SIMULIA (Bio)

    Matt Dunbar is the director for performance technology at SIMULIA. Since joining the company in 1993, he has worked on parallelization of the Abaqus suite of products, initially for shared memory architectures and more recently for distributed memory architectures. Dunbar has also been intimately involved in selecting both the hardware and software tools used in the development of the Abaqus product line.

    Abstract:
    Resolve elusive, costly multithreading errors quickly and efficiently with Intel® Parallel Studio. While many coding problems that lead to bugs in software applications are typically straightforward logic errors, errors in managing memory and in multithreading code can sometimes take weeks to months to diagnose and fix. Matt Dunbar explores how and why taking advantage of multicore processors through multithreaded code is critical for compute-intensive applications. While spotlighting his work on SIMULIA's Abaqus finite element solver, Dunbar addresses the need for multicore execution and shares his experiences using Intel Parallel Studio to streamline code development in a multicore environment.