MTC Envelope: Defining the Capability of Large Scale Computers in the Context of Parallel Scripting Applications
|Title||MTC Envelope: Defining the Capability of Large Scale Computers in the Context of Parallel Scripting Applications|
|Publication Type||Conference Paper|
|Year of Publication||2013|
|Authors||Zhang, Z, Katz, DS, Wilde, M, Wozniak, JM, Foster, IT|
Many scientific applications can be efficiently expressed with the parallel scripting [many-task computing (MTC)] paradigm. These applications are typically composed of several stages of computation, with tasks in different stages coupled by a shared file system abstraction. However, we often see poor performance when running these applications on large-scale computers because of the applications frequency and volume of filesystem I/O and the absence of appropriate optimizations in the context of parallel scripting applications.