Light-weight parallel I/O analysis at scale

Steven A. Wright*, Simon D. Hammond, Simon J. Pennycook, Stephen A. Jarvis

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

Input/output (I/O) operations can represent a significant proportion of the run-time when large scientific applications are run in parallel. Although there have been advances in the form of file-format libraries, file system design and I/O hardware, a growing divergence exists between the performance of parallel file systems and compute processing rates. In this paper we utilise RIOT, an input/output tracing toolkit being developed at the University of Warwick, to assess the performance of three standard industry I/O benchmarks and mini-applications. We present a case study demonstrating the tracing and analysis capabilities of RIOT at scale, using MPI-IO, Parallel HDF-5 and MPI-IO augmented with the Parallel Log-structured File System (PLFS) middle-ware being developed by the Los Alamos National Laboratory.

Original languageEnglish
Title of host publicationComputer Performance Engineering - 8th European Performance Engineering Workshop, EPEW 2011, Proceedings
Pages235-249
Number of pages15
DOIs
Publication statusPublished - 2011
Event8th European Performance Engineering Workshop, EPEW 2011 - Borrowdale, United Kingdom
Duration: 12 Oct 201113 Oct 2011

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume6977 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference8th European Performance Engineering Workshop, EPEW 2011
Country/TerritoryUnited Kingdom
CityBorrowdale
Period12/10/1113/10/11

Keywords

  • Input/Output
  • Message Passing Interface
  • Parallel I/O
  • Parallel Log-structured File System
  • Profiling

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint

Dive into the research topics of 'Light-weight parallel I/O analysis at scale'. Together they form a unique fingerprint.

Cite this