Warwick Data Store: A Data Structure Abstraction Library

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Authors

  • Richard O. Kirk
  • Martin Nolten
  • Robert Kevis
  • Timothy R. Law
  • Satheesh Maheswaran
  • Steven A. Wright
  • Seimon Powell
  • Gihan R. Mudalige

Colleges, School and Institutes

External organisations

  • University of Warwick
  • AWE
  • University of York

Abstract

With the increasing complexity of memory architectures and scientific applications, developing data structures that are performant, portable, scalable, and support developer productivity, is a challenging task. In this paper, we present Warwick Data Store (WDS), a lightweight and extensible C++ template library designed to manage these complexities and allow rapid prototyping. WDS is designed to abstract details of the underlying data structures away from the user, thus easing application development and optimisation. We show that using WDS does not significantly impact achieved performance across a variety of different scientific benchmarks and proxy-applications, compilers, and different architectures. The overheads are largely below 30% for smaller problems, with the overhead deceasing to below 10% when using larger problems. This shows that the library does not significantly impact the performance, while providing additional functionality to data structures, and the ability to optimise data structures without changing the application code.

Bibliographic note

Funding Information: This work was supported by the UK Atomic Weapons Establishment under grant CDK0724 (AWE TechnicalOutreach Programme). Prof. Stephen Jarvis is an AWE William Penney Fellow. This work would not have been possible without the assistance of a number of members of the Applied Computer Science team at AWE, to whom we would like to express our gratitude. Funding Information: Isambard is a UK National Tier-2 HPC Service based at the University of Bristol, operated by GW4 and the UK Met Office, and funded by EPSRC. Funding Information: CLX-AP is an Intel development system managed and funded by Intel UK. We are grateful for the support of Dr. Andrew Mallinson at Intel for his comments and guidance. Publisher Copyright: © 2020 IEEE.

Details

Original languageEnglish
Title of host publicationProceedings of PMBS 2020
Subtitle of host publicationPerformance Modeling, Benchmarking and Simulation of High Performance Computer Systems, Held in conjunction with SC 2020: The International Conference for High Performance Computing, Networking, Storage and Analysis
Publication statusPublished - Nov 2020
Event2020 IEEE/ACM Performance Modeling, Benchmarking and Simulation of High Performance Computer Systems, PMBS 2020 - Virtual, Atlanta, United States
Duration: 12 Nov 2020 → …

Publication series

NameProceedings of PMBS 2020: Performance Modeling, Benchmarking and Simulation of High Performance Computer Systems, Held in conjunction with SC 2020: The International Conference for High Performance Computing, Networking, Storage and Analysis

Conference

Conference2020 IEEE/ACM Performance Modeling, Benchmarking and Simulation of High Performance Computer Systems, PMBS 2020
Country/TerritoryUnited States
CityVirtual, Atlanta
Period12/11/20 → …

Keywords

  • Data Structures, High Performance Computing, Mini-Applications