All Stories

  1. AIIO: Using Artificial Intelligence for Job-Level and Automatic I/O Performance Bottleneck Diagnosis

    Article • August 2023, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  2. I/O Access Patterns in HPC Applications: A 360-Degree Survey

    Article • ACM Computing Surveys, July 2023, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  3. Real-time and post-hoc compression for data from Distributed Acoustic Sensing

    Article • Computers & Geosciences, September 2022, Elsevier

    Dr. Suren Byna

  4. Understanding Parallel I/O Performance and Tuning

    Article • June 2022, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  5. PROV-IO

    Article • June 2022, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  6. Access Patterns and Performance Behaviors of Multi-layer Supercomputer I/O Subsystems under Production Load

    Article • June 2022, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  7. LBNL Superfacility Project Report

    Article • June 2022, Office of Scientific and Technical Information (OSTI)

    Dr. Suren Byna

  8. Transparent Asynchronous Parallel I/O Using Background Threads

    Article • IEEE Transactions on Parallel and Distributed Systems, April 2022, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  9. Management and Storage of Scientific Data

    Article • January 2022, Office of Scientific and Technical Information (OSTI)

    Dr. Suren Byna

  10. Position Papers for the ASCR Workshop on the Management and Storage of Scientific Data

    Article • January 2022, Office of Scientific and Technical Information (OSTI)

    Dr. Suren Byna

  11. Optimizing Performance of Parallel I/O Accesses to Non-contiguous Blocks in Multiple Array Variables

    Article • December 2021, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  12. Tuning Parallel Data Compression and I/O for Large-scale Earthquake Simulation

    Article • December 2021, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  13. An In-Depth I/O Pattern Analysis in HPC Systems

    Article • December 2021, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  14. Exploiting user activeness for data retention in HPC systems

    Article • November 2021, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  15. Data-Aware Storage Tiering for Deep Learning

    Article • November 2021, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  16. I/O Bottleneck Detection and Tuning: Connecting the Dots using Interactive Log Analysis

    Article • November 2021, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  17. SCTuner: An Autotuner Addressing Dynamic I/O Needs on Supercomputer I/O Subsystems

    Article • November 2021, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  18. Characterizing Impacts of Storage Faults on HPC Applications: A Methodology and Insights

    Article • September 2021, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  19. Battle of the Defaults: Extracting Performance Characteristics of HDF5 under Production Load

    Article • May 2021, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  20. FasTensor Programming Model

    Article • January 2021, Springer Science + Business Media

    Dr. Suren Byna

  21. FasTensor User Interface

    Article • January 2021, Springer Science + Business Media

    Dr. Suren Byna

  22. FasTensor in Real Scientific Applications

    Article • January 2021, Springer Science + Business Media

    Dr. Suren Byna

  23. Introduction

    Article • January 2021, Springer Science + Business Media

    Dr. Suren Byna

  24. User-Defined Tensor Data Analysis

    Article • January 2021, Springer Science + Business Media

    Dr. Suren Byna

  25. GPU Direct I/O with HDF5

    Article • November 2020, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  26. Cross-facility science with the Superfacility Project at LBNL

    Article • November 2020, Institute of Electrical & Electronics Engineers (IEEE)

    Alex Sim, Dr. Suren Byna

  27. Towards HPC I/O Performance Prediction through Large-scale Log Analysis

    Article • June 2020, ACM (Association for Computing Machinery)

    Alex Sim, Dr. Suren Byna

  28. HPC Workload Characterization Using Feature Selection and Clustering

    Article • June 2020, ACM (Association for Computing Machinery)

    Alex Sim, Dr. Suren Byna

  29. Predicting and Comparing the Performance of Array Management Libraries

    Article • May 2020, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  30. Parallel Query Service for Object-centric Data Management Systems

    Article • May 2020, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  31. DASSA: Parallel DAS Data Storage and Analysis for Subsurface Event Detection

    Article • May 2020, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  32. Interfacing HDF5 with a scalable object‐centric storage system on hierarchical storage

    Article • Concurrency and Computation Practice and Experience, March 2020, Wiley

    Dr. Suren Byna

  33. ExaHDF5: Delivering Efficient Parallel I/O on Exascale Computing Systems

    Article • Journal of Computer Science and Technology, January 2020, Springer Science + Business Media

    Dr. Suren Byna

  34. Final Technical Report - Proactive Data Containers for Scientific Storage

    Article • December 2019, Office of Scientific and Technical Information (OSTI)

    Dr. Suren Byna

  35. Tuning Object-Centric Data Management Systems for Large Scale Scientific Applications

    Article • December 2019, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  36. Exploring Metadata Search Essentials for Scientific Data Management

    Article • December 2019, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  37. Analysis in the Data Path of an Object-Centric Data Management System

    Article • December 2019, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  38. MIQS

    Article • November 2019, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  39. Revisiting I/O behavior in large-scale storage systems

    Article • November 2019, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  40. Sparse Data Management in HDF5

    Article • November 2019, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  41. Understanding Data Motion in the Modern HPC Data Center

    Article • November 2019, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  42. Enabling Transparent Asynchronous I/O using Background Threads

    Article • November 2019, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  43. Active Learning-based Automatic Tuning and Prediction of Parallel I/O Performance

    Article • November 2019, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  44. Terabyte-scale Particle Data Analysis

    Article • July 2019, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  45. DCA-IO: A Dynamic I/O Control Scheme for Parallel and Distributed File Systems

    Article • May 2019, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna, Alex Sim

  46. A Zoom-in Analysis of I/O Logs to Detect Root Causes of I/O Performance Bottlenecks

    Article • May 2019, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  47. Optimizing I/O Performance of HPC Applications with Autotuning

    Article • ACM Transactions on Parallel Computing, March 2019, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  48. Parallel membership queries on very large scientific data sets using bitmap indexes

    Article • Concurrency and Computation Practice and Experience, January 2019, Wiley

    Dr. Suren Byna

  49. SLOPE: Structural Locality-Aware Programming Model for Composing Array Data Analysis

    Article • January 2019, Springer Science + Business Media

    Dr. Suren Byna

  50. Extreme Heterogeneity 2018 - Productive Computational Science in the Era of Extreme Heterogeneity: Report for DOE ASCR Workshop on Extreme Heterogeneity

    Article • December 2018, Office of Scientific and Technical Information (OSTI)

    Dr. Suren Byna

  51. ARCHIE: Data Analysis Acceleration with Array Caching in Hierarchical Storage

    Article • December 2018, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  52. A Year in the Life of a Parallel File System

    Article • November 2018, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  53. DART

    Article • November 2018, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  54. Evaluation of HPC Application I/O on Object Storage Systems

    Article • November 2018, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  55. UniviStor: Integrated Hierarchical and Distributed Storage for HPC

    Article • September 2018, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  56. IOMiner: Large-Scale Analytics Framework for Gaining Knowledge from I/O Logs

    Article • September 2018, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  57. A Transparent Server-Managed Object Storage System for HPC

    Article • September 2018, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  58. Toward Scalable and Asynchronous Object-Centric Data Management for HPC

    Article • May 2018, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  59. ArrayBridge: Interweaving Declarative Array Processing in SciDB with Imperative HDF5-Based Programs

    Article • April 2018, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  60. Toward Transparent Data Management in Multi-Layer Storage Hierarchy of HPC Systems

    Article • April 2018, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  61. SoMeta: Scalable Object-Centric Metadata Management for High Performance Computing

    Article • September 2017, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  62. ArrayUDF

    Article • June 2017, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  63. UMAMI

    Article • January 2017, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  64. Data Elevator: Low-Contention Data Movement in Hierarchical Storage System

    Article • December 2016, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  65. Exploring memory hierarchy and network topology for runtime AMR data sharing across scientific applications

    Article • December 2016, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  66. In Situ Storage Layout Optimization for AMR Spatio-temporal Read Accesses

    Article • August 2016, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  67. Resolution dependence of precipitation statistical fidelity in hindcast simulations

    Article • Journal of Advances in Modeling Earth Systems, June 2016, American Geophysical Union (AGU)

    Dr. Suren Byna

  68. SDS-Sort

    Article • May 2016, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  69. AMRZone: A Runtime AMR Data Sharing Framework for Scientific Applications

    Article • May 2016, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  70. PANDA: Extreme Scale Parallel K-Nearest Neighbor on Distributed Architectures

    Article • May 2016, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  71. Usage Pattern-Driven Dynamic Data Layout Reorganization

    Article • May 2016, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  72. Characterization of extreme precipitation within atmospheric river events over California

    Article • Advances in Statistical Climatology Meteorology and Oceanography, November 2015, Copernicus GmbH

    Dr. Suren Byna

  73. BD-CATS

    Article • November 2015, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  74. Security for the scientific data services framework

    Article • October 2015, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  75. Spatially clustered join on heterogeneous scientific data sets

    Article • October 2015, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  76. Collective Computing for Scientific Big Data Analysis

    Article • September 2015, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  77. Dynamic Model-Driven Parallel I/O Performance Tuning

    Article • September 2015, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  78. A study of file system read and write behavior on supercomputers

    Article • June 2015, ACM (Association for Computing Machinery)

    William Gropp, Dr. Suren Byna

  79. Parallel In Situ Detection of Connected Components in Adaptive Mesh Refinement Data

    Article • May 2015, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  80. TECA: Petascale Pattern Recognition for Climate Science

    Article • January 2015, Springer Science + Business Media

    Dr. Suren Byna

  81. Pattern-driven parallel I/O tuning

    Article • January 2015, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  82. Heavy-tailed distribution of parallel I/O system response time

    Article • January 2015, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  83. Managing scientific data with named data networking

    Article • January 2015, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  84. Techniques for modeling large-scale HPC I/O workloads

    Article • January 2015, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  85. A multi-domain SDN for dynamic layer-2 path service

    Article • January 2015, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  86. Simplifying index file structure to improve I/O performance of parallel indexing

    Article • December 2014, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  87. Towards Energy Awareness in Hadoop

    Article • November 2014, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  88. NDM'14 Chairs' Welcome

    Article • November 2014, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  89. Adaptation and Policy-Based Resource Allocation for Efficient Bulk Data Transfers in High Performance Computing Environments

    Article • November 2014, Institute of Electrical & Electronics Engineers (IEEE)

    Alex Sim, Dr. Suren Byna

  90. Analysis of the Effect of Core Affinity on High-Throughput Flows

    Article • November 2014, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  91. Flexible Scheduling and Control of Bandwidth and In-transit Services for End-to-End Application Workflows

    Article • November 2014, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  92. Towards Managed Terabit/s Scientific Data Flows

    Article • November 2014, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  93. Parallel query evaluation as a Scientific Data Service

    Article • September 2014, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  94. Parallel data analysis directly on scientific file formats

    Article • June 2014, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  95. Model-Driven Data Layout Selection for Improving Read Performance

    Article • May 2014, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  96. Improving parallel I/O autotuning with performance modeling

    Article • January 2014, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  97. SDS

    Article • November 2013, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  98. Taming parallel I/O complexity with auto-tuning

    Article • November 2013, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  99. Segmented analysis for reducing data movement

    Article • October 2013, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  100. Expediting scientific data analysis with reorganization of data

    Article • September 2013, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  101. Optimizing fastquery performance on lustre file system

    Article • July 2013, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  102. A framework for auto-tuning HDF5 applications

    Article • June 2013, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  103. Why high performance visual data analytics is both relevant and difficult

    Article • February 2013, SPIE

    Dr. Suren Byna

  104. Characterizing the impact of end-system affinities on the end-to-end performance of high-speed flows

    Article • January 2013, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  105. Abstract: Auto-Tuning of Parallel IO Parameters for HDF5 Applications

    Article • November 2012, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  106. NDM 2012: Second International Workshop on Network-Aware Data Management

    Article • November 2012, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  107. Parallel I/O, analysis, and visualization of a trillion particle simulation

    Article • November 2012, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  108. Boosting Application-Specific Parallel I/O Optimization Using IOSIG

    Article • May 2012, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  109. TECA: A Parallel Toolkit for Extreme Climate Analysis

    Article • Procedia Computer Science, January 2012, Elsevier

    Dr. Suren Byna

  110. Energy-Aware Workload Consolidation on GPU

    Article • September 2011, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  111. Special issue on Data Intensive Computing

    Article • Journal of Parallel and Distributed Computing, February 2011, Elsevier

    Dr. Suren Byna

  112. Detecting atmospheric rivers in large climate datasets

    Article • January 2011, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  113. Open problems in network-aware data management in exa-scale computing and terabit networking era

    Article • January 2011, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  114. Scientific data services

    Article • January 2011, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  115. Best-effort semantic document search on GPUs

    Article • January 2010, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  116. Data-aware scheduling of legacy kernels on heterogeneous platforms with distributed memory

    Article • January 2010, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  117. Exploiting the forgiving nature of applications for scalable parallel execution

    Article • January 2010, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  118. Special Issue of the Journal of Parallel and Distributed Computing: Data-Intensive Computing

    Article • Journal of Parallel and Distributed Computing, November 2009, Elsevier

    Dr. Suren Byna

  119. Core-aware memory access scheduling schemes

    Article • May 2009, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  120. Taxonomy of Data Prefetching for Multicore Processors

    Article • Journal of Computer Science and Technology, May 2009, Springer Science + Business Media

    Dr. Suren Byna

  121. Modeling Data Access Contention in Multicore Architectures

    Article • January 2009, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  122. Hiding I/O latency with pre-execution prefetching for parallel applications

    Article • November 2008, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna, William Gropp

  123. Parallel I/O prefetching using MPI file caching and I/O signatures

    Article • November 2008, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna, William Gropp

  124. Exploring Parallel I/O Concurrency with Speculative Prefetching

    Article • September 2008, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna, William Gropp

  125. A Taxonomy of Data Prefetching Mechanisms

    Article • May 2008, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  126. Server-Based Data Push Architecture for Multi-Processor Environments

    Article • Journal of Computer Science and Technology, September 2007, Springer Science + Business Media

    Dr. Suren Byna

  127. Improving Data Access Performance with Server Push Architecture

    Article • January 2007, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  128. Data access history cache and associated data prefetching mechanisms

    Article • January 2007, ACM (Association for Computing Machinery)

    Dr. Suren Byna

  129. Memory Servers: A Scope of SOA for High-End Computing

    Article • September 2006, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna

  130. Automatic Memory Optimizations for Improving MPI Derived Datatype Performance

    Article • January 2006, Springer Science + Business Media

    Dr. Suren Byna, William Gropp

  131. ISOLATING COSTS IN SHARED MEMORY COMMUNICATION BUFFERING

    Article • Parallel Processing Letters, December 2005, World Scientific Pub Co Pte Lt

    Dr. Suren Byna

  132. Quantification of Memory Communication

    Article • January 2004, Springer Science + Business Media

    Dr. Suren Byna

  133. Improving the performance of MPI derived datatypes by optimizing memory-access cost

    Article • January 2003, Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna, William Gropp

  134. Predicting memory-access cost based on data-access patterns

    Article • Institute of Electrical & Electronics Engineers (IEEE)

    Dr. Suren Byna, William Gropp