PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
October 20, 20250 citationsOpen Access

Automatic Metadata Capture and Processing for High-Performance Workflows

View Full Paper
PSPolina ShpilkerLPLine Pouchard

Key Points

  • Collecting and reorganizing metadata significantly enhances workflow performance analysis for researchers, allowing better insights.
  • Experimenting with two formats for metadata storage enables uniformity, thus improving accessibility and usability of the data.
  • Utilizing the FAIR principles emphasizes the importance of reproducibility in research using heterogeneous computing architectures.
  • This software addresses the complexity in modern workflows, making performance data more manageable for researchers.

Abstract

Modern workflows run on increasingly heterogeneous computing architectures and with this heterogeneity comes additional complexity. We aim to apply the FAIR principles for research reproducibility by developing software to collect metadata annotations for workflows run on HPC systems. We experiment with two possible formats to uniformly store these metadata, and reorganize the collected metadata to be as easy to use as possible for researchers studying their workflow performance.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Shpilker et al. (2025) studied this question.

synapsesocial.com/papers/68f6379bb481a140a36cf7d8https://doi.org/10.48550/arxiv.2506.15537
Ask AI
Helpful
Bookmark
Share
View Full Paper