PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
October 9, 2025EPJ Web of Conferences0 citationsOpen Access

Exploring Data Caching Policy with Data Access Patterns from dCache System

View Full Paper
JAJ. M. AldrichASAlex SimKWKesheng Wu

Key Points

  • The study shows significant reductions in predictive errors for dataset access patterns, enhancing cache efficiency.
  • Utilizing machine learning techniques, the model predicts access patterns and informs dataset pinning decisions effectively.
  • Integration of temporal trends and real-time access logs contributes to adaptive strategies for high-priority datasets.
  • Ongoing validation aims to optimize performance under realistic user workloads, crucial for large-scale data infrastructures.

Abstract

The dCache storage system at Brookhaven National Laboratory (BNL) serves as a critical cache for the ATLAS collaboration, enabling efficient access to petabytes of data located on tape, remote repositories, and cold storage. Effective cache management is vital to minimize access latency, particularly as operators have observed persistent high-demand datasets that warrant prolonged retention (“pinning”) in disk cache. This study evaluates machine learning (ML) techniques to automate dataset pinning decisions by predicting future access patterns. Our models, which integrate temporal trends and request-specific features, achieve predictive errors significantly below the inherent variability of dataset access patterns. We further explore dynamic updates to these predictions using real-time dCache access logs, enabling adaptive pinning strategies for high-priority datasets. Ongoing work focuses on validating system-wide performance gains under realistic user workloads, with the goal of optimizing resource utilization for large-scale scientific data infrastructures.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Aldrich et al. (2025) studied this question.

synapsesocial.com/papers/68e70db790569dd607ee6456https://doi.org/10.1051/epjconf/202533701340
Ask AI
Helpful
Bookmark
Share
View Full Paper

Also Consider

Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context:

  1. 1Understanding Data Access Patterns for dCache System2024 · 4 citations
  2. 2File Access Prediction Using Neural Networks2010 · 10 citations
  3. 3Learning a Hybrid Proactive and Reactive Caching Policy in Wireless Edge Under Dynamic Popularity2019 · 20 citations
  4. 4Optuna2019 · 8,235 citations
  5. 5A distributed storage system with dCache2008 · 32 citations