PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
September 17, 2025Proceedings of the VLDB Endowment0 citations

Enter the Warp: Fast and Adaptive Data Transfer with XDBC

View Full Paper
HGHaralampos GavriilidisJZJoel ZieglerMVMidhun Kaippillil Venugopalan

Key Points

  • Data transfer performance improves significantly in heterogeneous environments with XDBC's modular architecture, and offers optimization capabilities.
  • Throughput metrics are monitored to enhance real-time feedback during data transfers, achieving better adaptability in various conditions.
  • XDBC facilitates seamless integration of components tailored to specific workloads, accommodating diverse data transfer requirements.
  • The interactive game fosters understanding of data transfer challenges, enhancing user engagement with the XDBC framework.

Abstract

Fast and scalable data transfer is crucial in today's decentralized data ecosystems and data-driven applications, including extraction-transformation-loading (ETL) pipelines, and data science workflows. Transfers often occur across heterogeneous environments—ranging from cloud-hosted systems to local consumer devices—with varying compute and network constraints. However, existing solutions struggle to balance performance with generality across such diverse setups. We recently proposed XDBC, a holistic data transfer framework that decomposes the pipeline into logical components with multiple physical implementations per component. Its modular architecture enables seamless system integration and automatic tuning based on workload and environment characteristics. In this demonstration, we present Enter the Warp, an interactive game built around XDBC that visualizes data transfer as a space mission. Players configure transfer parameters, monitor live throughput metrics, and optimize performance to shield Earth from meteor strikes, gaining an understanding and hands-on experience of data transfer challenges in an engaging and intuitive way.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Gavriilidis et al. (2025) studied this question.

synapsesocial.com/papers/68d45b2931b076d99fa5dac7https://doi.org/10.14778/3750601.3750660
Ask AI
Helpful
Bookmark
Share
View Full Paper