What question did this study set out to answer?

To develop and evaluate a vectorized parallel-computing framework that optimizes memory usage and accelerates data extraction from large, high-bandwidth nanopore experiments.

November 26, 2023Open Access

A Robust Parallel Computing Data Extraction Framework for Nanopore Experiments

View Full Paper

Ask AI

Bookmark

Authors

YBY. M. Nuwan D. Y. Bandara SDShankar Dutt BKBuddini I. Karawdeniya

Discussion

Member takes

Overview

Computational study demonstrates accelerated data processing and event condensation for nanopore experiments, highlighting scalable workflows for high-bandwidth datasets.

Key Points

To develop and evaluate a vectorized parallel-computing framework that optimizes memory usage and accelerates data extraction from large, high-bandwidth nanopore experiments.
Engineered an open-seek-read-close data architecture across multiple processor cores, incorporating vectorization, batch-analysis capability, and multi-level waveform fitting.
Benchmarked execution speeds against five existing nanopore analysis platforms using long-duration (100-minute, ~4.5 GB) and high-frequency (200 kHz, 16 GB) ionic current datasets.
Delivered an ~18-fold data-loading speedup over traditional single-array methods and outperformed five benchmarked analysis tools by 6-fold to 1,120-fold.
Enabled concurrent multi-file batch processing and compressed extracted event files by 343-fold (reducing a 16 GB file with 28,182 events to 47.9 MB).

Cite This Study

Bandara et al. (2023) studied this question.

synapsesocial.com/papers/6a87fbb43fe66a1452bbf15c https://doi.org/10.26434/chemrxiv-2023-qcdp2

View Full Paper

Ask AI

Bookmark

November 26, 2023Open Access

A Robust Parallel Computing Data Extraction Framework for Nanopore Experiments

View Full Paper

Ask AI

Bookmark

Authors

YBY. M. Nuwan D. Y. Bandara SDShankar Dutt BKBuddini I. Karawdeniya

Discussion

Member takes

Overview

Computational study demonstrates accelerated data processing and event condensation for nanopore experiments, highlighting scalable workflows for high-bandwidth datasets.

Key Points

To develop and evaluate a vectorized parallel-computing framework that optimizes memory usage and accelerates data extraction from large, high-bandwidth nanopore experiments.
Engineered an open-seek-read-close data architecture across multiple processor cores, incorporating vectorization, batch-analysis capability, and multi-level waveform fitting.
Benchmarked execution speeds against five existing nanopore analysis platforms using long-duration (100-minute, ~4.5 GB) and high-frequency (200 kHz, 16 GB) ionic current datasets.
Delivered an ~18-fold data-loading speedup over traditional single-array methods and outperformed five benchmarked analysis tools by 6-fold to 1,120-fold.
Enabled concurrent multi-file batch processing and compressed extracted event files by 343-fold (reducing a 16 GB file with 28,182 events to 47.9 MB).

Cite This Study

Bandara et al. (2023) studied this question.

synapsesocial.com/papers/6a87fbb43fe66a1452bbf15c https://doi.org/10.26434/chemrxiv-2023-qcdp2

Also Consider

Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context:

View Full Paper

Ask AI

Bookmark