PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
January 1, 2015Proceedings of the Python in Science Conferences838 citationsOpen Access

Dask: Parallel Computation with Blocked algorithms and Task Scheduling

MRMatthew Rocklin

Key Points

Key points are not available for this paper at this time.

Abstract

Dask enables parallel and out-of-core computation. We couple blocked algorithms with dynamic and memory aware task scheduling to achieve a parallel and out-of-core NumPy clone. We show how this extends the effective scale of modern hardware to larger datasets and discuss how these ideas can be more broadly applied to other parallel collections.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Matthew Rocklin (2015) studied this question.

synapsesocial.com/papers/6a01c6a9897643a80dcb0a27https://doi.org/10.25080/majora-7b98e3ed-013
Ask AI
Helpful
Bookmark
Share
View Full Paper