Synapse
⌘+K
Synapse
PulseExploreClubsResearchersJournals
Instagram
HomeClubsExplore
August 8, 2024Open Access

IMI: In-memory Multi-job Inference Acceleration for Large Language Models

View Full Paper
Ask AI
Bookmark
Share

Authors

BGBin GaoNational University of SingaporeZWZhehui WangAgency for Science, Technology and ResearchZHZhuomin HeLiaoning University of Technology

Discussion

Loading...

Member takes

Implication

Key Points

Key points are not available for this paper at this time.

Cite This Study

Gao et al. (2024) studied this question.

synapsesocial.com/papers/68e5d110b6db643587566f77https://doi.org/10.1145/3673038.3673053
View Full Paper
Ask AI
Bookmark
Share

Also Consider

Synapse has enriched 4 closely related papers on similar clinical questions. Consider them for comparative context:

  1. 1Efficient Memory Management for Large Language Model Serving with PagedAttention2023 · 1,624 citations
  2. 2Hybrid Memory Buffer Microarchitecture for High-Radix Routers2021 · 4 citations
  3. 3A Survey of Techniques for Modeling and Improving Reliability of Computing Systems2015 · 80 citations
  4. 4Transformer in Transformer2021 · 1,021 citations