PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
February 19, 2026Software Practice and Experience0 citations

C‐Koordinator: Interference‐Aware Management for Large‐Scale and Co‐Located Microservice Clusters

View Full Paper
SSS. H. SongMXMinxian XuZZZuowei Zhang

Key Points

  • The aim is to design strategies for managing interference in large-scale, co-located microservice clusters to optimize resource utilization.
  • Analyzed characteristics of large-scale microservices clusters at Alibaba.
  • Utilized cycle per instruction (CPI) as a key metric for measuring interference.
  • Developed interference prediction models based on multi-dimensional metrics.
  • Presented the C-Koordinator platform that implements co-location and interference mitigation strategies.
  • Achieved over 90.3% accuracy in interference prediction models.
  • Reduced and stabilized application latency across all response time percentiles (P50, P90, P99).
  • Observed latency improvements ranging from 16.7% to 36.1% under various system loads.

Abstract

ABSTRACT Objective Microservices transform traditional monolithic applications into lightweight, loosely coupled application components and have been widely adopted in many enterprises. Cloud platform infrastructure providers enhance the resource utilization efficiency of microservices systems by co‐locating different microservices. However, this approach also introduces resource competition and interference among microservices. Designing interference‐aware strategies for large‐scale, co‐located microservice clusters is crucial for enhancing resource utilization and mitigating competition‐induced interference. These challenges are further exacerbated by unreliable metrics, application diversity, and node heterogeneity. Methods In this paper, we first analyze the characteristics of large‐scale and co‐located microservices clusters at Alibaba and further discuss why cycle per instruction (CPI) is adopted as a metric for interference measurement in large‐scale production clusters, as well as how to achieve accurate prediction of CPI through multi‐dimensional metrics. Based on CPI interference prediction and analysis, we also present the design of the C‐Koordinator platform, an open‐source solution utilized in Alibaba cluster, which incorporates co‐location and interference mitigation strategies. Results The interference prediction models consistently achieve over 90.3% accuracy, enabling precise prediction and rapid mitigation of interference in operational environments. As a result, application latency is reduced and stabilized across all percentiles (P50, P90, P99) response time (RT), achieving improvements ranging from 16.7% to 36.1% under various system loads compared with state‐of‐the‐art system. Conclusion These results demonstrate the system's ability to maintain smooth application performance in co‐located environments.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Song et al. (2026) studied this question.

synapsesocial.com/papers/6996a798ecb39a600b3ed722https://doi.org/10.1002/spe.70059
Ask AI
Helpful
Bookmark
Share
View Full Paper