Computing Resources Monitoring and Task Scheduling Design for Targeting a Massive Patent Data Fusion Cluster

With the maturity of cloud computing and distributed computing theory, the fusion of massive patent data increasingly relies on distributed clusters to efficiently process data. A simple system monitoring and data processing system is difficult to effectively improve the stability and resource utilization efficiency of the entire cluster. This article combines the monitoring subsystem and data processing subsystem to design a task scheduling capability with negative feedback regulation for the entire cluster, which can significantly reduce the probability of system crashes caused by resource depletion, improve the efficiency of computing resource utilization, and reduce operation and maintenance costs.