Iteratively Reweighted Algorithm for Fuzzy c-Means

Fuzzy <tex-math notation="LaTeX">c</tex-math> -means method (FCM) is a popular clustering method, which uses alternating iteration algorithm to update membership matrix <tex-math notation="LaTeX">F</tex-math> and center matrix <tex-math notation="LaTeX">M</tex-math> of <tex-math notation="LaTeX">d × c</tex-math> size. However, original FCM suffers from finding a suboptimal local minimum, which limits the performance of FCM. In this article, we propose a new optimization method for fuzzy <tex-math notation="LaTeX">c</tex-math> -means problem. We first propose an equivalent minimization problem of FCM, then, a simple alternating iteration algorithm is proposed to solve the new minimization problem, which involves an effective and theoretically guaranteed Iteratively Reweighted (IRW) method, so we call the new optimization method IRW-FCM. Our IRW-FCM utilizes <tex-math notation="LaTeX">c</tex-math> not <tex-math notation="LaTeX">$dc$</tex-math> intermediate variables to update <tex-math notation="LaTeX">F</tex-math> , which can decrease space complexity. Extensive experiments including objective-function value comparison and clustering-performance comparison show that IRW-FCM can obtain better local minima than FCM with fewer iterations. And according to the time-complexity analysis, it is verified IRW-FCM has the same linear time complexity with FCM. What's more, compared with other clustering methods, IRW-FCM also shows its superiority.