Optimal Algorithms for <formula formulatype="inline"> <tex Notation="TeX">L₁</tex></formula>-subspace Signal Processing

We describe ways to define and calculate L1-norm signal subspaces that are less sensitive to outlying data than L2-calculated subspaces. We start with the computation of the L1maximum-projection principal component of a data matrix containing N signal samples of dimension D. We show that while the general problem is formally NP-hard in asymptotically large N, D, the case of engineering interest of fixed dimension D and asymptotically large sample size N is not. In particular, for the case where the sample size is less than the fixed dimension , we present in explicit form an optimal algorithm of computational cost 2N. For the case N ≥ D, we present an optimal algorithm of complexity O(ND). We generalize to multiple L1-max-projection components and present an explicit optimal L1subspace calculation algorithm of complexity O(NDK-K+1) where K is the desired number of L1principal components (subspace rank). We conclude with illustrations of L1-subspace signal processing in the fields of data dimensionality reduction, direction-of-arrival estimation, and image conditioning/restoration.