Answers are grounded in this paper and cite their sources.
Evaluates functional differentiation in neural networks, indicating optimized complexity and organization.
In the context of Kolmogorov complexity, the complexity of an object can be characterized by the length of the shortest algorithm required to describe or compute it. In condensed matter systems under equilibrium and nonequilibrium conditions, macroscopic properties distinct from elementary ones can emerge from large numbers of particles. Such a large system size allows system properties to change as control parameters change, producing phase transitions. Inspired by this analogy, it is natural to consider that an optimized computing system may undergo a transition from an initially random organization to a functionally organized state. In this paper, by adopting a specific multi-task setting based on a typical dynamical system, we propose an evolutionary echo state network that realizes the functional differentiation of a random neural network into two subnetworks—one specialized for memory and the other for program execution. The model suggests a minimal neural mechanism for dynamic processes that extract rules embedded in input sequences and store information over short or long time scales. Because the proposed evolutionary model is driven by constraints that jointly reduce task errors and structural redundancy, the resulting network can be regarded as an optimized descriptor of memory and program functions. To clarify the relationship between the proposed model and algorithmic complexity, we introduce Lempel–Ziv-based complexity indices for both network structure and node-wise reservoir dynamics. Although neither density, effective spectral radius, nor the Lempel–Ziv-based complexity indices were prescribed or optimized in the eESN, the evolved network exhibited structural complexity comparable to conventional ESNs in the corresponding region and slightly higher dynamical complexity. These results suggest that the advantage of eESN is not attributable to a direct maximization of complexity itself, but rather to the evolutionary organization of complexity into a functionally differentiated reservoir that supports both memory-like retention and program-like rule extraction.
No takes yet. Share an insight, caveat, or question.
Watanabe et al. (2026) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: