Complete Stability of Neural Networks with Non-monotonic Piecewise Linear Activation Functions
This brief studies the complete stability of neural networks with non-monotonic piecewise linear activation functions. By applying the fixed point theorem and the eigenvalue properties of strict diagonal dominance matrix, some conditions are derived which guarantee that such n-neuron neural networks are completely stable.
More precisely, the following two important results are obtained: 1) The corresponding neural networks have exactly 5n equilibrium points, among which 3n equilibrium points are locally exponentially stable and the others are unstable; 2) As long as the initial states are not equal to the equilibrium points of the neural networks, the corresponding solution trajectories will converge towards one of the 3n locally stable equilibrium points. A numerical example is provided to illustrate the theoretical findings via computer simulations.