Abstract—Spiking neural networks (SNNs) receive widespread attention because of their low-power hardware characteristic and brain-like signal response mechanism, but the performance of SNNs is still behind Artificial Neural Networks (ANNs) currently. We build an information theory-inspired system called Stochastic Probability Adjustment (SPA) system to reduce this gap. The SPA maps the synapses and neurons of SNNs into a probability space, where a neuron with all the pre-synapses connected to it is represented by a cluster， and the movement of the synaptic transmitter between different clusters is a Brownian-like stochastic process in which the transmitter distribution is adaptively adjusted at different firing phases. We tested various existing unsupervised SNN architectures and achieved good, consistent performance improvements, the classification accuracy improvements on the MNIST and EMNIST datasets have reached 1.99% and 6.29% respectively.