Networks in the spinal cord, which are responsible for the generation of rhythmic movements, commonly known as central pattern generators (CPGs), have remained elusive for decades. Although it is well-known that many spinal neurons are rhythmically active, little attention has been given to the distribution of firing rates across the population. Here, we argue that firing rate distributions can provide an important clue to the organization of the CPGs. The data that can be gleaned from the sparse literature indicate a firing rate distribution, which is skewed toward zero with a long tail, akin to a normal distribution on a log-scale, i.e., a “log-normal” distribution. Importantly, such a shape is difficult to unite with the widespread assumption of modules composed of recurrently connected excitatory neurons. Spinal modules with recurrent excitation has the propensity to quickly escalate their firing rate and reach the maximum, hence equalizing the spiking activity across the population. The population distribution of firing rates hence would consist of a narrow peak near the maximum. This is incompatible with experiments, that show wide distributions and a peak close to zero. A way to resolve this puzzle is to include recurrent inhibition internally in each CPG modules. Hence, we investigate the impact of recurrent inhibition in a model and find that the firing rate distributions are closer to the experimentally observed. We therefore propose that recurrent inhibition is a crucial element in motor circuits, and suggest that future models of motor circuits should include recurrent inhibition as a mandatory element.