← Paper explainers

IROS 2024 · 1:30 narrated walkthrough

Online Optimization of Central Pattern Generators for Quadruped Locomotion

Zewei Zhang, Guillaume Bellegarda, Milad Shafiee, Auke Ijspeert

Keep the oscillator-based controller, and learn parameter settings that fit the command and operating conditions.

1:30 · Narrated · Sound onOriginal schematic animation · Synthetic narration

Explore the method

Step through the explanation, try a schematic optimization trial, and see how context and a new speed command change the information used by the optimizer. Diagrams illustrate the mechanism; they are not experimental data or a robot simulator.

The complete explanation is available in the text walkthrough below.
0:00 / 1:30

When conditions changeWalking is not one fixed setting. A heavier load, a slippery surface, or a slope changes what works.

Transcript

Read the 90-second narration

When conditions change. Walking is not one fixed setting. A heavier load, a slippery surface, or a slope changes what works.

A compact locomotion prior. This controller starts with central pattern generators: coupled oscillators that organize a rhythmic gait. Eight adjustable parameters shape the movement and its force feedback.

Choose the next trial. Bayesian optimization chooses what to try next. A probabilistic model predicts how parameter settings affect a score for speed tracking and energy use. Each trial updates that model, balancing predicted performance against uncertainty.

Condition the search on context. The optimizer also uses context. Foot forces provide a load-related estimate; body pitch provides a slope-related estimate. This helps it learn different settings for different conditions.

Reuse trials when speed changes. When the target speed changes, previous trials are scored again for the new target. Their measurements are reused instead of restarting the search.

Feedback supports the rhythm. Two feedback mechanisms help execution: contact forces adjust oscillator timing, while virtual model control corrects body posture. Ablations support combining them.

What the hardware experiments showed. On a treadmill, the Go1 learned flat-ground speed tracking in under three minutes. Separate hardware tests demonstrated adaptation to a ten-degree slope and added payloads up to fifteen kilograms.

Adaptation within a defined scope. Parameters adapt online. The search has no explicit safety guarantee; more rugged terrain remains future work.

The paper, step by step

Scene 02

A compact locomotion prior

One oscillator drives each leg. Coupled phases organize a trot, while oscillator states are mapped to foot trajectories and then to joint commands. The optimizer tunes eight variables: ground clearance, ground penetration, swing and stance frequencies, oscillator amplitude, front and hind foot offsets, and force-feedback strength. This is a designed rhythmic structure, not a policy learned from animal motion capture.

Paper: Section II-A1, Equations 1–5; Section III-A: eight-dimensional parameter vector

Scene 04

Condition the search on context

Contextual Bayesian optimization conditions the score model on two measured quantities: averaged normal foot forces and averaged body pitch. These are proxies related to payload and slope, not exact measurements of kilograms or terrain angle. The optimizer can use experience from nearby contexts when proposing parameters. Friction is tested experimentally but is not an additional context input in this implementation.

Paper: Section II-D, Equations 7–8; Section III-A3, Equation 11; Section IV-C

Scene 05

Reuse trials when speed changes

The objective explicitly contains the desired velocity. When that command changes, stored velocity and energy measurements can be evaluated against the new target, updating the objective values for previous parameter trials. This is reuse of measured trials, not copying a policy trained for another task. The hardware velocity-command experiment includes 0.6 → 0.3 → 0.5 → 0.6 m/s.

Paper: Section III-A2: Data Reuse; Section IV-B; Section IV-D, Figure 4c

Scene 06

Feedback supports the rhythm

Force feedback enters the oscillator phase equations, slowing phase progression when a leg is loaded. Virtual model control adds attitude-correcting torques. These fast feedback mechanisms work alongside the slower parameter optimizer. The controller ablation compares open-loop CPG, CPG with VMC, CPG with force feedback, and their combination; the results support force feedback and the combined controller, without establishing a universal performance or safety guarantee.

Paper: Section II-A2, Equation 6; Section II-B: Virtual Model Control; Section IV-E, Table II and Figure 6

Scene 07

What the hardware experiments showed

In the reported hardware slope experiment, the robot first learned to track 0.4 m/s on flat ground in fewer than 40 trials, reported as under three minutes. After the slope changed to 10°, it regained the target speed after about 20 further trials, reported as around two minutes. Separate hardware experiments added 5, 10, and 15 kg payloads. The slope and payload tests were conducted separately. The reported learning times describe these experiments, not a general guarantee of adaptation speed.

Paper: Section III-D: treadmill setup; Section IV-D: Hardware Experiments; Figures 1, 4 and 5

Scene 08

Adaptation within a defined scope

The result is a compact, biologically inspired controller whose parameters can be optimized through physical interaction. The paper studies a trot structure and specific command, friction, slope, and payload changes. It does not demonstrate arbitrary rough-terrain navigation or a general repertoire of learned gaits. The authors explicitly identify safety guarantees during parameter search and more rugged terrain as limitations or future work.

Paper: Section V: Conclusion; Section II-A1: trot phase coupling

From the paper

The online controller architecture: contextual Bayesian optimization around a CPG controller with sensory feedback
Figure 2. Control architecture. The optimizer updates parameters between trials; sensory feedback supports execution.
Unitree Go1 hardware experiments under normal, reduced-friction, added-payload and incline conditions
Figure 1. Hardware experiments. Friction, payload, and incline are separate tested conditions.
Reported hardware velocity tracking and contextual adaptation results for slope and command changes
Figure 4. Hardware results: slope adaptation and changing velocity commands.
Reported hardware velocity tracking as payloads of five, ten and fifteen kilograms are added
Figure 5. Hardware results with added payload. The tested loads do not define an arbitrary load-and-slope operating envelope.

A few useful terms

Central pattern generator (CPG)
A rhythmic controller represented here by coupled oscillators, one for each leg.
Bayesian optimization
A trial-based search that uses a probabilistic model to choose the next parameter setting to evaluate.
Context
Measured information related to the current operating condition; here, averaged foot forces and body pitch.
Cost of transport
An energy-use measure normalized by weight and distance traveled.
Force feedback
Foot-contact forces used to adjust the timing of the oscillator-driven movement.
Virtual model control (VMC)
A posture controller that adds corrective torques based on the robot’s attitude.

Based on Zhang et al., IROS 2024. Diagrams are schematic; experimental results are identified by their source in the paper. Hardware footage and figures: Zhang, Bellegarda, Shafiee and Ijspeert. Synthetic narration.