Information-Directed Active Calibration of Unknown Velocity Dynamics
Advanced Robotics Group, Toyota Research Institute, Palo Alto, CA, USA
Abstract:
Navigation stacks for legged robots usually command a vendor locomotion controller through an opaque velocity interface whose gains, saturation limits, and latency differ from their nominal values and must be calibrated before a planner can trust its motion model. Calibration requires choosing probe commands, and uniform excitation spends much of its motion on directions whose response is already well determined. This paper formulates probe selection as information-directed sampling. A particle posterior is maintained over a six-parameter state-delay model of the interface, comprising three per-axis gains, a planar-speed and a yaw-rate saturation limit, and a transport delay, and each probe is chosen to maximize the expected information gain about these parameters per unit of commanded path length. The information gain is evaluated through the saturated model, and a hierarchical shrinkage prior couples the per-axis gains so that weakly excited directions borrow strength from well-excited ones. The method is compared with uniform sweep excitation, random probing under a motion budget, and the planner-conditioned probes of GAUGE over 200 simulated calibration sessions of a Unitree B2 in Isaac Lab, with validation on five real-robot sessions. Information-directed probing attains a worst-direction calibration error of 8.9 percent against 9.5 to 10.3 percent for the baselines, reaches navigation-grade accuracy in 38 s against 40 to 42 s, and uses 11.4 m of commanded motion against 11.8 to 13.0 m. Ablations indicate that cost weighting, saturation awareness, and shrinkage are each needed to outperform uniform excitation.
| Journal: | Transactions on Intelligent Robotics and Autonomous Systems (TIRAS) |
|---|---|
| Volume / Issue: | Vol. 1, No. 2 (August 2026) |
| Article ID: | KAGG:2608.00001 |
| DOI: | 10.5803/kagg.2608.00001 |
| Received: | 2026-07-19 |
| Accepted: | 2026-07-30 |
| Published online: | 2026-08-02 |
| License: | CC BY 4.0 |
References (42)
- D. Fox, W. Burgard, and S. Thrun. The Dynamic Window Approach to Collision Avoidance. IEEE Robotics and Automation Magazine, 4(1):23–33, 1997. doi:10.1109/100.580977
- G. Williams, A. Aldrich, and E. Theodorou. Model Predictive Path Integral Control using Covariance Variable Importance Sampling. arXiv:1509.01149, 2015. arXiv:1509.01149
- N. Rudin, D. Hoeller, M. Bjelonic, and M. Hutter. Advanced Skills by Learning Locomotion and Local Navigation End-to-End. arXiv:2209.12827, 2022. arXiv:2209.12827
- J. Di Carlo, P. M. Wensing, B. Katz, G. Bledt, and S. Kim. Dynamic Locomotion in the MIT Cheetah 3 Through Convex Model-Predictive Control. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2018. doi:10.1109/IROS.2018.8594448
- J. Hwangbo, J. Lee, A. Dosovitskiy, D. Bellicoso, V. Tsounis, V. Koltun, and M. Hutter. Learning Agile and Dynamic Motor Skills for Legged Robots. arXiv:1901.08652, 2019. arXiv:1901.08652
- T. Miki, J. Lee, J. Hwangbo, L. Wellhausen, V. Koltun, and M. Hutter. Learning Robust Perceptive Locomotion for Quadrupedal Robots in the Wild. arXiv:2201.08117, 2022. arXiv:2201.08117
- T. Zang, H. Huang, S. Cheng, and W. Zhang. GAUGE: Planner-Conditioned Active Calibration of Opaque Quadruped Velocity Interfaces. arXiv:2607.02841, 2026. arXiv:2607.02841
- K. Chaloner and I. Verdinelli. Bayesian Experimental Design: A Review. Statistical Science, 10(3):273–304, 1995. doi:10.1214/ss/1177009939
- T. Rainforth, A. Foster, D. R. Ivanova, and F. Bickford Smith. Modern Bayesian Experimental Design. arXiv:2302.14545, 2023. arXiv:2302.14545
- D. Russo and B. Van Roy. Learning to Optimize via Information-Directed Sampling. arXiv:1403.5556, 2014. arXiv:1403.5556
- J. Borenstein and L. Feng. Measurement and Correction of Systematic Odometry Errors in Mobile Robots. IEEE Transactions on Robotics and Automation, 12(6):869–880, 1996. doi:10.1109/70.544770
- A. Censi, A. Franchi, L. Marchionni, and G. Oriolo. Simultaneous Calibration of Odometry and Sensor Parameters for Mobile Robots. IEEE Transactions on Robotics, 29(2):475–492, 2013. doi:10.1109/TRO.2012.2226380
- A. Foster, M. Jankowiak, E. Bingham, P. Horsfall, Y. W. Teh, T. Rainforth, and N. Goodman. Variational Bayesian Optimal Experimental Design. arXiv:1903.05480, 2019. arXiv:1903.05480
- A. Foster, D. R. Ivanova, I. Malik, and T. Rainforth. Deep Adaptive Design: Amortizing Sequential Bayesian Experimental Design. arXiv:2103.02438, 2021. arXiv:2103.02438
- N. Houlsby, F. Huszár, Z. Ghahramani, and M. Lengyel. Bayesian Active Learning for Classification and Preference Learning. arXiv:1112.5745, 2011. arXiv:1112.5745
- J. Kirschner and A. Krause. Information Directed Sampling and Bandits with Heteroscedastic Noise. arXiv:1801.09667, 2018. arXiv:1801.09667
- J. Kirschner, T. Lattimore, and A. Krause. Information Directed Sampling for Linear Partial Monitoring. arXiv:2002.11182, 2020. arXiv:2002.11182
- N. Srinivas, A. Krause, S. M. Kakade, and M. Seeger. Gaussian Process Optimization in the Bandit Setting: No Regret and Experimental Design. arXiv:0912.3995, 2009. arXiv:0912.3995
- R. K. Mehra. Optimal Input Signals for Parameter Estimation in Dynamic Systems: Survey and New Results. IEEE Transactions on Automatic Control, 19(6):753–768, 1974. doi:10.1109/TAC.1974.1100701
- A. Wagenmaker and K. Jamieson. Active Learning for Identification of Linear Dynamical Systems. arXiv:2002.00495, 2020. arXiv:2002.00495
- H. Mania, M. I. Jordan, and B. Recht. Active Learning for Nonlinear System Identification with Guarantees. arXiv:2006.10277, 2020. arXiv:2006.10277
- M. Buisson-Fenet, F. Solowjow, and S. Trimpe. Actively Learning Gaussian Process Dynamics. arXiv:1911.09946, 2019. arXiv:1911.09946
- P. Shyam, W. Jaśkowski, and F. Gomez. Model-Based Active Exploration. arXiv:1810.12162, 2018. arXiv:1810.12162
- D. Pathak, D. Gandhi, and A. Gupta. Self-Supervised Exploration via Disagreement. arXiv:1906.04161, 2019. arXiv:1906.04161
- B. Sukhija, L. Treven, C. Sancaktar, S. Blaes, S. Coros, and A. Krause. Optimistic Active Exploration of Dynamical Systems. arXiv:2306.12371, 2023. arXiv:2306.12371
- M. Memmel, A. Wagenmaker, C. Zhu, P. Yin, D. Fox, and A. Gupta. ASID: Active Exploration for System Identification in Robotic Manipulation. arXiv:2404.12308, 2024. arXiv:2404.12308
- T. Lew, A. Sharma, J. Harrison, A. Bylard, and M. Pavone. Safe Active Dynamics Learning and Control: A Sequential Exploration-Exploitation Framework. arXiv:2008.11700, 2020. arXiv:2008.11700
- J. Lee, J. Hwangbo, L. Wellhausen, V. Koltun, and M. Hutter. Learning Quadrupedal Locomotion over Challenging Terrain. arXiv:2010.11251, 2020. arXiv:2010.11251
- N. Rudin, D. Hoeller, P. Reist, and M. Hutter. Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learning. arXiv:2109.11978, 2021. arXiv:2109.11978
- V. Makoviychuk et al.. Isaac Gym: High Performance GPU-Based Physics Simulation for Robot Learning. arXiv:2108.10470, 2021. arXiv:2108.10470
- M. Mittal et al.. Orbit: A Unified Simulation Framework for Interactive Robot Learning Environments. arXiv:2301.04195, 2023. arXiv:2301.04195
- J. Tobin, R. Fong, A. Ray, J. Schneider, W. Zaremba, and P. Abbeel. Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real World. arXiv:1703.06907, 2017. arXiv:1703.06907
- X. B. Peng, M. Andrychowicz, W. Zaremba, and P. Abbeel. Sim-to-Real Transfer of Robotic Control with Dynamics Randomization. arXiv:1710.06537, 2017. arXiv:1710.06537
- W. Yu, J. Tan, C. K. Liu, and G. Turk. Preparing for the Unknown: Learning a Universal Policy with Online System Identification. arXiv:1702.02453, 2017. arXiv:1702.02453
- A. Kumar, Z. Fu, D. Pathak, and J. Malik. RMA: Rapid Motor Adaptation for Legged Robots. arXiv:2107.04034, 2021. arXiv:2107.04034
- F. Ramos, R. C. Possas, and D. Fox. BayesSim: Adaptive Domain Randomization via Probabilistic Inference for Robotics Simulators. arXiv:1906.01728, 2019. arXiv:1906.01728
- Y. Chebotar, A. Handa, V. Makoviychuk, M. Macklin, J. Issac, N. Ratliff, and D. Fox. Closing the Sim-to-Real Loop: Adapting Simulation Randomization with Real World Experience. arXiv:1810.05687, 2018. arXiv:1810.05687
- G. Kahn, P. Abbeel, and S. Levine. BADGR: An Autonomous Self-Supervised Learning-Based Navigation System. arXiv:2002.05700, 2020. arXiv:2002.05700
- J. Frey, M. Mattamala, N. Chebrolu, C. Cadena, M. Fallon, and M. Hutter. Fast Traversability Estimation for Wild Visual Navigation. arXiv:2305.08510, 2023. arXiv:2305.08510
- A. D. Ames, S. Coogan, M. Egerstedt, G. Notomista, K. Sreenath, and P. Tabuada. Control Barrier Functions: Theory and Applications. arXiv:1903.11199, 2019. arXiv:1903.11199
- M. S. Arulampalam, S. Maskell, N. Gordon, and T. Clapp. A Tutorial on Particle Filters for Online Nonlinear/Non-Gaussian Bayesian Tracking. IEEE Transactions on Signal Processing, 50(2):174–188, 2002. doi:10.1109/78.978374
- E. A. Wan and R. van der Merwe. The Unscented Kalman Filter for Nonlinear Estimation. Proceedings of the IEEE Adaptive Systems for Signal Processing, Communications, and Control Symposium, 153–158, 2000. doi:10.1109/ASSPCC.2000.882463