Technical Write-ups

Explore my latest projects, research, and technical guides on robotics, control systems, and automation.

Part III Mamba + LNN Robot

The Orchard Leap A significant increase in difficulty

Taking the Mamba-3 and Liquid CfC robot out of the tabletop sandbox and into a moving orchard platform in MuJoCo.

RoboticsReinforcement LearningMuJoCoMamba SSMLiquid NetworksSim-to-RealContact PhysicsImitation Learning
10 min read · Oct 30, 2026
Read →
Part II Mamba + LNN Robot

Hardening the Robot Brain

Continuing to improve the Mamba + LNN powered Franka Emika robot arm with parallelized cloud training, improved models, and closing the sim-to-real gap.

RoboticsReinforcement LearningMuJoCoCloud ComputingContact PhysicsDomain Randomization
13 min read · Sep 8, 2026
Read →
256 GPU ENVSMuJoCo / WarpROLLOUT16,384 Stepss_t, a_t, r_tGAE Â_tlog π(a_t)π_θ(a|s)V_φ(s)L^CLIP: [1-ε, 1+ε]
Write-up

How RL Training Actually Works in Robotics Multi-Rate Control, GAE Mechanics, PPO, and Diagnostics

A systems view of continuous robot reinforcement learning: why control splits across a 20 Hz policy loop and a 500 Hz PD loop, how GAE trades bias for variance, the truncation bug that quietly biases every late-episode advantage, what the PPO clip does and does not constrain, and which metrics to read when a run goes bad.

Reinforcement LearningPPOMuJoCoGPU SimulationRobotics
31 min read · Sep 1, 2026
Read →
Part I Mamba + LNN Robot

Building a Robot Brain Mamba SSMs and Liquid Neural Networks

Designing a multi-rate vision-based pick-and-place policy for a 7-DOF Franka Panda arm from first principles: 10 Hz Mamba-3 SSM Cortex, 50 Hz Liquid CfC Brainstem, SpatialSoftmax, and DLS Inverse Kinematics.

RoboticsMamba SSMLiquid NetworksReinforcement LearningMuJoCo
13 min read · Aug 18, 2026
Read →
Part III Double Pendulum

Real-Time Nonlinear MPC in the Browser

Ditch the pre-computation phase, the controller plans it all live, up to 200 times a second, in the browser. Learn how prediction controllers work.

NMPCControl TheoryTrajectory OptimizationiLQR
12 min read · Aug 13, 2026
Read →
Part II Double Pendulum

Bringing Reality into the Simulation

The same controller, this time bringing a bit of the real world into the sim. Find out what breaks and how to fix it.

Sim-to-RealRobustnessControl Theory
9 min read · Aug 8, 2026
Read →
Part I Double Pendulum

Teaching a Double Pendulum to Stand Up

One motor against three degrees of freedom. I cover trajectory optimization, LQR, and the handoff between them. Everything running live in the browser.

Control TheoryTrajectory OptimizationiLQRLQR
17 min read · Aug 3, 2026
Read →