Technical Write-ups

Explore my latest projects, research, and technical guides on robotics, control systems, and automation.

Part II Mamba + LNN Robot

Hardening the Robot Brain

Continuing to improve the Mamba + LNN powered Franka Emika robot arm with parallelized cloud training, improved models, and closing the sim-to-real gap.

RoboticsReinforcement LearningMuJoCoCloud ComputingContact PhysicsDomain Randomization
13 min read · Sep 8, 2026
Read →
256 GPU ENVSMuJoCo / WarpROLLOUT16,384 Stepss_t, a_t, r_tGAE Â_tlog π(a_t)π_θ(a|s)V_φ(s)L^CLIP: [1-ε, 1+ε]
Write-up

How RL Training Actually Works in Robotics Multi-Rate Control, GAE Mechanics, PPO, and Diagnostics

A systems view of continuous robot reinforcement learning: why control splits across a 20 Hz policy loop and a 500 Hz PD loop, how GAE trades bias for variance, the truncation bug that quietly biases every late-episode advantage, what the PPO clip does and does not constrain, and which metrics to read when a run goes bad.

Reinforcement LearningPPOMuJoCoGPU SimulationRobotics
31 min read · Sep 1, 2026
Read →
Part I Mamba + LNN Robot

Building a Robot Brain Mamba SSMs and Liquid Neural Networks

Designing a multi-rate vision-based pick-and-place policy for a 7-DOF Franka Panda arm from first principles: 10 Hz Mamba-3 SSM Cortex, 50 Hz Liquid CfC Brainstem, SpatialSoftmax, and DLS Inverse Kinematics.

RoboticsMamba SSMLiquid NetworksReinforcement LearningMuJoCo
18 min read · Aug 18, 2026
Read →
Interactive Tool

Which Controller Should You Use?

An interactive decision tree meant to help you find which controller is right for you between PID, LQR, MPC, NMPC, and more.

Control Theory
Web App · Aug 14, 2026
Open Tool →
Part III Double Pendulum

Real-Time Nonlinear MPC in the Browser

Ditch the pre-computation phase, the controller plans it all live, up to 200 times a second, in the browser. Learn how prediction controllers work.

NMPCControl TheoryTrajectory OptimizationiLQR
13 min read · Aug 13, 2026
Read →
Part II Double Pendulum

Bringing Reality into the Simulation

The same controller, this time bringing a bit of the real world into the sim. Find out what breaks and how to fix it.

Sim-to-RealRobustnessControl Theory
9 min read · Aug 8, 2026
Read →
Part I Double Pendulum

Teaching a Double Pendulum to Stand Up

One motor against three degrees of freedom. I cover trajectory optimization, LQR, and the handoff between them. Everything running live in the browser.

Control TheoryTrajectory OptimizationiLQRLQR
17 min read · Aug 3, 2026
Read →