Assistive Pepper Robot on NVIDIA Jetson
2026A companion robot for patients and caregivers. When someone walks in, Pepper recognizes them, says hello, checks in, and offers an activity: Simon Says, a guess-the-object game, or a seated exercise routine. All the AI runs locally on a Jetson attached to a robot that is more than ten years old.
- Live video from the robot to the Jetson, with YOLOv8 object detection and local face recognition (SCRFD + AuraFace).
- Root-caused corrupted camera frames to YUV422 decoding, and a torchvision::nms crash to a CUDA kernel missing from Jetson's aarch64 build.
- Pepper refused to go through doorways. The fix was smaller steps, not a bigger push.
- Bridged Pepper's navigation to ROS 2 / Nav2; tested with pytest plus a hardware-in-the-loop checklist.