multimodal memory
Moments, lined up.
Meatball's two timelines — what it saw move and what it heard said — folded onto one. Every event keeps the scene before and after it, plus anything from the other sense that happened nearby. This is the substrate for relating image patches to speech over time. Newest first, updating live.