This repository is my attempt at implementing the Continuous Thought Machine (CTM) from this paper.
The dataset i use can be found at google drive.
When training with an rtx 3060 12GB for 4 hours the model learns to predict 2-3 points accurately but dosen't learn to "look around". This might be because of the short training time or simplicity of the dataset.