CMP & Hierarchy Improvements
Improvements we would like to add to the CMP or hierarchical information processing.
These are the things we would like to implement:
- Figure out performance measures and supervision in heterarchy
- Add top-down connections
- Run & Analyze experiments with more LMs in heterarchy testbed
- Test learning at different speeds depending on level in hierarchy
- Send similarity encoding object ID to next level & test
- Global Interval Timer
- Include State in CMP
- Evaluate on the Omniglot dataset
Please see the instructions here if you would like to tackle one of these tasks.
Heterarchy vs. Hierarchy
We sometimes use the term heterarchy to express the notion that, similar to the brain, connections in Monty aren't always strictly hierarchical. There are many long-range connections (voting) within the same hierarchical level and across level, as well as skip-connections. Also, every level in the "hierarchy" has a motor output (goal state) that it sends to the motor system. To read more about this, see our recent publication Hierarchy or Heterarchy? A Theory of Long-Range Connections for the Sensorimotor Brain.
Help Us Make This Page Better
All our docs are open-source. If something is wrong or unclear, submit a PR to fix it!
Updated 20 days ago