CMP & Hierarchy Improvements
Improvements we would like to add to the CMP or hierarchical information processing.
These are the things we would like to implement:
- Figure out performance measures and supervision in heterarchy #infrastructure #compositional
- Add top-down connections #numsteps #multiobj #compositional
- Run & Analyze experiments with >2LMs in heterarchy testbed #compositional
- Run & Analyze experiments in multi-object environment looking at scene graphs #multiobj
- Test learning at different speeds depending on level in hierarchy #learning #generalization
- Send similarity encoding object ID to next level & test #compositional
Please see the instructions here if you would like to tackle one of these tasks.
Heterarchy vs. Hierarchy
We sometimes use the term heterarchy to express the notion that, similar to the brain, connections in Monty aren't always strictly hierarchical. There are many long-range connections (voting) within the same hierarchical level and across level, as well as skip-connections. Also, every level in the "hierarchy" has a motor output (goal state) that it sends to the motor system.
Help Us Make This Page Better
All our docs are open-source. If something is wrong or unclear, submit a PR to fix it!
Updated 11 days ago