CMP & Hierarchy Improvements
These are the things we would like to implement:
- Figure out performance measure and supervision in heterarchy #infrastructure
- Add top-down connections #numsteps
- Add associative connections #abstract #numsteps
- Run & Analyze experiments with >2LMs in heterarchy testbed #compositional
- Run & Analyze experiments in multiobject environment looking at scene graphs #multiobj
- Test learning at different speeds depending on level in hierarchy #learning #generalization
- Send similarity encoding object ID to next level & test #compositional
Please see the instructions here if you would like to tackle one of these tasks.
Heterarchy vs. Hierarchy
We sometimes use the term heterarchy to express the notion that, similar to the brain, connections in Monty aren't always strictly hierarchical. There are many long-range connections (voting) within the same hierarchical level and across level, as well as skip-connections. Also, every level in the "hierarchy" has a motor output (goal state) that it sends to the motor system.
Updated 1 day ago