CMP & Hierarchy Improvements

These are the things we would like to implement:

• Figure out performance measure and supervision in heterarchy #infrastructure
• Add top-down connections #numsteps
• Add associative connections #abstract #numsteps
• Run & Analyze experiments with >2LMs in heterarchy testbed #compositional
• Run & Analyze experiments in multiobject environment looking at scene graphs #multiobj
• Test learning at different speeds depending on level in hierarchy #learning #generalization
• Send similarity encoding object ID to next level & test #compositional

Please see the instructions here if you would like to tackle one of these tasks.

📘

Heterarchy vs. Hierarchy

We sometimes use the term heterarchy to express the notion that, similar to the brain, connections in Monty aren't always strictly hierarchical. There are many long-range connections (voting) within the same hierarchical level and across level, as well as skip-connections. Also, every level in the "hierarchy" has a motor output (goal state) that it sends to the motor system.