Neurocompositional computing: From the Central Paradox of Cognition to a new generation of AI systems. (arXiv:2205.01128v1 [cs.AI])

What explains the dramatic progress from 20th-century to 21st-century AI, and
how can the remaining limitations of current AI be overcome? The widely
accepted narrative attributes this progress to massive increases in the
quantity of computational and data resources available to support statistical
learning in deep artificial neural networks. We show that an additional crucial
factor is the development of a new type of computation. Neurocompositional
computing adopts two principles that must be simultaneously respected to enable
human-level cognition: the principles of Compositionality and Continuity. These
have seemed irreconcilable until the recent mathematical discovery that
compositionality can be realized not only through discrete methods of symbolic
computing, but also through novel forms of continuous neural computing. The
revolutionary recent progress in AI has resulted from the use of limited forms
of neurocompositional computing. New, deeper forms of neurocompositional
computing create AI systems that are more robust, accurate, and comprehensible.



Related post