Successful linguistic communication relies on a shared experience of the world.

(Experience Grounds Language, Bisk et al., 2020)

All language use can be thought of as a way of activating procedures within the hearer. We can think of an utterance as a program – one that indirectly causes a set of operations to be carried out within the hearer’s cognitive system.

(Understanding Computers and Cognition: A New Foundation for Design, Winograd and Flores, 1986)

Meaning does not arise from the statistical distribution of words, but from their use by people to communicate

(Experience Grounds Language)

With few exceptions (Carlson et al., 2010), machine learning models have been confined to IID datasets that lack the structure in time from which humans draw correlations about long-range causal dependencies. What if a machine was allowed to participate consistently? This is difficult to test under current evaluation paradigms for generalization. Yet, this is the structure of generalization in human development: drawing analogies to episodic memories and gathering new data through non-independent experiments.

(Experience Grounds Language)