← All research

Continual learning research · questions

Why do people learn so fast?

Starting points for research about learning, experience and the brain. Not settled explanations.

Open questions

Questions I want to investigate about learning, experience, and the brain. These are starting points for research, not settled explanations.

Why can humans learn so much from so little experience?

Many neural networks need extensive training, yet people can sometimes learn a new concept or skill from only a few examples. What explains that gap: the size of the network, its structure, what it already knows, or how it learns?

Does having more connections help?Brain scale, model size, and an open hypothesis

My starting hypothesis is that the brain’s much larger number of connections might be part of the explanation. A commonly cited rough estimate is around 100 trillion synapses in the human brain. Comparing that with a hypothetical trillion-parameter AI model suggests a striking difference in scale—but AI has no single parameter count, and a biological synapse is not equivalent to one artificial parameter.

Connection count alone does not establish why one system learns from fewer examples. How connections are organized and updated may matter as much as their number. Could greater capacity improve sample efficiency under otherwise matched conditions? That is a testable question, not a conclusion from the counts.

Scale reference: the National Institute on Aging’s Unraveling the Mystery gives the approximate 100-trillion-synapse figure. Treat it as an estimate, not a precise measurement or a direct AI comparison.

How much experience is really “a little”?New examples versus a lifetime of prior learning

A person approaching a new task brings years of sensory experience, learned concepts, and biological structure shaped by evolution. A fair comparison should distinguish learning from scratch from adapting with prior knowledge, including an AI model’s pretraining.

Human-level one-shot learning has been demonstrated in a computational model for handwritten characters using structured prior knowledge. That narrow result suggests that what a learner brings to a task matters; it does not settle the broader human–AI experience gap. See Lake, Salakhutdinov, and Tenenbaum’s Human-level concept learning through probabilistic program induction.

What should count as experience: examples, interactions, sensory information, or time? How much of rapid learning is reusing earlier knowledge, memory, or internal rehearsal?

Does the brain use backpropagation?How does it know which connections to change?

This leads to another question: do humans learn through something like backpropagation, or through a different mechanism? Backpropagation computes how each parameter contributes to an error, allowing a neural network to adjust its weights. The biological counterpart is the credit-assignment problem: how do local synaptic changes improve the behavior of the whole system?

Whether brains implement backpropagation, approximate parts of it, or use other mechanisms remains an open research question. Biological feedback and local learning rules could support backpropagation-like updates, but a plausible mechanism is not proof that the brain uses it. See Lillicrap and colleagues’ Backpropagation and the brain.

The experience gap alone cannot tell us which learning rule the brain uses. I want to understand which combinations of network structure, prior knowledge, memory, and learning rules could make artificial agents learn more efficiently.

Related questions for continual learning

  • What should be retained, revisited, or forgotten?
  • How could rapid adaptation in context connect with durable learning?
  • How should an agent’s ability to learn and retain capabilities be evaluated across tasks?
  • Do learning from own play, fencing the weight updates and replaying earlier levels, taken together, keep every earlier level passable while new gates are learned?

More research