A Fundamental Theory to Model the Mind


James O'Brien for Quanta Magazine

Mounting evidence suggests that localized episodes of disordered brain activity, like avalanches in a sand pile, help keep the overall system in healthy balance.

Comments (14)


In 1999, the Danish physicist Per Bak proclaimed to a group of neuroscientists that it had taken him only 10 minutes to determine where the field had gone wrong. Perhaps the brain was less complicated than they thought, he said. Perhaps, he said, the brain worked on the same fundamental principles as a simple sand pile, in which avalanches of various sizes help keep the entire system stable overall — a process he dubbed “self-organized criticality.”

As much as scientists in other fields adore outspoken, know-it-all physicists, Bak’s audacious idea — that the brain’s ordered complexity and thinking ability arise spontaneously from the disordered electrical activity of neurons — did not meet with immediate acceptance.

But over time, in fits and starts, Bak’s radical argument has grown into a legitimate scientific discipline. Now, about 150 scientists worldwide investigate so-called “critical” phenomena in the brain, the topic of at least three focused workshops in 2013 alone. Add the ongoing efforts to found a journal devoted to such studies, and you have all the hallmarks of a field moving from the fringes of disciplinary boundaries to the mainstream.

“How do we know that the creations of worlds are not determined by falling grains of sand?” — Victor Hugo, “Les Misérables

In the 1980s, Bak first wondered how the exquisite order seen in nature arises out of the disordered mix of particles that constitute the building blocks of matter. He found an answer in phase transition, the process by which a material transforms from one phase of matter to another. The change can be sudden, like water evaporating into steam, or gradual, like a material becoming superconductive. The precise moment of transition — when the system is halfway between one phase and the other — is called the critical point, or, more colloquially, the “tipping point.”

Classical phase transitions require what is known as precise tuning: in the case of water evaporating into vapor, the critical point can only be reached if the temperature and pressure are just right. But Bak proposed a means by which simple, local interactions between the elements of a system could spontaneously reach that critical point — hence the term self-organized criticality.

Think of sand running from the top of an hourglass to the bottom. Grain by grain, the sand accumulates. Eventually, the growing pile reaches a point where it is so unstable that the next grain to fall may cause it to collapse in an avalanche. When a collapse occurs, the base widens, and the sand starts to pile up again — until the mound once again hits the critical point and founders. It is through this series of avalanches of various sizes that the sand pile — a complex system of millions of tiny elements — maintains overall stability.

While these small instabilities paradoxically keep the sand pile stable, once the pile reaches the critical point, there is no way to tell whether the next grain to drop will cause an avalanche — or just how big any given avalanche will be. All one can say for sure is that smaller avalanches will occur more frequently than larger ones, following what is known as a power law.

Bak introduced self-organized criticality in a landmark 1987 paper — one of the most highly cited physics papers of the last 30 years. Bak began to see the stabilizing role of frequent smaller collapses wherever he looked. His 1996 book, “How Nature Works,” extended the concept beyond simple sand piles to other complex systems: earthquakes, financial markets, traffic jams, biological evolution, the distribution of galaxies in the universe — and the brain. Bak’s hypothesis implies that most of the time, the brain teeters on the edge of a phase transition, hovering between order and disorder.

The brain is an incredibly complex machine. Each of its tens of billions of neurons is connected to thousands of others, and their interactions give rise to the emergent process we call “thinking.” According to Bak, the electrical activity of brain cells shift back and forth between calm periods and avalanches — just like the grains of sand in his sand pile — so that the brain is always balanced precariously right at that the critical point.

A better understanding of these critical dynamics could shed light on what happens when the brain malfunctions. Self-organized criticality also holds promise as a unifying theoretical framework. According to the neurophysiologist Dante Chialvo, most of the current models in neuroscience apply only to single experiments; to replicate the results from other experiments, scientists must change the parameters — tune the system — or use a different model entirely.

Per Bak

Courtesy of Dante Chialvo

Per Bak at Rockefeller University in 1998.

Self-organized criticality has a certain intuitive appeal. But a good scientific theory must be more than elegant and beautiful. Bak’s notion has had its share of critics, in part because his approach strikes many as ridiculously broad: He saw nothing strange about leaping across disciplinary boundaries and using self-organized criticality to link the dynamics of forest fires, measles and the large-scale structure of the universe — often in a single talk. Nor was he one to mince words. His abrasive personality did not endear him to his critics, although Lee Smolin, a physicist at the Perimeter Institute for Theoretical Physics, in Canada, has chalked this up to “childlike simplicity,” rather than arrogance. “It would not have occurred to him that there was any other way to be,” Smolin wrote in a remembrance after Bak’s death in 2002. “Science is hard, and we have to say what we think.”

Nonetheless, Bak’s ideas found fertile ground in a handful of like-minded scientists. Chialvo, now with the University of California, Los Angeles, and with the National Scientific and Technical Research Council in Argentina, met Bak at Brookhaven National Laboratory around 1990 and became convinced that self-organized criticality could explain brain activity. He, too, encountered considerable resistance. “I had to put up with a number of critics because we didn’t have enough data,” Chialvo said. Dietmar Plenz, a neuroscientist with the National Institute of Mental Health, recalled that it was impossible to win a grant in neuroscience to work on self-organized criticality at the time, given the lack of experimental evidence.

Since 2003, however, the body of evidence showing that the brain exhibits key properties of criticality has grown, from examinations of slices of cortical tissue and electroencephalography (EEG) recordings of the interactions between individual neurons to large-scale studies comparing the predictions of computer models with data from functional magnetic resonance (fMRI) imaging. “Now the field is mature enough to stand up to any fair criticism,” Chialvo said.

One of the first empirical tests of Bak’s sand pile model took place in 1992, in the physics department of the University of Oslo. The physicists confined piles of rice between glass plates and added grains one at a time, capturing the resulting avalanche dynamics on camera. They found that the piles of elongated grains of rice behaved much like Bak’s simplified model.

Most notably, the smaller avalanches were more frequent than the larger ones, following the expected power law distribution. That is, if there were 100 small avalanches involving only 10 grains during a given time frame, there would be 10 avalanches involving 100 grains in the same period, but only a single large avalanche involving 1,000 grains. (The same pattern had been observed in earthquakes and their aftershocks. If there are 100 quakes measuring 6.0 on the Gutenberg-Richter scale in a given year, there will be 10 7.0 quakes and one 8.0 quake.)

Chialvo envisions self-organized criticality providing a broader, more fundamental theory for neuroscientists, like those found in physics.

Ten years later, Plenz and a colleague, John Beggs, now a biophysicist at Indiana University, observed the same pattern of avalanches in the electrical activity of neurons in cortical slices — the first key piece of evidence that the brain functions at criticality. “It was something that no one believed the brain would do,” Plenz said. “The surprise is that is exactly what happens.” Studies using magnetoencephalography (MEG) and Chialvo’s own work comparing computer simulations with fMRI imaging data of the brain’s resting state have since added to the evidence that the brain exhibits these key avalanche dynamics.

But perhaps it is not so surprising. There can be no phase transitions without a critical point, and without transitions, a complex system — like Bak’s sand pile, or the brain — cannot adapt. That is why avalanches only show up at criticality, a “sweet spot” where a system is perfectly balanced between order and disorder, according to Plenz. They typically occur when the brain is in its normal resting state. Avalanches are a mechanism by which a complex system avoids becoming trapped, or “phase-locked,” in one of two extreme cases. At one extreme, there is too much order, such as during an epileptic seizure; the interactions among elements are too strong and rigid, so the system cannot adapt to changing conditions. At the other, there is too much disorder; the neurons aren’t communicating as much, or aren’t as broadly interconnected throughout the brain, so information can’t spread as efficiently and, once again, the system is unable to adapt.

A complex system that hovers between “boring randomness and boring regularity” is surprisingly stable overall, said Olaf Sporns, a cognitive neuroscientist at Indiana University. “Boring is bad,” he said, at least for a critical system. In fact, “if you try to avoid ever sparking an avalanche, eventually when one does occur, it is likely to be really large,” said Raissa D’Souza, a complex systems scientist at the University of California, Davis, who simulated just such a generic system last year. “If you spark avalanches all the time, you’ve used up all the fuel, so to speak, and so there is no opportunity for large avalanches.”

D’Souza’s research applies these dynamics to better understand power outages across the electrical grid. The brain, too, needs sufficient order to function properly, but also enough flexibility to adapt to changing conditions; otherwise, the organism could not survive. This could be one reason that the brain exhibits hallmarks of self-organized criticality: It confers an evolutionary advantage. “A brain that is not critical is a brain that does exactly the same thing every minute, or, in the other extreme, is so chaotic that it does a completely random thing, no matter what the circumstances,” Chialvo said. “That is the brain of an idiot.”

Chialvo and Bak

Courtesy of Dante Chialvo

From left: Kim Christensen, Dante Chialvo, Per Bak and Zeev Olami at Brookhaven National Laboratory in the early 1990s.

When the brain veers away from criticality, information can no longer percolate through the system as efficiently. One study (not yet published) examined sleep deprivation; subjects remained awake for 36 hours and then took a reaction time test while an EEG monitored their brain activity. The more sleep-deprived the subject, the more the person’s brain activity veered away from the critical balance point and the worse the performance on the test.

Another study collected data from epileptic subjects during seizures. The EEG recordings revealed that mid-seizure, the telltale avalanches of criticality vanished. There was too much synchronization among neurons, and then, Plenz said, “information processing breaks down, people lose consciousness, and they don’t remember what happened until they recover.”

Chialvo envisions self-organized criticality providing a broader, more fundamental theory for neuroscientists, like those found in physics. He believes it could be used to model the mind in all its possible states: awake, asleep, under anesthesia, suffering a seizure, and under the influence of a psychedelic drug, among many others.

This is especially relevant as neuroscience moves deeper into the realm of big data. The latest advanced imaging techniques are capable of mapping synapses and monitoring brain activity at unprecedented resolutions, with a corresponding explosion in the size of data sets. Billions of dollars in research funding has launched the Human Connectome Project — which aims to build a “network map” of neural pathways in the brain — and the Brain Research Through Advancing Innovative Neurotechnologies (BRAIN), dedicated to developing new technological tools for recording signals from cells. There is also Europe’s Human Brain Project, working to simulate the complete human brain on a supercomputer, and China’s Brainnetome project to integrate data collected from every level of the brain’s hierarchy of complex networks.

Dante Chialvo

Pep Vicens

Dante Chialvo during an interview with the Spanish newspaper El Mundo in 2011.

But without an underlying theory, it will be difficult to glean all the potential insights hidden in the data. “It is fine to build maps and it is fine to catalog pieces and how they are related, so long as you don’t lose track of the fact that when the system you map actually functions, it is in an integrated system and it is dynamic,” Sporns said.

“The structure of the brain — the precise map of who connects with whom — is almost irrelevant by itself,” Chialvo said — or rather, it is necessary but not sufficient to decipher how cognition and behavior are generated in the brain. “What is relevant is the dynamics,” Chialvo said. He then compared the brain with a street map of Los Angeles containing details of all the connections at every scale, from private driveways to public freeways. The map tells us only about the structural connections; it does not help predict how traffic moves along those connections or where (and when) a traffic jam is likely to form. The map is static; traffic is dynamic. So, too, is the activity of the brain. In recent work, Chialvo said, researchers have demonstrated that both traffic dynamics and brain dynamics exhibit criticality.

Sporns emphasizes that it remains to be seen just how robust this phenomenon might be in the brain, pointing out that more evidence is needed beyond the observation of power laws in brain dynamics. In particular, the theory still lacks a clear description for how criticality arises from neurobiological mechanisms — the signaling of neurons in local and distributed circuits. But he admits that he is rooting for the theory to succeed. “It makes so much sense,” he said. “If you were to design a brain, you would probably want criticality in the mix. But ultimately, it is an empirical question.”

This article was reprinted on

Add a Comment

View Comments (14)

Comments for this entry

  • Very interesting article. However, I feel it should be noted that in most cases granular avalanches actually do not exhibit Self Organized Criticality (Jaeger, Liu, Nagel, PRL 1989). The Olso group mentioned in the article only found Self Organized Criticality in long rice grains. With shorter, more sphereical grains they found a stretched exponential distribution, which is inconsistent with Self Organized Criticality (Frette et al, Nature 1996). Other groups have also found that factors such as the system size and walls effects can also dramatically change the avalanche dynamics, finding Self Organized Criticality only in special circumstances (the intro in Lőrincz and Wijngaarden, PRE 2007 has a nice review). This does not relate directly to neuroscience, and it may turn out that Self Organized Criticality plays a key role in neural dynamics. However, the granular example does caution against applying Self Organized Criticality overly broadly.

  • This reminds me of Francis Crick’s work on dreaming to the effect that it’s just discharge of static electricity in the brain. See Crick, F. & Mitchelson, G. (1983, Jul. 14). “The function of dream sleep.” Nature, 304, 111-13

  • Very nice article. The brain (and actually all of physiology) is a self-organizing critical system. That is what evolution “pulls” for, shortcuts to make the current “state” differentially sensitive to signals to change it into a different “state”. That minimizes energy/substrate/time to do something new, that is what evolution selects for, minimum substrate use to switch to do what ever is important to do next.

    It is not *exactly* at the point of criticality, the system needs to be off-critical for stability. But deviations from criticality cause exponential changes in responsiveness, in both directions.

  • “the granular example does caution against applying Self Organized Criticality overly broadly”
    Thanks John for the very relevant remarks and references. Very useful for outsiders like me!

    One could take your point from a more “encouraging” angle: if self-organized criticality is not so universal and requires specific parameters, and if the data on the brain confirm that it is indeed a critical systems, then this feature is most probably relevant for its function, not just a generic one of complex system.

  • You write, ‘The brain is an incredibly complex machine. Each of its tens of billions of neurons is connected to thousands of others, and their interactions give rise to the emergent process we call “thinking.”’

    And this begins your ‘explanation’. However, this axiom (of ‘epiphenomenalism’) is exactly what is at question when it comes to the mind-brain issue. Thus it ‘begs the question’. Furthermore, to assume that the brain causes the mind (due to psych-physical correlation) is to commit the fallacy of cum hoc ergo propter hoc.

    What is actually required is an explanation as to how brain processes cause mental processes, rather than simply describing how brain processes correlate to mental processes. This will most likely require a radical rethinking of axioms. The proposed theory here in the article does not even touch upon this issue, therefore it is without fundamental merit.

    Peter Sjöstedt-H

  • Adding another wrinkle to Peter Sjöstedt-H, above (a good comment).

    This appears to be a too-simplistic idea relative to consciousness. How do we “get outside our brain” to even know what consciousness is? This hearkens back to Wittgenstein’s statement, thus:
    “Not how the world is, is the mystical, but that it is”

  • Dear Mr. Sjöstedt-H,

    the “mind-brain issue” only exists in the minds of the most recalcitrant philosophers that insist on trying to understand the physical world by completely ignoring all physical reality. Please, save this kind of comments for articles about epistemology.

  • I completely agree with No one above. There is zero data compatible with the idea that there is an immaterial mind “on top” of the brain and controlling it from the “top-down”.

    That the brain exhibits near critical behavior is very strong evidence that there is no “top” exerting “top-down” control.

    The whole point of near critical systems is that the local signaling self-regulates itself to be very nearly exactly in balance. In the brain it is a balance of excitation and inhibition between individual neurons. In a near critical fluid it is a balance of attraction and repulsion between molecules. In a magnet at the Curie point it is a balance of spin-up and spin-down between magnetic domains.

    That local balance cannot be imposed from the “top-down”.

    Humans have hyperactive agency detection, an artifact of sensory systems evolved to detect and avoid predators, where a false positive is much better than a false negative. Human perception and cognition is biased to perceive and find “agency” or “the cause”, even when there is not one. It is cognitive bias that causes humans to posit an immaterial mind.

    The mind is an illusion, albeit a persistent one. ;)

  • Interesting article. Per Bak a brave person. / John Royer’s comment alignes with the physics of deep time mountain building that ultimately results in Rocky Mountain avalanches, then chute formation combined with environmental factors like wind and temperature, uv energy and creature activity [including man]. Simple but often a challenge to discover/perceive.

  • Peter S. asks how brain processes cause mental processes. With the exception of the hard problem of the qualia of consciousness, which genuinely may remain a mystery (Tononi notwithstanding), there is actually not much of a problem as to how the collaboration of many information-processing sub-units cause “thinking”.

    The computation model, and symbolic representation suffices. The brain no doubt performs computational manipulations of highly associatively organized symbolic representations. The symbolic representations must be organized to directly and efficiently represent generalization, association, and relative weight of association between concepts (representations of structure in the environment; its objects and its processes), but many of these symbolic representational tricks are now known to computer science.

    The details will no doubt be tricky to work out, as regards organic brains, but the fundamental mechanism must be highly parallel computation over generalized associative representational networks, and brain is to mind as (extraordinarily parallel) computer is to software.

  • To state a tautology, the mind must exist because it has some evolutionary advantage. If it were just us, you could argue that maybe it’s just an evolutionary fluke, but looking at the behavior of other animals, it’s hard to argue that they aren’t experiencing something vaguely similar to what we are (more precisely, what I am; I can’t tell what you’re experiencing any more than I can what a mouse is experiencing, it just looks like what I feel). Off the top of my head, it would seem to be good way to organize the bunch of shifting goals, long and short term, that are required for the life of a higher order vertebrate to survive and reproduce, into one integrating entity, where hunger and fear can fight it out, rather than have your head reach for the cheese while your legs ran away or similar.
    As for the brain criticality theory, sure, why not? Sounds good. I assume there’s more meat to it than in this introductory mass market article, but it doesn’t seem to conflict with any standard scientific hypotheses. But I don’t see where it applies to the real central question; how and where does something completely immaterial, the mind/consciousness/personhood/sentience etc, interface with something completely material, i.e. the brain?

  • Gerald Zuckier et al, maybe this is old news, but you might want to take a look at New Scientist special issue about Consciousness (18 may 2013, pp 31-41) where they try to make sense about ” how a kilogram or so of nerve cells conjure up the seamless kaleidoscope of sensations, thoughts, memories and emotions that occupy every waking moment”.

    PS New Scientist also had a ten pages special issue about Self (23 feb 2013) … DS

  • Peter Sjöstedt-H says:
    “You write, ‘The brain is an incredibly complex machine. Each of its tens of billions of neurons is connected to thousands of others, and their interactions give rise to the emergent process we call “thinking.”. And this begins your ‘explanation’. However, this axiom (of ‘epiphenomenalism’)…”

    It’s a faulty assumption founded on faulty logic that correlation somehow equals causation.

    Axiom: “… A self-evident principle or one that is accepted as true without proof as the basis for argument.” It is not self-evident that the interactions of neurons give rise to thought so it must be ‘something accepted as true without proof’. So much for science.

  • I am not clear as to what the neural analogy is, as the discussion is vague. Is it saying that the neuronal activity in the brain is analogous to the pile of sand, and that some type of mental stimulation disturbs the balance of activity, resulting in a “thought?” analogous to the “avalanche? If so, then in the sand example there are lulls between avalanches, while in the brain there are no obvious lulls. Thoughts seem to continue seamlessly. Also, what neural correlate is analogous to the size of the avalanche?

Leave a Comment

Your email address will not be published. Your name will appear near your comment. Required *