2573 Publications

Learning predictable and robust neural representations by straightening image sequences

X. Niu, Cristina Savin, E. P. Simoncelli

Prediction is a fundamental capability of all living organisms, and has been proposed as an objective for learning sensory representations. Recent work demonstrates that in primate visual systems, prediction is facilitated by neural representations that follow straighter temporal trajectories than their initial photoreceptor encoding, which allows for prediction by linear extrapolation. Inspired by these experimental findings, we develop a self-supervised learning (SSL) objective that explicitly quantifies and promotes straightening. We demonstrate the power of his objective in training deep feedforward neural networks on smoothly-rendered synthetic image sequences that mimic commonly-occurring properties of natural videos. The learned model contains neural embeddings that are predictive, but also factorize the geometric, photometric, and semantic attributes of objects. The representations also prove more robust to noise and adversarial attacks compared to previous SSL methods that optimize for invariance to random augmentations. Moreover, these beneficial properties can be transferred to other training procedures by using the straightening objective as a regularizer, suggesting a broader utility of straightening as a principle for robust unsupervised learning.

Show Abstract

Shaping the distribution of neural responses with interneurons in a recurrent circuit model

D. Lipshutz, E. P. Simoncelli

Efficient coding theory posits that sensory circuits transform natural signals into neural representations that maximize information transmission subject to resource constraints. Local interneurons are thought to play an important role in these transformations, dynamically shaping patterns of local circuit activity to facilitate and direct information flow. However, the relationship between these coordinated, nonlinear, circuit-level transformations and the properties of interneurons (e.g., connectivity, activation functions, response dynamics) remains unknown. Here, we propose a normative computational model that establishes such a relationship. Our model is derived from an optimal transport objective that conceptualizes the circuit’s input-response function as transforming the inputs to achieve an efficient target response distribution. The circuit, which is comprised of primary neurons that are recurrently connected to a set of local interneurons, continuously optimizes this objective by dynamically adjusting both the synaptic connections between neurons as well as the interneuron activation functions. In an example application motivated by redundancy reduction, we construct a circuit that learns a dynamical nonlinear transformation that maps natural image data to a spherical Gaussian, significantly reducing statistical dependencies in neural responses. Overall, our results provide a framework in which the distribution of circuit responses is systematically and nonlinearly controlled by adjustment of interneuron connectivity and activation functions.

Show Abstract

Quantifying Differences in Neural Population Activity With Shape Metrics

Joao Barbosa, A. Nejatbakhsh, L. Duong, S. Harvey, Scott L. Brincat, Markus Siegel, Earl K. Miller, A. Williams

Quantifying differences across species and individuals is fundamental to many fields of biology. However, it remains challenging to draw detailed functional comparisons between large populations of interacting neurons. Here, we introduce a general framework for comparing neural population activity in terms of shape distances. This approach defines similarity in terms of explicit geometric transformations, which can be flexibly specified to obtain different measures of population-level neural similarity. Moreover, differences between systems are defined by a distance that is symmetric and satisfies the triangle inequality, enabling downstream analyses such as clustering and nearest-neighbor regression. We demonstrate this approach on datasets spanning multiple behavioral tasks (navigation, passive viewing of images, and decision making) and species (mice and non-human primates), highlighting its potential to measure functional variability across subjects and brain regions, as well as its ability to relate neural geometry to animal behavior.

Show Abstract

Disentangling Interacting Systems with Fermionic Gaussian Circuits: Application to the Single Impurity Anderson Model

Ang-Kun Wu, B. Kloss, Wladislaw Krinitsin, M. Fishman, J. Pixley, M. Stoudenmire

Tensor network quantum states are powerful tools for strongly correlated systems, tailored to capture local correlations such as in ground states with entanglement area laws. When applying tensor network states to interacting fermionic systems, a proper choice of the basis or orbitals can reduce the bond dimension of tensors and provide physically relevant orbitals. We introduce such a change of basis with unitary gates obtained from compressing fermionic Gaussian states into quantum circuits corresponding to various tensor networks. These circuits can reduce the ground-state entanglement entropy and improve the performance of algorithms such as the density matrix renormalization group. We study the Anderson impurity model with one and two impurities to show the potential of the method for improving computational efficiency and interpreting impurity physics. Furthermore, fermionic Gaussian circuits can also suppress entanglement during the time evolution out of low-energy state. Last, we consider Gaussian multiscale entanglement renormalization ansatz (GMERA) circuits which compress fermionic Gaussian states hierarchically. The emergent coarse-grained physical models from these GMERA circuits are studied in terms of their entanglement properties and suitability for performing time evolution.

Show Abstract

In vivo measurements of receptor tyrosine kinase activity reveal feedback regulation of a developmental gradient

Emily K. Ho , Rebecca P. Kim-Yip, S. Shvartsman, et al.

A lack of tools for detecting receptor activity in vivo has limited our ability to fully explore receptor-level control of developmental patterning. Here, we extend a new class of biosensors for receptor tyrosine kinase (RTK) activity, the pYtag system, to visualize endogenous RTK activity in Drosophila. We build biosensors for three Drosophila RTKs that function across developmental stages and tissues. By characterizing Torso::pYtag during terminal patterning in the early embryo, we find that Torso activity differs from downstream ERK activity in two surprising ways: Torso activity is narrowly restricted to the poles but produces a broader gradient of ERK, and Torso activity decreases over developmental time while ERK activity is sustained. This decrease in Torso activity is driven by ERK pathway-dependent negative feedback. Our results suggest an updated model of terminal patterning where a narrow domain of Torso activity, tuned in amplitude by negative feedback, locally activates signaling effectors which diffuse through the syncytial embryo to form the ERK gradient. Altogether, this work highlights the usefulness of pYtags for investigating receptor-level regulation of developmental patterning.

Show Abstract
January 7, 2025

Geometric model for dynamics of motor-driven centrosomal asters

Yuan-Nan Young, Vicente Gomez Herrera, Huan Zhang, R. Farhadifar, M. Shelley

The centrosomal aster is a mobile and adaptable cellular organelle that exerts and transmits forces necessary for tasks such as nuclear migration and spindle positioning. Recent experimental and theoretical studies of nematode and human cells demonstrate that pulling forces on asters by cortically anchored force generators are dominant during such processes. Here, we present a comprehensive investigation of the S-model (S for stoichiometry) of aster dynamics based solely on such forces. The model evolves the astral centrosome position, a probability field of cell-surface motor occupancy by centrosomal microtubules (under an assumption of stoichiometric binding), and free boundaries of unattached, growing microtubules. We show how cell shape affects the stability of centering of the aster, and its transition to oscillations with increasing motor number. Seeking to understand observations in single-cell nematode embryos, we use highly accurate simulations to examine the nonlinear structures of the bifurcations, and demonstrate the importance of binding domain overlap to interpreting genetic perturbation experiments. We find a generally rich dynamical landscape, dependent upon cell shape, such as internal constant-velocity equatorial orbits of asters that can be seen as traveling wave solutions. Finally, we study the interactions of multiple asters which we demonstrate an effective mutual repulsion due to their competition for surface force generators. We find, amazingly, that centrosomes can relax onto the vertices of platonic and nonplatonic solids, very closely mirroring the results of the classical Thomson problem for energy-minimizing configurations of electrons constrained to a sphere and interacting via repulsive Coulomb potentials. Our findings both explain experimental observations, providing insights into the mechanisms governing spindle positioning and cell division dynamics, and show the possibility of new nonlinear phenomena in cell biology.

Show Abstract

The 2024 New York City Integrative Structural Biology Symposium

P. Cossio, Edward T. Eng

The 2024 New York City Integrative Structural Biology Symposium focused on understanding the challenges and opportunities of applying integrative structural biology techniques to biomedical research. To foster connections across different fields and disciplines, this symposium offered hands-on workshops. These workshops provided attendees an opportunity to use state-of-the-art instrumentation and software programs in the structural biology sciences that they may not have access to in their own laboratories. Moreover, the symposium provided a vibrant environment for scientific discourse where cutting-edge research talks presented the trends in integrative structural biology in the New York City area. In this TrendsTalk, the symposium organizers bring to you the highlights of the workshops and scientific sections from this event.

Show Abstract

Classical variational phase-field models cannot predict fracture nucleation

Oscar Lopez-Pamies, John E. Dolbow , G. Francfort, Christopher J. Larsen

Notwithstanding the evidence against them, classical variational phase-field models continue to be used and pursued in an attempt to describe fracture nucleation in elastic brittle materials. In this context, the main objective of this paper is to provide a comprehensive review of the existing evidence against such a class of models as descriptors of fracture nucleation. To that end, a review is first given of the plethora of experimental observations of fracture nucleation in nominally elastic brittle materials under quasi-static loading conditions, as well as of classical variational phase-field models, without and with energy splits. These models are then confronted with the experimental observations. The conclusion is that they cannot possibly describe fracture nucleation in general. This because classical variational phase-field models cannot account for material strength as an independent macroscopic material property. The last part of the paper includes a brief summary of a class of phase-field models that can describe fracture nucleation. It also provides a discussion of how pervasively material strength has been overlooked in the analysis of fracture at large, as well as an outlook into the modeling of fracture nucleation beyond the basic setting of elastic brittle materials.

Show Abstract

Two-dimensional homogeneous electron gas with symmetric dual-gate screening: Exchange-correlation functional and other ground-state properties

The two-dimensional (2D) homogeneous electron gas (HEG) is a fundamental model in quantum many-body physics. It is important to theoretical and computational studies, where exchange-correlation energies computed in it serve as the foundation for density-functional calculations. It is also of direct relevance to a variety of experimental settings, especially with the rapid recent growth in 2D materials and moiré systems. In these experiments, metallic gates are often present, which screen the Coulomb interaction between electrons. The effect of the screening can qualitatively change the behavior of the 2D HEG, and requires accurate many-body computations to capture. In this work, we perform state-of-the-art diffusion Monte Carlo (DMC) calculations in the 2D HEG subjected to symmetric dual-gate screening. We systematically compute the correlation energy across a range of densities and gate separations for both spin unpolarized and fully polarized systems. A global fit is obtained for the correlation energy, using these data and imposing various limiting behaviors obtained from perturbation analysis. The new functional will allow density-functional calculations to be performed for a variety of realistic experimental setups which can accurately account for the presence of gates. We also investigate how the gate screening affects the bulk modulus, pair correlation function, and the structure factor of the 2D HEG, which can potentially be probed in experiments.
Show Abstract
January 1, 2025

Two-dimensional homogeneous electron gas with symmetric dual-gate screening: Exchange-correlation functional and other ground-state properties

The two-dimensional (2D) homogeneous electron gas (HEG) is a fundamental model in quantum many-body physics. It is important to theoretical and computational studies, where exchange-correlation energies computed in it serve as the foundation for density-functional calculations. It is also of direct relevance to a variety of experimental settings, especially with the rapid recent growth in 2D materials and moiré systems. In these experiments, metallic gates are often present, which screen the Coulomb interaction between electrons. The effect of the screening can qualitatively change the behavior of the 2D HEG, and requires accurate many-body computations to capture. In this work, we perform state-of-the-art diffusion Monte Carlo (DMC) calculations in the 2D HEG subjected to symmetric dual-gate screening. We systematically compute the correlation energy across a range of densities and gate separations for both spin unpolarized and fully polarized systems. A global fit is obtained for the correlation energy, using these data and imposing various limiting behaviors obtained from perturbation analysis. The new functional will allow density-functional calculations to be performed for a variety of realistic experimental setups which can accurately account for the presence of gates. We also investigate how the gate screening affects the bulk modulus, pair correlation function, and the structure factor of the 2D HEG, which can potentially be probed in experiments.
Show Abstract
January 1, 2025
  • Previous Page
  • Viewing
  • Next Page
Advancing Research in Basic Science and MathematicsSubscribe to Flatiron Institute announcements and other foundation updates

privacy consent banner

Privacy preference

We use cookies to provide you with the best online experience. By clicking "Accept All," you help us understand how our site is used and enhance its performance. You can change your choice at any time here. To learn more, please visit our Privacy Policy.