Publications

We explore the universality of neural encodings in convolutional neural networks trained on image classification tasks. We develop a procedure to directly compare the learned weights rather than their representations. It is based on a factorization of spatial and channel dimensions and measures the similarity of aligned weight covariances. We show that, for a range of layers of VGG-type networks, the learned eigenvectors appear to be universal across different natural image datasets. Our results suggest the existence of a universal neural encoding for natural images. They explain, at a more fundamental level, the success of transfer learning. Our work shows that, instead of aiming at maximizing the performance of neural networks, one can alternatively attempt to maximize the universality of the learned encoding, in order to build a principled foundation model.

Despite many successful examples in which probabilistic inference can account for perception, we have little understanding of how the brain represents and uses structured priors that capture the complexity of natural input statistics. Here we construct a recurrent circuit model that can implicitly represent priors over latent variables, and combine them with sensory and contextual sources of information to encode task-specific posteriors. Inspired by the recent success of diffusion models as means of learning and using priors over images, our model uses dendritic nonlinearities optimized for denoising, and stochastic somatic integration with the degree of noise modulated by an oscillating global signal. Combining these elements into a recurrent network yields a stochastic dynamical system that samples from the prior at a rate prescribed by the period of the global oscillator. Additional inputs reflecting sensory or top-down contextual information alter these dynamics to generate samples from the corresponding posterior, with different input gating patterns selecting different inference tasks. We demonstrate that this architecture can sample from low dimensional nonlinear manifolds and multimodal posteriors. Overall, the model provides a new framework for circuit-level representation of probabilistic information, in a format that facilitates flexible inference.

Allostery is the mechanism by which information and control are propagated in biomolecules. It regulates ligand binding, chemical reactions, and conformational changes. An increasing level of experimental resolution and control over allosteric mechanisms promises a deeper understanding of the molecular basis for life and powerful new therapeutics. In this review, we survey the literature for an up-to-date biological and theoretical understanding of protein allostery. By delineating five ways in which the energy landscape or the kinetics of a system may change to give rise to allostery, we aim to help the reader grasp its physical origins. To illustrate this framework, we examine three systems that display these forms of allostery: allosteric inhibitors of beta-lactamases, thermosensation of TRP channels, and the role of kinetic allostery in the function of kinases. Finally, we summarize the growing power of computational tools available to investigate the different forms of allostery presented in this review.

In this work, we propose and compare three numerical methods to handle the one-phase Hele-Shaw problem with surface tension in dimension two by using three variational approaches in the spirit of the seminal works \cite{Otto, Gia_Otto}.

There is a need to define regions of gene activation or repression that control human kidney cells in states of health, injury, and repair to understand the molecular pathogenesis of kidney disease and design therapeutic strategies. Comprehensive integration of gene expression with epigenetic features that define regulatory elements remains a significant challenge. We measure dual single nucleus RNA expression and chromatin accessibility, DNA methylation, and H3K27ac, H3K4me1, H3K4me3, and H3K27me3 histone modifications to decipher the chromatin landscape and gene regulation of the kidney in reference and adaptive injury states. We establish a spatially-anchored epigenomic atlas to define the kidney’s active, silent, and regulatory accessible chromatin regions across the genome. Using this atlas, we note distinct control of adaptive injury in different epithelial cell types. A proximal tubule cell transcription factor network of ELF3, KLF6, and KLF10 regulates the transition between health and injury, while in thick ascending limb cells this transition is regulated by NR2F1. Further, combined perturbation of ELF3, KLF6, and KLF10 distinguishes two adaptive proximal tubular cell subtypes, one of which manifested a repair trajectory after knockout. This atlas will serve as a foundation to facilitate targeted cell-specific therapeutics by reprogramming gene regulatory networks.

The self-assembly of amyloid-beta (Aβ) peptides into fibrillar structures in the brain is a signature of Alzheimer's disease. Recent studies have reported correlations between Alzheimer's disease and type-2 diabetes. Structurally, hyperglycemia induces covalent protein crosslinkings by advanced glycation end products (AGE), which can affect the stability of Aβ oligomers. In this work, we leverage physics-based coarse-grained molecular simulations to probe alternate thermodynamic pathways that affect peptide aggregation propensities at varying concentrations of glucose molecules. Similar to previous experimental reports, our simulations show a glucose concentration-dependent increase in Aβ aggregation rates, without changes in the overall secondary structure content. We discovered that glucose molecules prefer partitioning onto the aggregate–water interface at a specific orientation, resulting in a loss of molecular rotational entropy. This effectively hastens the aggregation rates, as peptide self-assembly can reduce the available surface area for peptide–glucose interactions. This work introduces a new thermodynamic-driven pathway, beyond chemical cross-linking, that can modulate Aβ aggregation.

Chemotactic bacteria not only navigate chemical gradients, but also shape their environments by consuming and secreting attractants. Investigating how these processes influence the dynamics of bacterial populations has been challenging because of a lack of experimental methods for measuring spatial profiles of chemoattractants in real time. Here, we use a fluorescent sensor for aspartate to directly measure bacterially generated chemoattractant gradients during collective migration. Our measurements show that the standard Patlak–Keller–Segel model for collective chemotactic bacterial migration breaks down at high cell densities. To address this, we propose modifications to the model that consider the impact of cell density on bacterial chemotaxis and attractant consumption. With these changes, the model explains our experimental data across all cell densities, offering insight into chemotactic dynamics. Our findings highlight the significance of considering cell density effects on bacterial behavior, and the potential for fluorescent metabolite sensors to shed light on the complex emergent dynamics of bacterial communities.

This paper continues the analysis of the scattering problem for a network of open wave-guides started in [arXiv:2302.04353, arXiv:2310.05816]. In this part we present explicit, physically motivated radiation conditions that ensure uniqueness of the solution to the scattering problem. These conditions stem from a 2000 paper of A. Vasy on 3-body Schrodinger operators; we discuss closely related conditions from a 1994 paper of H. Isozaki. Vasy's paper also proves the existence of the limiting absorption resolvents, and that the limiting solutions satisfy the radiation conditions. The statements of these results require a calculus of pseudodifferential operators, called the 3-body scattering calculus, which is briefly introduced here. We show that the solutions to the model problem obtained in arXiv:2302.04353 satisfy these radiation conditions, which makes it possible to prove uniqueness, and therefore existence, for the system of Fredholm integral equations introduced in that paper.

In recent years, growth in our understanding of the computations performed in both biological and artificial neural networks has largely been driven by either low-level mechanistic studies or global normative approaches. However, concrete methodologies for bridging the gap between these levels of abstraction remain elusive. In this work, we investigate the internal mechanisms of neural networks through the lens of neural population geometry, aiming to provide understanding at an intermediate level of abstraction, as a way to bridge that gap. Utilizing manifold capacity theory (MCT) from statistical physics and manifold alignment analysis (MAA) from high-dimensional statistics, we probe the underlying organization of task-dependent manifolds in deep neural networks and neural recordings from the macaque visual cortex. Specifically, we quantitatively characterize how different learning objectives lead to differences in the organizational strategies of these models and demonstrate how these geometric analyses are connected to the decodability of task-relevant information. Furthermore, these metrics show that macaque visual cortex data are more similar to unsupervised DNNs in terms of geometrical properties such as manifold position and manifold alignment. These analyses present a strong direction for bridging mechanistic and normative theories in neural networks through neural population geometry, potentially opening up many future research avenues in both machine learning and neuroscience.

Collective behaviors require coordination of individuals. Thus, a population must adjust its phenotypic distribution to adapt to changing environments. How can a population regulate its phenotypic distribution? One strategy is to utilize specialized networks for gene regulation and maintaining distinct phenotypic subsets. Another involves genetic mutations, which can be augmented by stress-response pathways. Here, we studied how a migrating bacterial population regulates its phenotypic distribution to traverse across diverse environments. We generated isogenic Escherichia coli populations with varying distributions of swimming behaviors and observed their phenotype distributions during migration in liquid and porous environments. Surprisingly, we found that during collective migration, the distributions of swimming phenotypes adapt to the environment without mutations or gene regulation. Instead, adaptation is caused by the dynamic and reversible enrichment of high-performing swimming phenotypes within each environment. This adaptation mechanism is supported by a recent theoretical study, which proposed that the phenotypic composition of a migrating population results from a balance between cell growth generating diversity and collective migration eliminating the phenotypes that are unable to keep up with the migrating group. Furthermore, by examining chemoreceptor abundance distributions during migration towards different attractants, we found that this mechanism acts on multiple chemotaxis-related traits simultaneously. Our findings reveal that collective migration itself can enable cell populations with continuous, multi-dimensional phenotypes to flexibly and rapidly adapt their phenotypic composition to diverse environmental conditions.