2789 Publications

Estimating Neural Representation Alignment from Sparsely Sampled Inputs and Features

C. Chun, A. Canatar, S. Chung , Daniel D. Lee

In both artificial and biological systems, the centered kernel alignment (CKA) has become a widely used tool for quantifying neural representation similarity. While current CKA estimators typically correct for the effects of finite stimuli sampling, the effects of sampling a subset of neurons are overlooked, introducing notable bias in standard experimental scenarios. Here, we provide a theoretical analysis showing how this bias is affected by the representation geometry. We then introduce a novel estimator that corrects for both input and feature sampling. We use our method for evaluating both brain-to-brain and model-to-brain alignments and show that it delivers reliable comparisons even with very sparsely sampled neurons. We perform within-animal and across-animal comparisons on electrophysiological data from visual cortical areas V1, V4, and IT data, and use these as benchmarks to evaluate model-to-brain alignment. We also apply our method to reveal how object representations become progressively disentangled across layers in both biological and artificial systems. These findings underscore the importance of correcting feature-sampling biases in CKA and demonstrate that our bias-corrected estimator provides a more faithful measure of representation alignment. The improved estimates increase our understanding of how neural activity is structured across both biological and artificial systems.

Show Abstract
February 24, 2025

Brain-Model Evaluations Need the NeuroAI Turing Test

J. Feather, Meenakshi Khosla, N. Apurva Ratan Murty, Aran Nayebi

What makes an artificial system a good model of intelligence? The classical test proposed by Alan Turing focuses on behavior, requiring that an artificial agent's behavior be indistinguishable from that of a human. While behavioral similarity provides a strong starting point, two systems with very different internal representations can produce the same outputs. Thus, in modeling biological intelligence, the field of NeuroAI often aims to go beyond behavioral similarity and achieve representational convergence between a model's activations and the measured activity of a biological system. This position paper argues that the standard definition of the Turing Test is incomplete for NeuroAI, and proposes a stronger framework called the ``NeuroAI Turing Test'', a benchmark that extends beyond behavior alone and \emph{additionally} requires models to produce internal neural representations that are empirically indistinguishable from those of a brain up to measured individual variability, i.e. the differences between a computational model and the brain is no more than the difference between one brain and another brain. While the brain is not necessarily the ceiling of intelligence, it remains the only universally agreed-upon example, making it a natural reference point for evaluating computational models. By proposing this framework, we aim to shift the discourse from loosely defined notions of brain inspiration to a systematic and testable standard centered on both behavior and internal representations, providing a clear benchmark for neuroscientific modeling and AI development.

Show Abstract
February 22, 2025

Engineering anisotropic electrodynamics at the graphene/CrSBr interface

Graphene is a privileged 2D platform for hosting confined light-matter excitations known as surface plasmon polaritons (SPPs), as it possesses low intrinsic losses and a high degree of optical confinement. However, the isotropic nature of graphene limits its ability to guide and focus SPPs, making it less suitable than anisotropic elliptical and hyperbolic materials for polaritonic lensing and canalization. Here, we present graphene/CrSBr as an engineered 2D interface that hosts highly anisotropic SPP propagation across mid-infrared and terahertz energies. Using scanning tunneling microscopy, scattering-type scanning near-field optical microscopy, and first-principles calculations, we demonstrate mutual doping in excess of 1013cm--2 holes/electrons between the interfacial layers of graphene/CrSBr. SPPs in graphene activated by charge transfer interact with charge-induced electronic anisotropy in the interfacial doped CrSBr, leading to preferential SPP propagation along the quasi-1D chains that compose each CrSBr layer. This multifaceted proximity effect both creates SPPs and endows them with anisotropic propagation lengths that differ by an order-of-magnitude between the in-plane crystallographic axes of CrSBr.
Show Abstract

Nongenetic adaptation by collective migration

Lam Vo, Fotios Avgidis, H. Mattingly, et al.

Cell populations must adjust their phenotypic composition to adapt to changing environments. One adaptation strategy is to maintain distinct phenotypic subsets within the population and to modulate their relative abundances via gene regulation. Another strategy involves genetic mutations, which can be augmented by stress-response pathways. Here, we studied how a migrating bacterial population regulates its phenotypic distribution to traverse diverse environments. We generated isogenic Escherichia coli populations with varying distributions of swimming behaviors and observed their phenotype distributions during migration in liquid and porous environments. We found that the migrating populations became enriched with high-performing swimming phenotypes in each environment, allowing the populations to adapt without requiring mutations or gene regulation. This adaptation is dynamic and rapid, reversing in a few doubling times when migration ceases. By measuring the chemoreceptor abundance distributions during migration toward different attractants, we demonstrated that adaptation acts on multiple chemotaxis-related traits simultaneously. These measurements are consistent with a general mechanism in which adaptation results from a balance between cell growth generating diversity and collective migration eliminating underperforming phenotypes. Thus, collective migration enables cell populations with continuous, multidimensional phenotypes to flexibly and rapidly adapt their phenotypic composition to diverse environmental conditions.

Show Abstract

Comment on ‘Pressure of Coulomb systems with volume-dependent long-range potentials’

Lei Li , J. Liang, Zhenli Xu

In this note, we address some issues concerning the accurate pressure calculation of Coulomb systems with periodic boundary conditions. First, we prove that the formulas for the excess part of the pressure with Ewald summation also reduce to the ensemble average of one-third of the ratio between the potential energy and the volume so that the comments on our previous work in a recent paper by Onegin et al (2024 J. Phys. A: Math. Theor. 57 205002) are incorrect. Second, we demonstrate that in charge non-neutral systems, the pressure expression must be corrected to include interactions with the neutralizing background. This addresses the issues about pressure computation in LAMMPS raised in the paper by Onegin et al. Numerical experiments are performed to verify that the pressure obtained via Ewald summation with corrected terms agrees with the average pressure using thermodynamics for the non-neutral OCP system, and are independent of the splitting parameter in the Ewald summation.

Show Abstract

The ManifoldEM method for cryo-EM: a step-by-step breakdown accompanied by a modern Python implementation

A. A. Ojha, R. Blackwell, M. Astore, S. Hanson, et al.

Resolving continuous conformational heterogeneity in single-particle cryo-electron microscopy (cryo-EM) is a field in which new methods are now emerging regularly. Methods range from traditional statistical techniques to state-of-the-art neural network approaches. Such ongoing efforts continue to enhance the ability to explore and understand the continuous conformational variations in cryo-EM data. One of the first methods was the manifold embedding approach or ManifoldEM. However, comparing it with more recent methods has been challenging due to software availability and usability issues. In this work, we introduce a modern Python implementation that is user-friendly, orders of magnitude faster than its previous versions and designed with a developer-ready environment. This implementation allows a more thorough evaluation of the strengths and limitations of methods addressing continuous conformational heterogeneity in cryo-EM, paving the way for further community-driven improvements.

Show Abstract

The ManifoldEM method for cryo-EM: a step-by-step breakdown accompanied by a modern Python implementation

A. A. Ojha, R. Blackwell, M. Astore, S. Hanson, et al.

Resolving continuous conformational heterogeneity in single-particle cryo-electron microscopy (cryo-EM) is a field in which new methods are now emerging regularly. Methods range from traditional statistical techniques to state-of-the-art neural network approaches. Such ongoing efforts continue to enhance the ability to explore and understand the continuous conformational variations in cryo-EM data. One of the first methods was the manifold embedding approach or ManifoldEM. However, comparing it with more recent methods has been challenging due to software availability and usability issues. In this work, we introduce a modern Python implementation that is user-friendly, orders of magnitude faster than its previous versions and designed with a developer-ready environment. This implementation allows a more thorough evaluation of the strengths and limitations of methods addressing continuous conformational heterogeneity in cryo-EM, paving the way for further community-driven improvements.

Show Abstract

Accurate close interactions of Stokes spheres using lubrication-adapted image systems

Anna Broms, A. Barnett, Anna-Karin Tornberg

Stokes flows with near-touching rigid particles induce near-singular lubrication forces under relative motion, making their accurate numerical treatment challenging. With the aim of controlling the accuracy with a computationally cheap method, we present a new technique that combines the method of fundamental solutions (MFS) with the method of images. For rigid spheres, we propose to represent the flow using Stokeslet proxy sources on interior spheres, augmented by lines of image sources adapted to each near-contact to resolve lubrication. Source strengths are found by a least-squares solve at contact-adapted boundary collocation nodes. We include extensive numerical tests, and validate against reference solutions from a well-resolved boundary integral formulation. With less than 60 additional image sources per particle per contact, we show controlled uniform accuracy to three relative digits in surface velocities, and up to five digits in particle forces and torques, for all separations down to a thousandth of the radius. In the special case of flows around fixed particles, the proxy sphere alone gives controlled accuracy. A one-body preconditioning strategy allows acceleration with the fast multipole method, hence close to linear scaling in the number of particles. This is demonstrated by solving problems of up to 2000 spheres on a workstation using only 700 proxy sources per particle.

Show Abstract

Counterfactual Learning of Stochastic Policies with Continuous Actions

Houssam Zenati , A. Bietti, Matthieu Martin, Eustache Diemert, Julien Mairal

Counterfactual reasoning from logged data has become increasingly important for many applications such as web advertising or healthcare. In this paper, we address the problem of counterfactual risk minimization (CRM) for learning a stochastic policy with continuous actions, whereas most existing work has focused on the discrete setting. Switching from discrete to continuous action spaces presents several difficulties as naive discretization strategies have been shown to perform poorly. To deal with this issue, we first introduce an effective contextual modelling strategy that learns a joint representation of contexts and actions based on positive definite kernels. Second, we empirically show that the optimization perspective of CRM is more important than previously thought, and we demonstrate the benefits of proximal point algorithms and differentiable estimators. Finally, we propose an evaluation protocol for offline policies in real-world logged systems, which is challenging since policies cannot be replayed on test data, and we release a new large-scale dataset along with multiple synthetic, yet realistic, evaluation setups.

Show Abstract

Identifying new classes of financial price jumps with wavelets

Cecilia Aubrun, R. Morel, Michael Benzaquen, Jean-Philippe Bouchaud

We introduce an unsupervised classification framework that leverages a multiscale wavelet representation of time-series and apply it to stock price jumps. In line with previous work, we recover the fact that time-asymmetry of volatility is the major feature that separates exogenous, news-induced jumps from endogenously generated jumps. Local mean-reversion and trend are found to be two additional key features, allowing us to identify new classes of jumps. Using our wavelet-based representation, we investigate the endogenous or exogenous nature of cojumps, which occur when multiple stocks experience price jumps within the same minute. Perhaps surprisingly, our analysis suggests that a significant fraction of cojumps result from an endogenous contagion mechanism.

Show Abstract
  • Previous Page
  • Viewing
  • Next Page
Advancing Research in Basic Science and MathematicsSubscribe to Flatiron Institute announcements and other foundation updates