2697 Publications

Responses of neurons in macaque V4 to object and texture images

Justin D. Lieber, T. D. Oleskiw , E. P. Simoncelli, J. A. Movshon

Humans and monkeys can effortlessly recognize objects in everyday scenes. This ability relies on neural computations in the ventral stream of visual cortex. The intermediate computations that lead to object selectivity are not well understood, but previous studies implicate V4 as an early site of selectivity for object shape. To explore the mechanisms of this selectivity, we generated a continuum of images between “scrambled” textures and photographic images of both natural and manmade environments, using techniques that preserve the local statistics of the original image while discarding information about scene and shape. We measured the responses of single units in awake macaque V4 to these images. On average, V4 neurons were slightly more active in response to photographic images than to their scrambled counterparts. However, responses in V4 varied widely both across different cells and different sets of images. An important determinant of this variation was the effectiveness of image families at driving strong neural responses. Across the full V4 population, a cell’s average evoked firing rate for a family reliably predicted that family’s preference for photographic over scrambled images. Accordingly, the cells that respond most strongly to each image family showed a much stronger difference between photographic and scrambled images and a graded level of modulation for images scrambled at intermediate levels. This preference for photographic images was not evident until ∼50 ms after the onset of neuronal activity and did not peak in strength until 140 ms after activity onset. Finally, V4 neural responses seemed to categorically separate photographic images from all of their scrambled counterparts, despite the fact that the least scrambled images in our set appear similar to the originals. When these same images were analyzed with DISTS (Deep Image Structure and Texture Similarity), an image-computable similarity metric that predicts human judgements of image degradation, this same pattern emerged. This suggests that V4 responses are highly sensitive to small deviations from photographic image structure.

Show Abstract

Nonlinear spiked covariance matrices and signal propagation in deep neural networks

Zhichao Wang, D. Wu, Zhou Fan

Many recent works have studied the eigenvalue spectrum of the Conjugate Kernel (CK) def ined by the nonlinear feature map of a feedforward neural network. However, existing results only establish weak convergence of the empirical eigenvalue distribution, and fall short of providing precise quantitative characterizations of the “spike” eigenvalues and eigenvectors that often capture the low-dimensional signal structure of the learning problem. In this work, we characterize these signal eigenvalues and eigenvectors for a nonlinear version of the spiked covariance model, including the CK as a special case. Using this general result, we give a quantitative description of how spiked eigenstructure in the input data propagates through the hidden layers of a neural network with random weights. As a second application, we study a simple regime of representation learning where the weight matrix develops a rank-one signal component over training and characterize the alignment of the target function with the spike eigenvector of the CK on test data.

Show Abstract

Tapioca: a platform for predicting de novo protein–protein interactions in dynamic contexts

Tavis J. Reed, Matthew D. Tyl, O. Troyanskaya, et al.

Protein–protein interactions (PPIs) drive cellular processes and responses to environmental cues, reflecting the cellular state. Here we develop Tapioca, an ensemble machine learning framework for studying global PPIs in dynamic contexts. Tapioca predicts de novo interactions by integrating mass spectrometry interactome data from thermal/ion denaturation or cofractionation workflows with protein properties and tissue-specific functional networks. Focusing on the thermal proximity coaggregation method, we improved the experimental workflow. Finely tuned thermal denaturation afforded increased throughput, while cell lysis optimization enhanced protein detection from different subcellular compartments. The Tapioca workflow was next leveraged to investigate viral infection dynamics. Temporal PPIs were characterized during the reactivation from latency of the oncogenic Kaposi’s sarcoma-associated herpesvirus. Together with functional assays, NUCKS was identified as a proviral hub protein, and a broader role was uncovered by integrating PPI networks from alpha- and betaherpesvirus infections. Altogether, Tapioca provides a web-accessible platform for predicting PPIs in dynamic contexts.

Show Abstract

To be or not to be: orb, the fusome and oocyte specification in Drosophila

In the fruit fly Drosophila melanogaster, two cells in a cyst of 16 interconnected cells have the potential to become the oocyte, but only one of these will assume an oocyte fate as the cysts transition through regions 2a and 2b of the germarium. The mechanism of specification depends on a polarized microtubule network, a dynein dependent Egl:BicD mRNA cargo complex, a special membranous structure called the fusome and its associated proteins, and the translational regulator orb. In this work, we have investigated the role of orb and the fusome in oocyte specification. We show here that specification is a stepwise process. Initially, orb mRNAs accumulate in the two pro-oocytes in close association with the fusome. This association is accompanied by the activation of the orb autoregulatory loop, generating high levels of Orb. Subsequently, orb mRNAs become enriched in only one of the pro-oocytes, the presumptive oocyte, and this is followed, with a delay, by Orb localization to the oocyte. We find that fusome association of orb mRNAs is essential for oocyte specification in the germarium, is mediated by the orb 3′ UTR, and requires Orb protein. We also show that the microtubule minus end binding protein Patronin functions downstream of orb in oocyte specification. Finally, in contrast to a previously proposed model for oocyte selection, we find that the choice of which pro-oocyte becomes the oocyte does not seem to be predetermined by the amount of fusome material in these two cells, but instead depends upon a competition for orb gene products.

Show Abstract
February 12, 2024

For how many iterations should we run Markov chain Monte Carlo?

C. Margossian, Andrew Gelman

Standard Markov chain Monte Carlo (MCMC) admits three fundamental control parameters: the number of chains, the length of the warmup phase, and the length of the sampling phase. These control parameters play a large role in determining the amount of computation we deploy. In practice, we need to walk a line between achieving sufficient precision and not wasting precious computational resources and time. We review general strategies to check the length of the warmup and sampling phases, and examine the three control parameters of MCMC in the contexts of CPU- and GPU-based hardware. Our discussion centers around three tasks: (1) inference about a latent variable, (2) computation of expectation values and quantiles, and (3) diagnostics to check the reliability of the estimators. This chapter begins with general recommendations on the control parameters of MCMC, which have been battle-tested over the years and often motivate defaults in Bayesian statistical software. Usually we do not know ahead of time how a sampler will interact with a target distribution, and so the choice of MCMC algorithm and its control parameters, tend to be based on experience, re-evaluated after simulations have been obtained and analyzed. The second part of this chapter provides a theoretical motivation for our recommended approach, with pointers to some concerns and open problems. We also examine recent developments on the algorithmic and hardware fronts, which motivate new computational approaches to MCMC.

Show Abstract

Design of Perfectly Conducting Objects That Are Invisible to an Incident Plane Wave

Johan Helsing, S. Jiang, Anders Karlsson

This work concerns the design of perfectly conducting objects that are invisible to an incident transverse magnetic plane wave. The object in question is a finite planar waveguide with a finite periodic array of barriers. By optimizing this array, the amplitude of the scattered field is reduced to less than 10−9 times the amplitude of the incident plane wave everywhere outside the waveguide. To accurately evaluate such minute amplitudes, we employ a recently developed boundary integral equation technique, adapted for objects whose boundaries have endpoints, corners, and branch points.

Show Abstract

Metal-Insulator Transition in a Semiconductor Heterobilayer Model

Transition metal dichalcogenide superlattices provide an exciting new platform for exploring and understanding a variety of phases of matter. The moiré continuum Hamiltonian, of two-dimensional jellium in a modulating potential, provides a fundamental model for such systems. Accurate computations with this model are essential for interpreting experimental observations and making predictions for future explorations. In this work, we combine two complementary quantum Monte Carlo (QMC) methods, phaseless auxiliary field quantum Monte Carlo and fixed-phase diffusion Monte Carlo, to study the ground state of this Hamiltonian. We observe a metal-insulator transition between a paramagnetic and a 120° Néel ordered state as the moiré potential depth and the interaction strength are varied. We find significant differences from existing results by Hartree-Fock and exact diagonalization studies. In addition, we benchmark density-functional theory, and suggest an optimal hybrid functional which best approximates our QMC results.
Show Abstract
February 1, 2024

Deep reinforcement learning in finite-horizon to explore the most probable transition pathway

Jin Guo, Ting Gao, Peng Zhang, J. Han, Jinqiao Duan

In many scientific and engineering problems, noise and nonlinearity are unavoidable, which could induce interesting mathematical problem such as transition phenomena. This paper focuses on efficiently discovering the most probable transition pathway for stochastic dynamical systems employing reinforcement learning. With the Onsager–Machlup action functional theory to quantify rare events in stochastic dynamical systems, finding the most probable pathway is equivalent to solving a variational problem on the action functional. When the action function cannot be explicitly expressed by paths near the reference orbit, the variational problem needs to be converted into an optimal control problem. First, by integrating terminal prediction into the reinforcement learning framework, we develop a Terminal Prediction Deep Deterministic Policy Gradient (TP-DDPG) algorithm to deal with the finite-horizon optimal control issue in a forward way. Next, we present the convergence analysis of our algorithm for the value function in terms of the neural network’s approximation error and estimation error. Finally, we conduct various experiments in different dimensions for the transition problems in applications to illustrate the effectiveness of our algorithm.

Show Abstract

Molecular Signatures of Glomerular Neovascularization in a Patient with Diabetic Kidney Disease

Michael J. Ferkowicz, Ashish Verma, R. Sealfon

The Kidney Precision Medicine Project (KPMP) aims to create a kidney tissue atlas, define disease subgroups, and identify critical cells, pathways, and targets for novel therapies through molecular investigation of human kidney biopsies obtained from participants with AKI or CKD. We present the case of a 66-year-old woman with diabetic kidney disease who underwent a protocol KPMP kidney biopsy. Her clinical history included diabetes mellitus complicated by neuropathy and eye disease, increased insulin resistance, hypertension, albuminuria, and relatively preserved glomerular filtration rate (early CKD stage 3a). The patient's histopathology was consistent with diabetic nephropathy and arterial and arteriolar sclerosis. Three-dimensional, immunofluorescence imaging of the kidney biopsy specimen revealed extensive periglomerular neovascularization that was underestimated by standard histopathologic approaches. Spatial transcriptomics was performed to obtain gene expression signatures at discrete areas of the kidney biopsy. Gene expression in the areas of glomerular neovascularization revealed increased expression of genes involved in angiogenic signaling, proliferation, and survival of endothelial cells, as well as new vessel maturation and stability. This molecular correlation provides additional insights into the development of kidney disease in patients with diabetes and spotlights how novel molecular techniques used by the KPMP can supplement and enrich the histopathologic diagnosis obtained from a kidney biopsy.

Show Abstract

Anillin-related Mid1 as an adaptive and multimodal contractile ring anchoring protein: A simulation study

Aaron Hall, Dimitrios Vavylonis, et al.

Cytokinesis of animal and fungi cells depends crucially on the anillin scaffold proteins. Fission yeast anillin-related Mid1 anchors cytokinetic ring precursor nodes to the membrane. However, it is unclear if both of its Pleckstrin Homology (PH) and C2 C-terminal domains bind to the membrane as monomers or dimers, and if one domain plays a dominant role. We studied Mid1 membrane binding with all-atom molecular dynamics near a membrane with yeast-like lipid composition. In simulations with the full C terminal region started away from the membrane, Mid1 binds through the disordered L3 loop of C2 in a vertical orientation, with the PH away from the membrane. However, a configuration with both C2 and PH initially bound to the membrane remains associated with the membrane. Simulations of C2-PH dimers show extensive asymmetric membrane contacts. These multiple modes of binding may reflect Mid1’s multiple interactions with membranes, node proteins, and ability to sustain mechanical forces.

Show Abstract
  • Previous Page
  • Viewing
  • Next Page
Advancing Research in Basic Science and MathematicsSubscribe to Flatiron Institute announcements and other foundation updates