2697 Publications

Decoupled Greedy Learning of CNNs

Eugene Belilovsky, M. Eickenberg, Edouard Oyallon

A commonly cited inefficiency of neural network training by back-propagation is the update locking problem: each layer must wait for the signal to propagate through the full network before updating. Several alternatives that can alleviate this issue have been proposed. In this context, we consider a simpler, but more effective, substitute that uses minimal feedback, which we call Decoupled Greedy Learning (DGL). It is based on a greedy relaxation of the joint training objective, recently shown to be effective in the context of Convolutional Neural Networks (CNNs) on large-scale image classification. We consider an optimization of this objective that permits us to decouple the layer training, allowing for layers or modules in networks to be trained with a potentially linear parallelization in layers. With the use of a replay buffer we show this approach can be extended to asynchronous settings, where modules can operate with possibly large communication delays. We show theoretically and empirically that this approach converges. Then, we empirically find that it can lead to better generalization than sequential greedy optimization. We demonstrate the effectiveness of DGL against alternative approaches on the CIFAR-10 dataset and on the large-scale ImageNet dataset.

Show Abstract
June 19, 2019

Capturing vacuum fluctuations and photon correlations in cavity quantum electrodynamics with multitrajectory Ehrenfest dynamics

Norah M. Hoffmann, Christian Schäfer, A. Rubio, Aaron Kelly, Heiko Appel

We describe vacuum fluctuations and photon-field correlations in interacting quantum mechanical light-matter systems by generalizing the application of mixed quantum classical dynamics techniques. We employ the multitrajectory implementation of Ehrenfest mean-field theory, traditionally developed for electron-nuclear problems, to simulate the spontaneous emission of radiation in a model quantum electrodynamical cavity-bound atomic system. We investigate the performance of this approach in capturing the dynamics of spontaneous emission from the perspective of both the atomic system and the cavity photon field through a detailed comparison with exact benchmark quantum mechanical observables and correlation functions. By properly accounting for the quantum statistics of the vacuum field, while using mixed quantum classical (mean-field) trajectories to describe the evolution, we identify a surprisingly accurate and promising route towards describing quantum effects in realistic correlated light-matter systems.

Show Abstract

Microscopic theory for the light-induced anomalous Hall effect in graphene

S. A. Sato, J. W. McIver, M. Nuske, P. Tang, G. Jotzu, B. Schulte, H. Hübener, U. De Giovannini, L. Mathey, M. A. Sentef, A. Cavalleri, A. Rubio

We employ a quantum Liouville equation with relaxation to model the recently observed anomalous Hall effect in graphene irradiated by an ultrafast pulse of circularly polarized light. In the weak-field regime, we demonstrate that the Hall effect originates from an asymmetric population of photocarriers in the Dirac bands. By contrast, in the strong-field regime, the system is driven into a nonequilibrium steady state that is well described by topologically nontrivial Floquet-Bloch bands. Here, the anomalous Hall current originates from the combination of a population imbalance in these dressed bands together with a smaller anomalous velocity contribution arising from their Berry curvature. This robust and general finding enables the simulation of electrical transport from light-induced Floquet-Bloch bands in an experimentally relevant parameter regime and creates a pathway to designing ultrafast quantum devices with Floquet-engineered transport properties.

Show Abstract

Microbial networks in SPRING — Semi-parametric rank-based correlation and partial correlation estimation for quantitative microbiome data

Grace Yoon, Irina Gaynanova, C. Müller

High-throughput microbial sequencing techniques, such as targeted amplicon-based and metagenomic profiling, provide low-cost genomic survey data of microbial communities in their natural environment, ranging from marine ecosystems to host-associated habitats. While standard microbiome profiling data can provide sparse relative abundances of operational taxonomic units or genes, recent advances in experimental protocols give a more quantitative picture of microbial communities by pairing sequencing-based techniques with orthogonal measurements of microbial cell counts from the same sample. These tandem measurements provide absolute microbial count data albeit with a large excess of zeros due to limited sequencing depth. In this contribution we consider the fundamental statistical problem of estimating correlations and partial correlations from such quantitative microbiome data. To this end, we propose a semi-parametric rank-based approach to correlation estimation that can naturally deal with the excess zeros in the data. Combining this estimator with sparse graphical modeling techniques leads to the Semi-Parametric Rank-based approach for INference in Graphical model (SPRING). SPRING enables inference of statistical microbial association networks from quantitative microbiome data which can serve as high-level statistical summary of the underlying microbial ecosystem and can provide testable hypotheses for functional species-species interactions. Due to the absence of verified microbial associations we also introduce a novel quantitative microbiome data generation mechanism which mimics empirical marginal distributions of measured count data while simultaneously allowing user-specified dependencies among the variables. SPRING shows superior network recovery performance on a wide range of realistic benchmark problems with varying network topologies and is robust to misspecifications of the total cell count estimate. To highlight SPRING's broad applicability we infer taxon-taxon associations from the American Gut Project data and genus-genus associations from a recent quantitative gut microbiome dataset. We believe that, as quantitative microbiome profiling data will become increasingly available, the semi-parametric estimators for correlation and partial correlation estimation introduced here provide an important tool for reliable statistical analysis of quantitative microbiome data.

Show Abstract

Detecting Thin Stellar Streams in External Galaxies: Resolved Stars & Integrated Light

S. Pearson, T. Starkenburg, K. Johnston, BF Williams, RA Ibata

The morphology of thin stellar streams can be used to test the nature of dark matter. It is therefore crucial to extend searches for globular cluster streams to other galaxies than the Milky Way. In this paper, we investigate the current and future prospects of detecting globular cluster streams in external galaxies in resolved stars (e.g. with WFIRST) and using integrated light (e.g. with HSC, LSST and Euclid). In particular, we inject mock-streams to data from the PAndAS M31 survey, and produce simulated M31 backgrounds mimicking what WFIRST will observe in M31. Additionally, we estimate the distance limit to which globular cluster streams will be observable. Our results demonstrate that for a 1 hour (1000 sec.) exposure, using conservative estimates, WFIRST should detect globular cluster streams in resolved stars in galaxies out to distances of ~3.5 Mpc (~2 Mpc). This volume contains 199 (122) galaxies of which >90% are dwarfs. With integrated light, thin streams can be resolved out to ~100 Mpc with HSC and LSST and to ~600 Mpc with WFIRST and Euclid. The low surface brightness of the streams (typically >30 mag/arcsec2), however, will make them difficult to detect, unless the streams originate from very young clusters. We emphasize that if the external galaxies do not host spiral arms or galactic bars, gaps in their stellar streams provide an ideal test case for evidence of interactions with dark matter subhalos. Furthermore, obtaining a large samples of thin stellar streams can help constrain the orbital structure and hence the potentials of external halos.

Show Abstract
June 7, 2019

High-resolution photoemission on Sr2RuO4 reveals correlation-enhanced effective spin-orbit coupling and dominantly local self-energies

A. Tamai, M. Zingl, E. Rozbicki, E. Cappelli, S. Ricco, A. de la Torre, S. McKeown Walker, F. Y. Bruno, P. D. C. King, W. Meevasana, M. Shi, M. Radovic, N. C. Plumb, A. S. Gibbs, A. P. Mackenzie, C. Berthod, H. Strand, M. Kim, A. Georges, F. Baumberger

We explore the interplay of electron-electron correlations and spin-orbit coupling in the model Fermi liquid Sr2RuO4 using laser-based angle-resolved photoemission spectroscopy. Our precise measurement of the Fermi surface confirms the importance of spin-orbit coupling in this material and reveals that its effective value is enhanced by a factor of about two, due to electronic correlations. The self-energies for the β and γ sheets are found to display significant angular dependence. By taking into account the multi-orbital composition of quasiparticle states, we determine self-energies associated with each orbital component directly from the experimental data. This analysis demonstrates that the perceived angular dependence does not imply momentum-dependent many-body effects, but arises from a substantial orbital mixing induced by spin-orbit coupling. A comparison to single-site dynamical mean-field theory further supports the notion of dominantly local orbital self-energies, and provides strong evidence for an electronic origin of the observed non-linear frequency dependence of the self-energies, leading to `kinks' in the quasiparticle dispersion of Sr2RuO4.

Show Abstract

Reaching the continuum limit in finite-temperature ab initio field-theory computations in many-fermion systems

Finite-temperature, grand-canonical computations based on field theory are widely applied in areas including condensed matter physics, ultracold atomic gas systems, and lattice gauge theory. However, these calculations have computational costs scaling as $N_s^3$ with the size of the lattice or basis set, $N_s$. We report a new approach based on systematically controllable low-rank factorization which reduces the scaling of such computations to $N_s N_e^2$, where $N_e$ is the average number of fermions in the system. In any realistic calculations aiming to describe the continuum limit, $N_s/N_e$ is large and needs to be extrapolated effectively to infinity for convergence. The method thus fundamentally changes the prospect for finite-temperature many-body computations in correlated fermion systems. Its application, in combination with frameworks to control the sign or phase problem as needed, will provide a powerful tool in {\it ab initio} quantum chemistry and correlated electron materials. We demonstrate the method by computing exact properties of the two-dimensional Fermi gas with zero-range attractive interaction, as a function of temperature in both the normal and superfluid states.

Show Abstract
June 6, 2019
  • Previous Page
  • Viewing
  • Next Page
Advancing Research in Basic Science and MathematicsSubscribe to Flatiron Institute announcements and other foundation updates