2573 Publications

Simple lessons from complex learning: what a neural network model learns about cosmic structure formation

D. Jamieson, Y. Li, S. He, F. Villaescusa-Navarro, S. Ho, R. Alves de Oliveira, D. Spergel

We train a neural network model to predict the full phase space evolution of cosmological N-body simulations. Its success implies that the neural network model is accurately approximating the Green's function expansion that relates the initial conditions of the simulations to its outcome at later times in the deeply nonlinear regime. We test the accuracy of this approximation by assessing its performance on well understood simple cases that have either known exact solutions or well understood expansions. These scenarios include spherical configurations, isolated plane waves, and two interacting plane waves: initial conditions that are very different from the Gaussian random fields used for training. We find our model generalizes well to these well understood scenarios, demonstrating that the networks have inferred general physical principles and learned the nonlinear mode couplings from the complex, random Gaussian training data. These tests also provide a useful diagnostic for finding the model's strengths and weaknesses, and identifying strategies for model improvement. We also test the model on initial conditions that contain only transverse modes, a family of modes that differ not only in their phases but also in their evolution from the longitudinal growing modes used in the training set. When the network encounters these initial conditions that are orthogonal to the training set, the model fails completely. In addition to these simple configurations, we evaluate the model's predictions for the density, displacement, and momentum power spectra with standard initial conditions for N-body simulations. We compare these summary statistics against N-body results and an approximate, fast simulation method called COLA. Our model achieves percent level accuracy at nonlinear scales of $$k ∼ 1 Mpc −1 h,$$ representing a significant improvement over COLA.

Show Abstract

Parallel Discrete Convolutions on Adaptive Particle Representations of Images

Joel Jonsson, S. Maddu, et al.

We present data structures and algorithms for native implementations of discrete convolution operators over Adaptive Particle Representations (APR) of images on parallel computer architectures. The APR is a content-adaptive image representation that locally adapts the sampling resolution to the image signal. It has been developed as an alternative to pixel representations for large, sparse images as they typically occur in fluorescence microscopy. It has been shown to reduce the memory and runtime costs of storing, visualizing, and processing such images. This, however, requires that image processing natively operates on APRs, without intermediately reverting to pixels. Designing efficient and scalable APR-native image processing primitives, however, is complicated by the APR’s irregular memory structure. Here, we provide the algorithmic building blocks required to efficiently and natively process APR images using a wide range of algorithms that can be formulated in terms of discrete convolutions. We show that APR convolution naturally leads to scale-adaptive algorithms that efficiently parallelize on multi-core CPU and GPU architectures. We quantify the speedups in comparison to pixel-based algorithms and convolutions on evenly sampled data. We achieve pixel-equivalent throughputs of up to 1TB/s on a single Nvidia GeForce RTX 2080 gaming GPU, requiring up to two orders of magnitude less memory than a pixel-based implementation.

Show Abstract

Discrete Lehmann representation of imaginary time Green’s functions

We present an efficient basis for imaginary time Green's functions based on a low rank decomposition of the spectral Lehmann representation. The basis functions are simply a set of well-chosen exponentials, so the corresponding expansion may be thought of as a discrete form of the Lehmann representation using an effective spectral density which is a sum of δ functions. The basis is determined only by an upper bound on the product βωmax, with β the inverse temperature and ωmax an energy cutoff, and a user-defined error tolerance ϵ. The number r of basis functions scales as (log(βωmax)log(1/ϵ)). The discrete Lehmann representation of a particular imaginary time Green's function can be recovered by interpolation at a set of r imaginary time nodes. Both the basis functions and the interpolation nodes can be obtained rapidly using standard numerical linear algebra routines. Due to the simple form of the basis, the discrete Lehmann representation of a Green's function can be explicitly transformed to the Matsubara frequency domain, or obtained directly by interpolation on a Matsubara frequency grid. We benchmark the efficiency of the representation on simple cases, and with a high precision solution of the Sachdev-Ye-Kitaev equation at low temperature. We compare our approach with the related intermediate representation method, and introduce an improved algorithm to build the intermediate representation basis and a corresponding sampling grid.

Show Abstract

Field Level Neural Network Emulator for Cosmological N-body Simulations

D. Jamieson, Y. Li, R. Alves de Oliveira, F. Villaescusa-Navarro, S. Ho, D. Spergel

We build a field level emulator for cosmic structure formation that is accurate in the nonlinear regime. Our emulator consists of two convolutional neural networks trained to output the nonlinear displacements and velocities of N-body simulation particles based on their linear inputs. Cosmology dependence is encoded in the form of style parameters at each layer of the neural network, enabling the emulator to effectively interpolate the outcomes of structure formation between different flat ΛCDM cosmologies over a wide range of background matter densities. The neural network architecture makes the model differentiable by construction, providing a powerful tool for fast field level inference. We test the accuracy of our method by considering several summary statistics, including the density power spectrum with and without redshift space distortions, the displacement power spectrum, the momentum power spectrum, the density bispectrum, halo abundances, and halo profiles with and without redshift space distortions. We compare these statistics from our emulator with the full N-body results, the COLA method, and a fiducial neural network with no cosmological dependence. We find our emulator gives accurate results down to scales of $$k ∼ 1 Mpc −1 h,$$ representing a considerable improvement over both COLA and the fiducial neural network. We also demonstrate that our emulator generalizes well to initial conditions containing primordial non-Gaussianity, without the need for any additional style parameters or retraining.

Show Abstract

A reference tissue atlas for the human kidney

Jens Hansen, R. Sealfon, O. Troyanskaya, et al.

Kidney Precision Medicine Project (KPMP) is building a spatially specified human kidney tissue atlas in health and disease with single-cell resolution. Here, we describe the construction of an integrated reference map of cells, pathways, and genes using unaffected regions of nephrectomy tissues and undiseased human biopsies from 56 adult subjects. We use single-cell/nucleus transcriptomics, subsegmental laser microdissection transcriptomics and proteomics, near-single-cell proteomics, 3D and CODEX imaging, and spatial metabolomics to hierarchically identify genes, pathways, and cells. Integrated data from these different technologies coherently identify cell types/subtypes within different nephron segments and the interstitium. These profiles describe cell-level functional organization of the kidney following its physiological functions and link cell subtypes to genes, proteins, metabolites, and pathways. They further show that messenger RNA levels along the nephron are congruent with the subsegmental physiological activity. This reference atlas provides a framework for the classification of kidney disease when multiple molecular mechanisms underlie convergent clinical phenotypes.

Show Abstract

Randomized Iterative Methods for Low-Complexity Large-Scale MIMO Detection

Zheng Wang, R. M. Gower, Yili Xia, Lanxin He, Yongming Huang

In this paper, we introduce a randomized iterative method for signal detection in uplink large-scale multiple-input multiple-output (MIMO) systems, which not only achieves a low computational complexity but also enjoys a global and exponentially fast convergence. First of all, by adopting the random sampling into the iterations, the randomized iterative detection algorithm (RIDA) is proposed for large-scale MIMO systems. We show that RIDA converges exponentially fast in terms of mean squared error (MSE). Furthermore, this global convergence always holds, and does not depend on the standard requirements such as N≫K , where N and K denote the numbers of antennas at the sides of base station and users. This broadly extends the applications of low-complexity detection in uplink large-scale MIMO systems. Then, based on a new conditional sampling, optimization and enhancements are given to further improve both the convergence and efficiency of RIDA, resulting in the modified randomized iterative detection algorithm (MRIDA). Meanwhile, with respect to MRIDA, further complexity reduction by exploiting the matrix structure is given while its implementation by deep neural networks (DNN) is also presented for a better detection performance.

Show Abstract

The chemical enrichment of the Milky Way disk evaluated using conditional abundances

B. Ratcliffe, M. Ness

Chemical abundances of stars in the Milky Way disk are empirical tracers of its enrichment history. However, they capture joint-information that is valuable to disentangle. In this work, we seek to quantify how individual abundances evolve across the present-day radius of the disk, at fixed supernovae contribution ([Fe/H], [Mg/Fe]). We use 18,135 APOGEE DR17 red clump stars and 7,943 GALAH DR3 main sequence stars to compare the abundance distributions conditioned on ([Fe/H], [Mg/Fe]) across 3−13 kpc and 6.5−9.5 kpc, respectively. In total we examine 15 elements: C, N, Al, K (light), O, Si, S, Ca, (α), Mn, Ni, Cr, Cu, (iron-peak) Ce, Ba (s-process) and Eu (r-process). We find that the conditional neutron capture and light elements most significantly trace variations in the disk's enrichment history, with absolute conditional radial gradients ≤0.03 dex/kpc. The other elements studied have absolute conditional gradients ≲0.01 dex/kpc. We uncover structured conditional abundance variations as a function of [Fe/H] for the low-α, but not the high-α sequence. The average scatter between the mean conditional abundances at different radii is σintrinsic≈ 0.02 dex (with Ce, Eu, Ba σintrinsic> 0.05 dex). These results serve as a measure of the magnitude via which different elements trace Galactic radial enrichment history once fiducial supernovae correlations are accounted for. Furthermore, we uncover subtle systematic variations in all moments of the conditional abundance distributions that will presumably constrain chemical evolution models of the Galaxy.

Show Abstract
June 6, 2022

The In Situ Origins of Dwarf Stellar Outskirts in FIRE-2

E. Kado-Fong, R. Sanderson, J. E. Greene, E. Cunningham, C. Wheeler, T. K. Chan, K. El-Brady, P. F. Hopkins, A. Wetzel, M. Boylan-Kolchin, C-A. Faucher-Giguère, S. Huang, E. Quataert, T. Starkenburg

Extended, old, and round stellar halos appear to be ubiquitous around high-mass dwarf galaxies (108.5 < M⋆/M⊙ < 109.6) in the observed universe. However, it is unlikely that these dwarfs have undergone a sufficient number of minor mergers to form stellar halos that are composed of predominantly accreted stars. Here, we demonstrate that FIRE-2 (Feedback in Realistic Environments) cosmological zoom-in simulations are capable of producing dwarf galaxies with realistic structures, including both a thick disk and round stellar halo. Crucially, these stellar halos are formed in situ, largely via the outward migration of disk stars. However, there also exists a large population of "nondisky" dwarfs in FIRE-2 that lack a well-defined disk/halo and do not resemble the observed dwarf population. These nondisky dwarfs tend to be either more gas-poor or to have burstier recent star formation histories than the disky dwarfs, suggesting that star formation feedback may be preventing disk formation. Both classes of dwarfs underscore the power of a galaxy's intrinsic shape—which is a direct quantification of the distribution of the galaxy's stellar content—to interrogate the feedback implementation in simulated galaxies.

Show Abstract

Analytic Light Curves in Reflected Light: Phase Curves, Occultations, and Non-Lambertian Scattering for Spherical Planets and Moons

R. Luger, Eric Agol, F. Bartolić, D. Foreman-Mackey

We derive efficient, closed-form, differentiable, and numerically stable solutions for the flux measured from a spherical planet or moon seen in reflected light, either in or out of occultation. Our expressions apply to the computation of scattered light phase curves of exoplanets, secondary eclipse light) curves in the optical, or future measurements of planet–moon and planet–planet occultations, as well as to photometry of solar system bodies. We derive our solutions for Lambertian bodies illuminated by a point source, but extend them to model illumination sources of finite angular size and rough surfaces with phase-dependent scattering. Our algorithm is implemented in Python within the open-source starry mapping framework and is designed with efficient gradient-based inference in mind. The algorithm is ∼4–5 orders of magnitude faster than direct numerical evaluation methods and ∼10 orders of magnitude more precise. We show how the techniques developed here may one day lead to the construction of two-dimensional maps of terrestrial planet surfaces, potentially enabling the detection of continents and oceans on exoplanets in the habitable zone.

Show Abstract
  • Previous Page
  • Viewing
  • Next Page
Advancing Research in Basic Science and MathematicsSubscribe to Flatiron Institute announcements and other foundation updates

privacy consent banner

Privacy preference

We use cookies to provide you with the best online experience. By clicking "Accept All," you help us understand how our site is used and enhance its performance. You can change your choice at any time here. To learn more, please visit our Privacy Policy.