Search

What are you looking for?

  1. Spontaneous behaviour is structured by reinforcement without explicit reward

    Publication

  2. ​​Striatal dopamine explains novelty-induced behavioral dynamics and individual variability in threat prediction

    Publication
    Animals both explore and avoid novel objects in the environment, but the neural mechanisms that underlie these behaviors and their dynamics remain uncharacterized. Here, we used multi-point …

  3. A gradual temporal shift of dopamine responses mirrors the progression of temporal difference error in machine learning

    Publication
    A large body of evidence has indicated that the phasic responses of midbrain dopamine neurons show a remarkable similarity to a type of teaching signal (temporal difference (TD …

  4. The role of state uncertainty in the dynamics of dopamine

    Publication
    Reinforcement learning models of the basal ganglia map the phasic dopamine signal to reward prediction errors (RPEs). Conventional models assert that, when a stimulus predicts a reward with …

  5. Distinct temporal difference error signals in dopamine axons in three regions of the striatum in a decision-making task

    Publication
    Different regions of the striatum regulate different types of behavior. However, how dopamine signals differ across striatal regions and how dopamine regulates different behaviors remain unclear. Here, we …

  6. A Unified Framework for Dopamine Signals across Timescales

    Publication
    Rapid phasic activity of midbrain dopamine neurons is thought to signal reward prediction errors (RPEs), resembling temporal difference errors used in machine learning. However, recent studies describing slowly …

  7. Dopamine signals as temporal difference errors: recent advances

    Publication
    In the brain, dopamine is thought to drive reward-based learning by signaling temporal difference reward prediction errors (TD errors), a 'teaching signal' used to train computers. Recent …

  8. Distributional Reinforcement Learning in the Brain

    Publication
    Learning about rewards and punishments is critical for survival. Classical studies have demonstrated an impressive correspondence between the firing of dopamine neurons in the mammalian midbrain and the …

  9. A distributional code for value in dopamine-based reinforcement learning

    Publication
    Since its introduction, the reward prediction error theory of dopamine has explained a wealth of empirical phenomena, providing a unifying framework for understanding the representation of reward and …

  10. Believing in dopamine

    Publication
    Midbrain dopamine signals are widely thought to report reward prediction errors that drive learning in the basal ganglia. However, dopamine has also been implicated in various probabilistic computations …

  11. Multiple Dopamine Systems: Weal and Woe of Dopamine.

    Publication
    The ability to predict future outcomes increases the fitness of the animal. Decades of research have shown that dopamine neurons broadcast reward prediction error (RPE) signals-the discrepancy …

  12. Dopamine neurons projecting to the posterior striatum reinforce avoidance of threatening stimuli

    Publication
    Midbrain dopamine neurons are well known for their role in reward-based reinforcement learning. We found that the activity of dopamine axons in the posterior tail of the …

  13. Belief state representation in the dopamine system.

    Publication
    Learning to predict future outcomes is critical for driving appropriate behaviors. Reinforcement learning (RL) models have successfully accounted for such learning, relying on reward prediction errors (RPEs) signaled …

  14. The Medial Prefrontal Cortex Shapes Dopamine Reward Prediction Errors under State Uncertainty.

    Publication
    Animals make predictions based on currently available information. In natural settings, sensory cues may not reveal complete information, requiring the animal to infer the "hidden state" of the …

  15. Opposite initialization to novel cues in dopamine signaling in ventral and posterior striatum in mice.

    Publication
    Dopamine neurons are thought to encode novelty in addition to reward prediction error (the discrepancy between actual and predicted values). In this study, we compared dopamine activity across …