You are on page 1of 21

Letter doi:10.

1038/nature25457

Dopamine neuron activity before action initiation


gates and invigorates future movements
Joaquim Alves da Silva1,2, Fatuel Tecuapetla1,3, Vitor Paixão1 & Rui M. Costa1,2,4

Deciding when and whether to move is critical for survival. Loss of modulated neurons (Fig. 1e). These findings were corroborated using
dopamine neurons (DANs) of the substantia nigra pars compacta microendoscopic calcium imaging of SNc DANs in freely moving mice
(SNc) in patients with Parkinson’s disease causes deficits in (Extended Data Fig. 4; 22 neurons, see Methods and below for details).
movement initiation and slowness of movement1. The role of DANs We next examined whether the transient activity of individual
in self-paced movement has mostly been attributed to their tonic DANs before action initiation was tuned to the initiation of specific
activity, whereas phasic changes in DAN activity have been linked actions, or represented a more general signal before action initiation.
to reward prediction2,3. This model has recently been challenged by To characterize each spontaneous movement initiation, we built tra-
studies showing transient changes in DAN activity before or during jectories in the motion-sensor space using a combination of total body
self-paced movement initiation4–7. Nevertheless, the necessity of acceleration (correlated with displacement, see Extended Data Fig. 1),
this activity for spontaneous movement initiation has not been angular velocity (direction of movement) and gravitational acceleration
demonstrated, nor has its relation to initiation versus ongoing (postural changes)11 (Fig. 1f). Next, we used affinity propagation12 to
movement been described. Here we show that a large proportion of cluster similar movement initiations13 (Fig. 1g). We found that most
SNc DANs, which did not overlap with reward-responsive DANs, DANs were broadly tuned, and were transiently active before rather
transiently increased their activity before self-paced movement different initiations (Fig. 1h). Furthermore, we found that initiation
initiation in mice. This activity was not action-specific, and was trajectories preceded by increased activity of each DAN were as variable
related to the vigour of future movements. Inhibition of DANs when as all other initiation trajectories (Fig. 1i). These data strongly indicate
mice were immobile reduced the probability and vigour of future that the transient activity of individual DANs before initiation is not
movements. Conversely, brief activation of DANs when mice were very action-specific.
immobile increased the probability and vigour of future movements. Previous studies in patients with Parkinson’s disease14 and animal
Manipulations of dopamine activity after movement initiation did models15 have shown that dopamine depletion leads to less vigorous
not affect ongoing movements. Similar findings were observed for movements. We therefore investigated whether the activity of DANs
the initiation and execution of learned action sequences. These before movement initiation encoded information about the vigour of
findings causally implicate DAN activity before movement initiation the movement that was about to be initiated. We verified that overall,
in the probability and vigour of future movements. the activity of DANs 300 ms before movement initiation was signifi-
We quantified spontaneous motion of mice placed in an open field cantly related to the vigour of future movements (measured by body
(with no external cues, food deprivation or reward) by using inertial acceleration; Fig. 1j, k). When doing per-trial analyses comparing all
sensors that measure high-resolution acceleration and angular velocity the lower vigour with the higher vigour initiations, we found that 38.5%
(Fig. 1a). We found that the distribution of movements in an open field of the neurons had significantly higher activity before higher vigour
was not a continuum between arrest and motion, but rather a bimodal movements (Fig. 1l).
distribution (Fig. 1b and Extended Data Fig. 1). Using the m ­ inimum In order to test whether inhibiting DAN activity affects movement
acceleration between the two peaks of the bimodal distribution initiation, we expressed archaerhodopsin (ArchT)16 specifically in
(Fig. 1b), we could separate periods of immobility from periods of SNc neurons (AAV2/1.CAG.Flex.ArchT-GFP injected into TH-Cre
overt mobility (Fig. 1b and Extended Data Fig. 1), and precisely ­identify mice, Extended Data Fig. 5). We expressed ArchT in the SNc of 11
moments of spontaneous movement initiation. TH-Cre mice and YFP in the SNc of 9 TH-Cre mice (control group),
We investigated the activity of photoidentified SNc DANs in relation to and delivered light unpredictably for periods of 15 s (Fig. 2a). Inhibition
movement initiation by implanting 16-channel movable electrode bun- of SNc DANs increased the probability of mice being immobile
dles coupled to a fibre-optic cannula placed just above the SNc (Fig. 1a). (Fig. 2b, c). This was not observed in YFP controls (Fig. 2b, c). To inves-
We implanted these bundles in six TH-Cre mice8 (Extended Data tigate whether DAN inhibition mainly affected movement initiation or
Fig. 2a–c) crossed with Ai32 mice9 to obtain expression of channel- reduced ongoing movement, we investigated the effects of DAN inhi-
rhodopsin-2 (ChR2) in TH+ neurons, and used ­photoidentification10 bition in trials in which the mouse was immobile (for at least 300 ms),
to identify putative DANs (Extended Data Fig. 3, see Methods for or mobile (for at least 300 ms), when the inhibition started (Fig. 2d–h).
details). Next, we built peri-event time histograms (PETH) of their We found a significant impairment in movement initiation when
activity aligned to spontaneous movement initiations. We found that SNc DANs were inhibited during immobility (Fig. 2g). The effect of
the average activity of all recorded DANs increased transiently before inhibition was relatively rapid with a significant difference between
movement initiation (Fig. 1d). Consistently, we found that many light and no light after 2.4 s (Fig. 2e). Consistently, we also found that
photoidentified DANs were significantly modulated by movement 5 s of inhibition was sufficient to impair movement initiation (Extended
initiation and that the majority of these were positively modulated Data Fig. 6).
(Fig. 1d). The latency for modulation preceded the initiation of By contrast, there was no significant change in mean acceleration
movement for positively modulated neurons, but not for negatively when inhibition happened after movement onset (Fig. 2g). There was

1
Champalimaud Neuroscience Programme, Champalimaud Centre for the Unknown, Lisbon, Portugal. 2Nova Medical School, Faculdade de Ciências Médicas, Universidade Nova de Lisboa, Lisbon,
Portugal. 3Neuropatologia molecular, Instituto de Fisiología Celular, Universidad Nacional Autónoma de México, Mexico City, Mexico. 4Departments of Neuroscience and Neurology, Zuckerman
Mind Brain Behavior Institute, Columbia University, New York, New York, USA.

2 4 4 | N A T U R E | V O L 5 5 4 | 8 f e b ruar y 2 0 1 8
© 2018 Macmillan Publishers Limited, part of Springer Nature. All rights reserved.
Letter RESEARCH

a b 0.12
between laser-on and laser-off trials before the first stop. However,
Movable bundle- Threshold
there was clear impairment in movement initiation after the first stop

Normalized
recording array 0.08

counts
coupled to optical fibre
0.04
(Fig. 2i). This was not observed in YFP controls (Fig. 2j).
TH+ neurons 0 A more detailed analysis of the effects of inhibition when mice were
expressing ChR2 0.001 0.01 0.1
Acceleration ( g)
1
immobile revealed that there was a significant decrease in the prob-

acceleration ( g)
0.2 ability of initiating movement during the 15 s of inhibition (Fig. 2k).

Dynamic
Open field 0.1 Furthermore, even when mice were able to initiate movements, the
(39 cm × 39 cm)
0 latency to initiate was significantly higher than in laser-off trials, and
1s
c d e
the initiated movements were less vigorous (Fig. 2l, m). Taken together,
20 0.08 10 +
200 * these data indicate that DAN activity before movement initiation mod-
Firing rate (z score)


Acceleration ( g)

ulates the probability and vigour of future movements, but activity of


Firing rate (Hz)

Latency (ms)
15 0.06 No 0
5
10 0.04 20% –200 these neurons is less critical for the maintenance and vigour of ongoing
5 0.02
0
28%
52%
–400 movements.
0 0 –5 –600 * Next, we investigated whether brief activation of DANs, when
–1.5 0 1.5 n = 25
Time (s)
–1 0
Time (s)
1
­animals were immobile, would be sufficient to promote movement
initiation. We expressed ChR2 in SNc DANs using a similar Cre-
f g h 80 i 10 dependent strategy (DIO-ChR2-YFP in seven mice, and control DIO-
acceleration (g)

60 8 eYFP in five mice). Stimulation at 20 Hz for 500 ms (Fig. 3a) delivered


spread (AU)
Percentage
of neurons
Dynamic

0.8 Initiations 6
0 40
4
when mice were immobile was sufficient to produce overt movement
×104
ac
0.6
0
–1.5
20 2 that lasted several seconds (Fig. 3b), in accordance with previous
ce Stat
ler ic –0.6 2
ati
0 ive
mu
lat city 0
1 2 3 4 ≥5
0
Not ­findings7,17,18. The same activation when mice were overtly moving
Cu r velo Active
on
(g) ula –1 )
ang (dg s
Number of
initiation clusters
active
did not significantly affect ongoing acceleration (Fig. 3b, c).
To further corroborate this finding, we performed an online closed-
*
j 3.0 k 30 20 l loop experiment in which mice received stimulation if they were
2.5
Firing rate (Hz)

15 ­immobile for at least 900 ms (in 50% of the trials, Fig. 3d). Trials in which
Normalized

2.0
firing rate

20
38.5%
1.5
1.0 10
10
61.5% light was not delivered (50%) were used as within-animal control (laser-
5
0.5
0 0
off trials). Average acceleration during the first second after the closed-
0 –1.5 0
Time (s)
1.5 –1.5 0
Time (s)
1.5 n = 13
loop trigger was higher during laser-on than during laser-off trials in
M

H m
Lo

ig

the ChR2 group (Fig. 3e–g). Moreover, the latency to initiate movement
ed
w

h
iu

Figure 1 | Movement initiation is preceded by increased activity of when SNc DANs were briefly activated was almost three times shorter
dopamine neurons. a, Top left, photoidentification schematics. Top than in laser-off trials (Fig. 3h). The percentage of trials in which move-
right, movable bundle electrode array with fibre-optic cannula. Bottom, ment was initiated during the first second was also higher in laser-on
open field set-up. The mouse brain schematic in this panel has been re- trials (Fig. 3i). We found no evidence that this closed-loop SNc DAN
drawn with permission from ref. 31. b, Top, distribution of total dynamic activation had a reinforcement effect, because immobility states did
acceleration in the open field (mean in blue; 3 ± 2.2 one-hour open- not become more frequent in ChR2 mice (interval between immobility
field sessions per mouse, n = 6 mice). Bottom, examples of movement ­periods: ChR2, 254.5 ±​ 116.5 s; YFP, 150.5 ±​ 65.8 s; t =​  1.74, P =​  0.12). We
initiation events (red). Dotted line represents acceleration threshold.
found that movements initiated during laser-on trials were more vigorous
c, PETH of a positively modulated DAN aligned to movement initiation.
d, Left, mean trace for all neurons (n = 25, black), positively modulated
than movements spontaneously initiated during laser-off trials (Fig. 3j, k).
neurons (n = 13, green) and negatively modulated neurons (n = 7, red), None of the described effects were found in YFP controls.
aligned to movement initiation (93.45 ± 35.99 (mean ± s.e.m.) spontaneous The results presented above highlight a specific role for the transient
initiations per neuron). Grey shadows denote s.e.m. Right, proportion activity of DANs for the gating and invigoration of self-paced move-
of positively (+) and negatively (−) modulated and unmodulated (No) ment initiation, but not for the modulation of ongoing movements. On
neurons. e, Latency of each neuron to be significantly modulated in relation the basis of these findings, one prediction would be that if individual
to movement initiation (red, negatively modulated; green, positively spontaneous movements are chunked into a sequence of movements,
modulated). f, Time series of video frames for three movement initiations then the activity of DANs would become preferentially active before
(1.5 s duration) and their representation in the motion sensor space. sequence initiation, but not during the execution of individual elements
Cumulative angular velocity is shown in degrees per second (dg s−1).
within the sequence. To test this prediction, we trained mice on a self-
g, Representation of the initiations of one session using t-distributed
stochastic neighbour embedding (t-SNE) dimensionality reduction. paced operant task in which eight lever presses led to a 20% sucrose
Colours represent different clusters determined using affinity propagation solution reward (fixed-ratio eight task (FR8)), without any explicit
clustering. h, Number of initiation clusters in which each positively stimuli signalling the availability of reward4 (Fig. 4a). We implanted a
modulated neuron was significantly activated (n = 13, 30.4 ± 0.19% of gradient index lens just above the SNc of four TH-Cre mice (Extended
initiations were preceded by a significant increase in neuron activity). Data Fig. 7d), and injected a virus that expressed GCaMP6f19 in a Cre-
i, Spread of initiations (mean distance to every other initiation) according dependent manner20 (AAV2/5.CAG.Flex.GCaMP6f). We then used
to whether positively modulated neurons were active or not (not active, a miniaturized epifluorescence microscope21 to image calcium tran-
n = 8; active, n = 5). j, Normalized firing rate (firing rate / firing rate of sients in genetically identified SNc DANs while mice were performing
low acceleration trials) for positively modulated neurons of low, medium
the FR8 task (Fig. 4b, c). Similarly to previous findings4, by creating
and high acceleration trials (n = 13). k, Examples of a vigour-related
neuron (left) and a neuron unrelated to vigour (right). Red, blue and black
lever press time histograms using normalized fluorescence traces
represent firing rates during high, medium and low acceleration initiations, (z score of Δ​F), we found that the proportion of modulated neurons
respectively. l, Proportion of vigour-related (red) and non-related neurons was different between press events with the highest proportion of
(grey). P < 0.05, paired t-test comparing firing rate of low and high ­neurons being modulated by the first press (Fig. 4d–f). As predicted,
acceleration trials. Data are mean ± s.e.m. (i, j). *P < 0.05. this higher proportion of neurons that were related to the first press was
not apparent early in training, and developed with sequence learning4,22
no change in the vigour of movement when SNc DANs were inhibited (Extended Data Fig. 8).
after movement initiation and mice did not stop during the inhibition Recent studies claimed that SNc neurons are more modulated by
(Fig. 2h). Furthermore, in mobile trials in which animals stopped dur- movement, whereas ventral tegmental area neurons are more modu-
ing the 15 s (≥​300 ms immobile), there was no difference in acceleration lated by reward7. However, we found that around 35% of neurons in the

8 f e b ruar y 2 0 1 8 | V O L 5 5 4 | N A T U R E | 2 4 5
© 2018 Macmillan Publishers Limited, part of Springer Nature. All rights reserved.
RESEARCH Letter

a Optical fibres b c
0.12 0.14 *

Normalized frequency
SNC TH+ neurons

Time spent immobile (s)


5 4
expressing 0.10 ArchT 0.12 YFP * *

immobile (on/off)
ArchT or YFP 0.08 0.10 4 3

Time spent
0.08 3
0.06
0.06 2
0.04 0.04 2
0.02 0.02 1 1
15 s 15 s ITI ~30 s
0 0
Baseline Laser on 0.01 0.1 1 0.01 0.1 1 0 0
(laser off) ~35 mW Acceleration (g) ArchT YFP ArchT YFP

Acceleration (g)
d e 0.15 Laser off
g 0.25 1.5

Acceleration (on/off)
0.5 0.4 0.3 0.2 0.1 Laser on

Acceleration (g)

Acceleration (g)
0.20
1
Laser off
1
Laser on 0.10 * 1.0
0.15
Not 0.10
0.05 0.5
Trials
moving
0.05
*
0 0 0 *
0 3 6 9 12 15

M
Im

M
45 42

Im
Time (s)

ob le
ob
m

m
ob

ile
ob
i le
0.25 0.3
f h

i
1 1

le
0.20

Acceleration (g)

Acceleration (g)
Moving 0.2
0.15
Trials

0.10 Laser off


Laser on 0.1
Laser off
236 239 0.05 Laser on
0 5 10 15 0 5 10 15
Time (s) Time (s) 0 0
0 3 6 9 12 15 0 3 6 9 12 15
Time (s) Time (s)

i STOP
j STOP
2.00 * 2.00
ArchT *
Acceleration (on/off)

YFP

Acceleration (on/off)
0.25 0.25
Acceleration (g)

Acceleration (g)
1.00
0.20 * 0.20 1.00
0.15 n = 10 0.15 n=7
* 0.50 n=8
0.10 0.10 0.50
n = 11
0.05 Laser off 0.05 Laser off
Laser on 0.25 Laser on
0 Before After 0 0.25
–4 –3 –2 –1 0 1 2 3 4 –4 –3 –2 –1 0 1 2 3 4 Before After
stop stop
Time (s) Time (s) stop stop

k * l 0.3 m
0.8 3 *
1.0 *
Cumulative probability of

Cumulative probability of

Latency to move (on/off)


On
Mean acceleration (g)
movement initiation

movement initiation

Off
0.6
0.2 2
0.4 0.5
0.1 1
0.2

0 0 0 0
0 5 10 15 Off On Off On Move Stop
Time (s)

Figure 2 | Inhibition of SNc dopamine neurons impairs movement Table 1). g, Left, mean values of the data plotted in e and f. Grey, laser off;
initiation, but not ongoing movement. a, Schematics showing fibre green, laser on. Right, same data normalized (laser on / laser off). Single
positioning and trial structure. b, Distribution of acceleration in the asterisk in Immobile indicates significant difference from 1. h, Mean
open field during laser on and laser off for ArchT (left) and YFP (right) acceleration per mouse for mobile trials without stops. n = 10 ArchT mice.
groups. The vertical dashed line denotes the acceleration threshold. i, Left, mobile trials aligned to the first stop. Right, normalized mean
c, Left, time spent immobile during laser-off and laser-on periods. Clear acceleration (laser on / laser off) before (−4 to −3 s) and after (3–4 s)
bars indicate laser off and filled bars indicate laser on. Right, time spent the first stop for ArchT mice. Single asterisk above ‘After stop’ indicates
immobile during laser-on normalized to the baseline. n = 11 ArchT mice, significant difference from 1. j, Same as in i, but for the YFP group. k, Left,
9 YFP mice. Single asterisk above ArchT indicates significant difference mean cumulative probability of movement initiation for immobile trials.
from baseline (1). d, Heat maps of acceleration data of all trials where Right, mean probability to initiate movement. n = 7 ArchT mice. l, Mean
the mouse was immobile (top) or mobile (bottom) before the start of acceleration for initiations that occurred during immobile trials of ArchT
the trial, in laser-off (left) and laser-on (right) conditions. n = 11 ArchT mice. Laser on, n = 16; laser off, n = 30 trials. m, Normalized mean latency
mice. e, f, Acceleration during laser-off and laser-on trials for immobile to initiate movement. n = 9 YFP mice, 11 ArchT mice. Single asterisk
trials and mobile trials. n = 7 ArchT mice. The horizontal dotted line above Move indicates significant difference from 1. Data are mean ± s.e.m.
denotes the acceleration threshold. There was an interaction between Error bars and shaded areas denote s.e.m. *P < 0.05.
inhibition and mobility state when inhibition started (Supplementary

SNc responded to reward (Fig. 4e). This is almost similar to the percent- mice broke an infrared beam placed between the reward magazine
age of neurons modulated during sequence initiation (approxi­mately and the lever (Fig. 4g, h), corresponding to the moment of minimal
40% first press neurons; Fig. 4d, e). Importantly, there was little overlap DAN ­activity (before the increase in activity of first press neurons;
between reward- and first-press-modulated neurons, and the overlap Fig. 4g). We compared a block of inhibition (laser-on block) with a
was not significantly different than what would be expected by chance previous block without inhibition (laser-off block) during the same
(Extended Data Fig. 9). These data suggest that different populations session. Inhibition during 5 s before the first lever press resulted in
of SNc DANs are related to movement versus reward, but it remains to a significant increase in the latency to initiate the action sequence
be determined whether these correspond to populations that project to when compared to laser-off trials (Fig. 4h). Moreover, the probability
the dorsal versus ventral striatum, as has previously been suggested23. of ­initiating a sequence decreased during the 5 s of DAN inhibition
Next, we tested whether SNc DAN activity was necessary for (Fig. 4i). Consistent with the experiments presented above, when the
sequence initiation. TH-Cre mice expressing ArchT (n =​ 11) or YFP inhibition happened after sequence initiation (triggered by the first
(n =​ 9) were trained on the FR8 task for 12–14 days. Mice developed press), the inter-press interval and number of presses during the 5-s
a structured behaviour with predictable sequence initiations and inhibition were not altered (Fig. 4j). No effects were observed in YFP
trajectory after reward consumption24 (Fig. 4a). To inhibit SNc ­neurons controls (Fig. 4h–j). These results were replicated using DAT-IRES-Cre
before the first press of a sequence, the laser was triggered when mice using a different inhibitory opsin (Jaws25) when pseudorandomly

2 4 6 | N A T U R E | V O L 5 5 4 | 8 f e b ruar y 2 0 1 8
© 2018 Macmillan Publishers Limited, part of Springer Nature. All rights reserved.
Letter RESEARCH

a b ChR2 on YFP on c Low High d Laser triggering


ChR2 off YFP off
0.15 * 0.3
dependent
0.25 0.25 on movement state

Acceleration (g)
te
ta

Acceleration (g)
0.20 0.20 0.10 0.2 Online acceleration
t-s ty
processing and movement- le, ili
en tion obi bab n
250 μV

0.15 0.15 state classification e m ca m o t i o


r
ov ifi If im p ula
0.10 0.10 0.05 0.1 M lass % m s
0.5 ms c 50 f sti 30
o I~
IT
50 Hz

0.05 0.05
0 0 900 ms 500 ms
0 0 ChR2 YFP ChR2 YFP 3 mw
–500 0 500 1,000 0 1 2 3 4 5 0 1 2 3 4 5 Open field 20Hz
Time (ms) Time (s) Time (s) (39 cm × 39 cm)
Off On
e 20
f g h i j k
20
40 0.20 * 0.20
*
ChR2

60 40 5 100 * 0.20 *
*

Trials with movement

Normalized counts
Latency to move (s)
60 0.3

Acceleration (g)

Acceleration (g)
80 0.15 0.15
Acceleration (g)

0.3

acceleration (g)
4 80

initiation (%)
100 80 0.15
0.2

Initiation
0.10 0.10 3 60 0.2
20 20 0.10
0.1 2 40 0.1
40 40
YFP

0.05 0.05 0.05


60 60 1 20 0
80 80 0 0.01 0.1 1
0 0 0 0 0
0 1 2 3 4 5 0 1 2 3 4 5 0 1 2 3 4 5 ChR2 YFP ChR2 YFP ChR2 YFP Off On Initiation acceleration (g)
Time (s) Time (s) Time (s) * *
Figure 3 | Transient SNc dopamine neuron activation promotes YFP off. g, Mean acceleration from 0 to 1 s. n = 5 mice per group. h, Latency
movement initiation. a, Example of three SNc DANs (single units) to initiate movement. n = 5 mice per group. i, Percentage of trials with
expressing ChR2, following stimulation at 20 Hz. b, Mean acceleration movement initiation between 0 and 1 s. n = 5 mice per group. In h, i, there
depending on movement state before the trial. n = 7 ChR2 mice; n = 5 YFP is a significant effect for group between ChR2 and YFP. j, Mean distribution
mice. c, Mean acceleration from 0 to 1 s depending on movement state of acceleration during the first second after movement initiation for laser on
before the trial. Left, immobile; right, mobile. n = 7 ChR2 mice; n = 5 YFP (blue) and laser off (black). n = 5 ChR2 mice. k, Mean acceleration during
mice. Blue, laser on; grey, laser off. d, Closed loop set-up. e, Heat maps of the first second of movement initiation during laser-off and laser-on trials.
acceleration data for all trials. Laser-trigger criteria were reached at time 0. n = 5 ChR2 mice. Grey bars indicate laser off; blue bars indicate laser on.
White crosses indicate onset of movement. f, Mean acceleration. n = 5 mice Data are mean ± s.e.m. Error bars and grey-shaded areas represent s.e.m.
per group. Dark blue, ChR2 on; light blue, ChR2 off; black, YFP on; grey, *P < 0.05.

a Lever
Magazine b c Sequence (z score) 1
170 10 s
Lever press number

160
150
140
130
120
430 470 510
Press Licks Magazine entry
Time (s) Third Second
First Second Third to last to last Last
d 50 * e f 1 1 1 1 1 1
0.8 g Infrared beam
Magazine
modulated neurons

Modulated 0.4 Lever


40
Percentage of

by reward 0
30
14 8 –0.4
20 22 16 12 10 14 0.2
ΔF (z score)

6 ΔF
10 0.4 (z score) 0
ΔF (z score)

0 16 0.2 –0.2
First press
Second press
Third press
Third to last
Second to last
Last press

Modulated 0 –0.4
by first press
–0.2 –2 0 2
–3 0 3 –3 0 3 –3 0 3 –3 0 3 –3 0 3 –3 0 3 Time (s)
Time (s)
*
* ArchT YFP
h Infrared beam 5s i 0.5 0.7 j 5s
Normalized

Magazine laser on Off Off Magazine laser on


counts

Lever On On Lever

Latency Inter-press
0 0
(first press) 0.1 1 10 100 0.1 1 10 100 interval
Time (s) Time (s)
Inter-press interval (s)

10 8.0 * 100 1.5 1.0 2


of initiations (on/off)

* *
Inter-press interval

* *
Latency to press

Percentage of

8 4.0 80 0.8
Percentage
Latency (s)

initiations

1.0
(on/off)
(on/off)

6 60 0.6
2.0 1
4 40 0.4
0.5
2 1.0 20 0.2
0 0.5 0 0 * 0 0.5
ArchT YFP ArchT YFP ArchT YFP ArchT YFP ArchT YFP ArchT YFP
*
Figure 4 | SNc dopamine neurons are transiently active at sequence denotes s.e.m. g, Activity of first lever press-responsive neurons aligned
initiation, and when inhibited, impair sequence initiation, but not to the cross from the magazine to the lever, before the first lever press.
sequence performance. a, Example of the behaviour microstructure n =​  22. h, Left, latency to initiate lever press sequence. Right, normalized
during the FR8 task late in training. Red, black and blue circles indicate latency to sequence initiation. ArchT, n =​ 11 mice; YFP, n =​  9 mice.
first, middle and last press, respectively. Red and blue bars indicate licks Single asterisk above ArchT indicates significant difference from 1. i, Top,
and head entries, respectively. Dashed line denotes reward delivery. distribution of latencies to sequence initiation. Bottom left, percentage of
b, Field of view (projection of pixel standard deviation) of a TH-Cre early initiations. Right, normalized percentage of early initiations (latency
mouse expressing GCaMP6f in the SNc. Regions of interest correspond to <​5 s). ArchT, n =​ 11 mice; YFP, n =​ 9 mice. There is a significant effect
traces in c. Scale bar, 20 μ​m. c, Example traces obtained using the CNMF-E for group between ArchT and YFP. j, Left, press rate. Light was delivered
algorithm during FR8 task. d, Percentage of neurons modulated by press after the first press. Right, mean press rate normalized. ArchT, n =​  11 mice;
events. n =​  4 mice. e, Venn diagram representing reward- and first press- YFP, n =​  9 mice. *​P <​ 0.05. Clear bars indicate laser-off and filled indicate
related neurons. f, PETH of positively modulated neurons for each press laser-on blocks in h–j. Data are mean ±​  s.e.m.
event (bottom) and the corresponding heat maps (top). Grey shadow

8 f e b ruar y 2 0 1 8 | V O L 5 5 4 | N A T U R E | 2 4 7
© 2018 Macmillan Publishers Limited, part of Springer Nature. All rights reserved.
RESEARCH Letter

inhibiting 30% of the trials (Extended Data Fig. 10). Taken together, 10. Lima, S. Q., Hromádka, T., Znamenskiy, P. & Zador, A. M. PINP: a new method of
these results indicate that SNc dopamine activity before the initiation of tagging neuronal populations for identification during in vivo
electrophysiological recording. PLoS ONE 4, e6099 (2009).
the action sequence modulates the probability and latency of sequence 11. Klaus, A. et al. The spatiotemporal organization of the striatum encodes action
initiation, but is not critical for the execution of ongoing sequences. space. Neuron 95, 1171–1180 (2017).
Here we show that SNc DAN activity modulates self-paced 12. Frey, B. J. & Dueck, D. Clustering by passing messages between data points.
Science 315, 972–976 (2007).
movement initiation. Importantly, precisely timed and state-­ 13. Van Der Maaten, L. & Hinton, G. H. Visualizing data using t-SNE. J. Mach. Learn.
dependent optogenetic manipulations did not change ongoing Res. 9, 2579–2605 (2008).
­movements, indicating a specific role for SNc DAN activity for 14. Mazzoni, P., Hristova, A. & Krakauer, J. W. Why don’t we move faster?
Parkinson’s disease, movement vigor, and implicit motivation. J. Neurosci. 27,
­initiation. These results were corroborated using more complex 7105–7116 (2007).
movement sequences. 15. Panigrahi, B. et al. Dopamine is required for the neural representation and
It has been proposed that dopamine release in the dorsal striatum control of movement vigor. Cell 162, 1418–1430 (2015).
16. Han, X. et al. A high-light sensitivity optical neural silencer: development and
is important for the regulation of movement vigour2,14,15, but it was application to optogenetic control of non-human primate cortex. Front. Syst.
thought that this effect was mostly due to the ongoing tonic levels Neurosci. 5, 18 (2011).
of dopamine release. Our results indicate that the activity of DANs 17. Barter, J. W. et al. Beyond reward prediction errors: the role of dopamine in
before movement onset modulates future movement vigour. This movement kinematics. Front. Integr. Neurosci. 9, 39 (2015).
18. Hamid, A. A. et al. Mesolimbic dopamine signals the value of work.
could explain why patients with Parkinson’s disease select less v­ igorous Nat. Neurosci. 19, 117–126 (2016).
movements to initiate14. It is also in accordance with recent studies 19. Chen, T.-W. et al. Ultrasensitive fluorescent proteins for imaging neuronal
that have shown that activity of DAN terminals in the dorsal striatum activity. Nature 499, 295–300 (2013).
20. Atasoy, D., Aponte, Y., Su, H. H. & Sternson, S. M. A FLEX switch targets
preceded spontaneous movement initiation but did not precede and channelrhodopsin-2 to multiple cell types for imaging and long-range circuit
even followed acceleration bursts during ongoing movement7. Our mapping. J. Neurosci. 28, 7025–7030 (2008).
results suggest that transient changes in dopamine can function as a 21. Ghosh, K. K. et al. Miniaturized integration of a fluorescence microscope.
Nat. Methods 8, 871–878 (2011).
fast system that acts on top of tonic release to increase the ­probability 22. Wassum, K. M., Ostlund, S. B. & Maidment, N. T. Phasic mesolimbic dopamine
(and vigour) of initiating movements, presumably by modulating the signaling precedes and predicts performance of a self-initiated action
excitability of striatal projection neurons24,26, which receive infor- sequence task. Biol. Psychiatry 71, 846–854 (2012).
23. Parker, N. F. et al. Reward and choice encoding in terminals of midbrain
mation about the movements that are ‘planned’ at that exact time via dopamine neurons depends on striatal target. Nat. Neurosci. 19, 845–854
­glutamatergic inputs from cortex and/or thalamus. This suggests a (2016).
role for dopamine in gating and invigorating movements that were 24. Tecuapetla, F., Jin, X., Lima, S. Q. & Costa, R. M. Complementary contributions
of striatal projection pathways to action initiation and execution. Cell 166,
planned ­elsewhere27,28, and is consistent with the observation that DAN 703–715 (2016).
activity is not very action-specific. More sustained changes in DAN 25. Chuong, A. S. et al. Noninvasive optical inhibition with a red-shifted microbial
activity could represent states in which the ‘gate’ is more permissive, rhodopsin. Nat. Neurosci. 17, 1123–1129 (2014).
increasing the probability of action initiation during longer periods of 26. Kravitz, A. V. et al. Regulation of Parkinsonian motor behaviours by optogenetic
control of basal ganglia circuitry. Nature 466, 622–626 (2010).
time, therefore promoting movement29. This would translate into more 27. Wong, A. L., Lindquist, M. A., Haith, A. M. & Krakauer, J. W. Explicit knowledge
movement variability with exploration of the action space, which could enhances motor vigor and performance: motivation versus practice in
be important in situations of uncertainty or learning. sequence tasks. J. Neurophysiol. 114, 219–232 (2015).
28. Thura, D. & Cisek, P. The basal ganglia do not select reach targets but control
These results highlight that approaches aimed at providing transient the urgency of commitment. Neuron 95, 1160–1170 (2017).
modulations of basal ganglia circuitry tied to movement initiation, 29. Spielewoy, C. et al. Behavioural disturbances associated with
for example, via closed-loop deep-brain stimulation30 triggered by hyperdopaminergia in dopamine-transporter knockout mice. Behav.
Pharmacol. 11, 279–290 (2000).
­activity in cortical areas related to motor planning, could be beneficial 30. Rosin, B. et al. Closed-loop deep brain stimulation is superior in ameliorating
to patients with Parkinson’s disease. Parkinsonism. Neuron 72, 370–384 (2011).
31. Franklin, K. B. J. & Paxinos, G. The Mouse Brain in Stereotaxic Coordinates
Online Content Methods, along with any additional Extended Data display items and (Academic, 2008).
Source Data, are available in the online version of the paper; references unique to
these sections appear only in the online paper. Supplementary Information is available in the online version of the paper.

received 1 February 2016; accepted 11 December 2017. Acknowledgements We thank A. Vaz for mouse colony management,
I. Vaz for the help during photoidentification experiments, L. Perry for help
Published online 31 January 2018.
with stereological cell counts, A. Klaus, P. Zhou, L. Paninski for help with the
application of the CNMF-E analysis, and the Champalimaud Hardware Platform
1. Jankovic, J. Parkinson’s disease: clinical features and diagnosis. J. Neurol. (F. Carvalho, A. Silva, D. Bento) for help with the development of the motion
Neurosurg. Psychiatry 79, 368–376 (2008). sensors. This work was supported by fellowships from Gulbenkian Foundation
2. Niv, Y., Daw, N. D. & Dayan, P. How fast to work: response vigor, to J.A.d.S. and Grants from Fundação para a Ciência e Tecnologia, Fronteras
motivation and tonic dopamine. Adv. Neural Inf. Process. Syst. 18, de la Ciencia-CONACyT-2022 and the IN226517 DGAPA-PAPIIT-UNAM to F.T.
1019–1026 (2005). and from ERA-NET, European Research Council (COG 617142), and HHMI
3. Schultz, W. Multiple dopamine functions at different time courses. Annu. Rev. (IEC 55007415) to R.M.C.
Neurosci. 30, 259–288 (2007).
4. Jin, X. & Costa, R. M. Start/stop signals emerge in nigrostriatal circuits during Author Contributions J.A.d.S. and R.M.C. designed the experiments and
sequence learning. Nature 466, 457–462 (2010). analyses and wrote the paper, J.A.d.S. performed all experiments and analyses,
5. Syed, E. C. J. et al. Action initiation shapes mesolimbic dopamine encoding of F.T. helped with optogenetic and recording experiments, V.P. helped with
future rewards. Nat. Neurosci. 19, 34–36 (2016). accelerometer experiments and accelerometer data analyses.
6. Dodson, P. D. et al. Representation of spontaneous movement by dopaminergic
neurons is cell-type selective and disrupted in Parkinsonism. Proc. Natl Acad. Author Information Reprints and permissions information is available
Sci. USA 113, E2180–E2188 (2016). at www.nature.com/reprints. The authors declare no competing financial
7. Howe, M. W. & Dombeck, D. A. Rapid signalling in distinct dopaminergic axons interests. Readers are welcome to comment on the online version of the
during locomotion and reward. Nature 535, 505–510 (2016). paper. Publisher’s note: Springer Nature remains neutral with regard
8. Gong, S. et al. Targeting Cre recombinase to specific neuron populations to jurisdictional claims in published maps and institutional affiliations.
with bacterial artificial chromosome constructs. J. Neurosci. 27, 9817–9823 Correspondence and requests for materials should be addressed to
(2007). R.M.C. (rc3031@columbia.edu).
9. Madisen, L. et al. A toolbox of Cre-dependent optogenetic transgenic
mice for light-induced activation and silencing. Nat. Neurosci. 15, 793–802 Reviewer Information Nature thanks D. J. Surmeier and the other anonymous
(2012). reviewer(s) for their contribution to the peer review of this work.

2 4 8 | N A T U R E | V O L 5 5 4 | 8 f e b ruar y 2 0 1 8
© 2018 Macmillan Publishers Limited, part of Springer Nature. All rights reserved.
Letter RESEARCH

Methods captured by a large diameter optical fibre (1 mm), which connected to a one-input
Animals. All experiments were approved by the Portuguese DGAV and to one-output rotary joint. A branched 500-μ​m optical fibre was then used to
Champalimaud Centre for the Unknown Ethical Committee and performed in connect to the fibres that had been implanted in the mice.
accordance with European guidelines. TH-Cre male mice from the FI12 mouse Light intensity was measured before and during experiments using a fibre
line8 between 3 and 5 months, DAT IRES-Cre32 and TH-Cre;Ai329 between 2.5 ­similar to the ones implanted and a power meter (PD1000-S130C, Thorlabs). The
and 6 months were used. power was adjusted at the tip of the fibre to be around 15 mW for photoidentifi-
Sample sizes, randomization and blinding. The number of animals in each cation experiments (Fig. 1 and Extended Data Fig. 3), approximately 3 mW for
­experiment was based on previous studies using a power of 0.7 and α =​  0.05. ChR2 (Fig. 3), around 35 mW for ArchT experiments (Figs 2, 4 and Extended Data
n was larger than 5 in all experiments (except imaging experiments) as required Fig. 5), and approximately 9 mW in Jaws experiments (Extended Data Fig. 10).
for the use of parametric statistics. No formal method of randomization was used; Open field. We used a 39 ×​ 39 cm open field with black walls (17.5 cm height)
littermates were equally divided among the groups that were compared. There was and white acrylic floor to assess the spontaneous movement of mice. The open
no blinding of experimental groups. Every experiment contained all experimental field was inside a sound-attenuating chamber. Illumination was provided by white
groups that were tested concomitantly. The timing of optogenetic manipulations (2700 K) LEDs (Dioder, Ikea) that were placed on the floor and symmetrically
was controlled automatically, not by the experimenter. around the open field in a way that illumination of the open field was uniform
Recombinant adeno-associated viral vectors. The following Cre-dependent and indirect (135 lx).
adeno-associated viral vectors were used in the experiments: AAV2/5.CAG.Flex. FR8 operant task. Behaviour training and testing took place in operant chambers
GCaMP6f.WPRE.SV40 (titre 1.19 ×​  1013, University of Pennsylvania); AAV2/1. as described previously4. In brief, each chamber (23 cm L ×​ 20 cm W ×​ 19.5 cm H)
CAG.Flex.ArchT-GFP (titre 1.4 ×​  1012, University of Pennsylvania); AAV2/1. was housed within a sound-attenuating box (Med-Associates) and equipped with
ChR2-eYFP (titre 1.4 ×​  1013; University of North Carolina), AVV2/1.EF1a.DIO. one retractable lever on the left side of the food magazine and a house light (3 W,
eYFP (titre 1.4 ×​  1013, University of North Carolina); AAV8/hSyn.Flex.Jaws-GFP 24 V) mounted on the left lateral wall. Sucrose solution (10%) was delivered into a
(titre 4.2 ×​  1012, University of North Carolina); rAAV8/hSyn.DIO.eGFP, (titre metal cup in the magazine through a syringe pump (20 μ​l per reward). Magazine
4.9 ×​  1012, University of North Carolina). entries were recorded using an infrared beam and licks using a contact lickometer.
Virus injections, electrode, lens and fibre placement. Surgeries were performed Mice were placed on food restriction throughout training, and fed daily after the
using a stereotaxic system (Kopf). Mice were kept in deep anaesthesia using a training sessions with approximately 2 g of regular food to allow them to maintain
mixture of isoflurane and oxygen (1–3% isoflurane at 1 l min−1). a body weight of around 85% of their baseline weight.
For imaging experiments, a 1 μ​l of virus solution was injected in the right Training started with a 30-min magazine training session, in which the
substantia nigra compacta at the following coordinates: −​3.16 mm anteroposterior, reinforcer was delivered on a random time schedule, on average every 60 s (30
1.40 mm lateral from Bregma and 4.20 mm deep from the brain surface. The injec- reinforcers). The following day lever-pressing training started with continuous
tion was done through a glass pipette using a Nanojet II (Drummond Scientific) reinforcement (CRF), in which animals obtained a reinforcer after each lever press.
with a rate of injection of 4.6 nl every 5 s. After the injection was finished, the The session began with the illumination of the house light and insertion of the
pipette was left in place for 10–15 min. The virus solution was kept at −​80 °C and lever, and ended with the retraction of the lever and by turning off the house light.
thawed at room temperature just before the injection. A 500-μ​m diameter, 8.2-mm On the first day of CRF, the sessions lasted 45 min or until mice received five rein-
long gradient index (GRIN) lens (GLP-0584, Inscopix) was implanted at the same forcers, the second day of CRF lasted 45 min or until mice received 15 reinforcers,
coordinates as the injection. Before the lens was lowered, a blunt 28G needle was and the last day of CRF lasted 45 min or until mice received 30 reinforcers. This
lowered to 3 mm deep from the brain surface to facilitate the lowering of the last CRF session was repeated if mice failed to obtain 30 rewards within the time
GRIN lens. The GRIN lens was then lowered (4.2 mm deep). The lens was fixed limit. After CRF, animals started to be trained (day 1) on a fixed ratio schedule in
in place using cyanoacrilate and black dental cement (Ortho-Jet). One 1/16-inch which eight presses earn a reinforcer (FR8), without any stimulus signalling when
­stainless-steel screw (Antrin miniatures) was attached to the skull to provide a eight presses were completed or when the reinforcer was delivered; this training
scaffold to build a dental-cement-based cap that protected and fixed the lens to continued for 12–14 days.
the skull. All timestamps of lever presses, magazine entries and licks for each animal were
Three weeks after surgery, the mouse was anaesthetized and fixed with head recorded with a 10-ms resolution. The same training chamber was used during
bars. A baseplate (BPC-2, Inscopix) attached to a mini epifluorescence microscope imaging and optogenetic experiments.
(nVista HD, Inscopix) was positioned above the GRIN lens. To correctly position Acceleration and video recordings. In the experiments where photoidentified
the baseplate, brain tissue was imaged through the lens to find the appropriate focal TH+ neurons were recorded, acceleration was recorded using a digital 9-axis
plane using 20% LED power, a frame rate of 5 Hz and a digital gain of 4. Once the ­inertial sensor with a sampling rate of 200 Hz (MPU-9150, Invensense) assembled
focal plane was set, the baseplate was cemented to the rest of the cap using the same on a custom-made PCB and connected to a computer via a custom-made USB
dental cement. Imaging started 2–3 days after this final step. interface PCB (Champalimaud Foundation Hardware Platform).
The same stereotaxic system and anaesthesia protocol was used for electrode For the other experiments, an analogue 3-axis inertial sensor was used
and fibre placement. In the case of TH-Cre;Ai32 mice, no virus injection was used. with a sampling rate of 1,000 Hz (LIS331AL, ST) assembled on a custom PCB
The same coordinates were used for optrode placement, except for a depth of (Champalimaud Foundation Hardware Platform), and the signals were fed to the
3.8–3.9 mm from the brain surface. The ground wire was attached to a 1/16-inch analogue inputs of a Cerebus recording system (Blackrock Microsystems).
stainless-steel screw (Antrin miniatures), touching the surface of the brain. Acceleration data obtained from these sensors aggregates acceleration from
For optogenetic experiments (ChR2 and ArchT groups), the same ­procedure two sources: acceleration generated from gravity and from the body. To separate
and coordinates were used, except that a 1.5-μ​l virus solution was injected these two components we processed data obtained from both types of inertial
­bilaterally at 2.3 nl every 5 s and optical fibres with a diameter of 230 μ​m and a NA sensor using a custom MATLAB code. We used a standard approach34 that relies
of 0.39 (Thorlabs FMT 200 EMT) were placed bilaterally at a depth of 3.9 mm from on filtering the 3-axis data using a Butterworth filter. In our analysis we used a
the brain surface. Optical fibres were built based on a published protocol33. Two median filter (7 bins wide) to remove noise peaks. Then we used a 1-Hz high-pass
TH-Cre mice underwent the same virus injection protocol as the ArchT group and fifth-order Butterworth filter to separate the static (gravitational) component of the
were used to obtain the data presented in Extended Data Fig. 5. signal. Unless stated otherwise, we used the sum of the three vectors of acceleration
For the Jaws experiment, the same procedure was followed except that 1 μ​l as a global measurement of body acceleration for our analysis. The dynamic (body
of virus was used and optical fibres with a diameter of 400 μ​m and a NA of 0.5 acceleration) component accurately tracked animal movement, and correlated well
(Thorlabs FP400URT) were implanted at the same depth. with pixel change in video measurements (Extended Data Fig. 1b–d).
Optogenetic set-ups. For ChR2-expressing mice and corresponding controls, Video recordings were obtained using a charge-coupled device camera (DFK
light from a free-launched 200-mW, 473-nm, diode-pumped, solid-state laser 31BF03, Imaging Source) and a custom-developed software in Labview (National
(Laserglow Technologies), controlled using an AOM (AA Optolectronic), was Instruments) at a rate of 15 frames per second. This software allowed us to intro-
delivered after being captured by a collimator and split using a one-input to duce signals to the video frames to sync acceleration, neural recordings and light
two-outputs rotary joint (Doric Lenses). In addition, 200-nm, 0.22 NA optical delivery periods.
fibre patch cords were used to guide the light to the fibres implanted in the mice. Classification of movement state. We used the average distribution of acceleration
For the ArchT and the corresponding controls, the same set-up was used, but in the open field for each experimental group to define the movement state of the
with a different light source (free-launched 500-mW, 556-nm, diode-pumped, mice. This was possible, because the average distribution of the logarithm of total
solid-state laser from CNI Lasers). body acceleration was clearly bimodal, with a very low acceleration distribution
For the Jaws group and corresponding controls, we used a red LED (around corresponding to immobility periods (with the possible exception of small and
100 mW maximum output, approximately 625 nm, Prizmatix). The light was slow postural adjustments) and a high acceleration distribution corresponding

© 2018 Macmillan Publishers Limited, part of Springer Nature. All rights reserved.
RESEARCH Letter

to periods of mobility (see Fig. 1b and Extended Data Fig. 1 for a comparison http://www.psi.toronto.edu/index.php?q=​affinity%20propagation. We used the
between video and motion-sensor acceleration data). The acceleration ­threshold correlation between neuron auROC traces as the measure of similarity used by the
was defined as the lowest acceleration value between the two distributions. Unless algorithm. We also used maxits =​  1,000, convits =​  100; lam =​ 0.9 and a preference
stated otherwise in the methods, initiation events were defined as transitions equal to the median similarity of the dataset.
between periods of at least 300 ms below the threshold followed by at least 300 ms Trial-by-trial analysis of significant increases in neuron activity before
above the threshold. ­movement initiation. We defined a baseline distribution of the number of spikes
Extracellular recordings of photoidentifed SNc DANs. We used a single-drive per 200-ms bin for a period of 1 s (from 2,200 ms before movement initiation to
movable microbundle (sixteen 23-μ​m tungsten electrodes) with an optic-­fibre 1,200 ms before movement initiation) for all trials. On the basis of this distribution,
guide cannula (Innovative Neurophysiology). An optical fibre with 230 μ​m we determined a criterion for each neuron such that 90% of the 200-ms bins in
­diameter and a NA of 0.39 (Thorlabs FMT 200 EMT) was inserted in the cannula the baseline had a lower number of spikes than the criteria. Trials were considered
just to the top of the electrode microbundle cannula (see Fig. 1a for schematics). to present a significant increase in neuron activity when the number of spikes
The neural activity and the timestamps from the light stimulation were recorded during the 200-ms bin immediately preceding movement initiation was above
using a Cerebus recording system (Blackrock Microsystems). this criterion.
Experiments were started one week after electrode placement. Every day, Definition of movement initiation clusters and spread. We used a ­methodology
we sorted putative units using an online sorting algorithm (Central Software, previously developed by our group to use motion-sensor data to classify
Blackrock Microsystems) while the mouse was in its home cage. If putative single ­behaviour11.
units were isolated, we delivered a screening protocol consisting of a train of 100 We defined 1-s movement initiation trajectories specified by three motion-­
blue light pulses with a 10-ms width delivered at 1 Hz. Using neurophysiology sensor variables: total body acceleration, the angular velocity of the axis most
data analysis software (NeuroExplorer V4), we built PETH that were aligned to parallel to the dorsal–ventral axis of the mice and the gravitational acceleration
the train pulses. If any of the isolated units appeared to be modulated by the light of the same axis. We divided these trajectories in two 500-ms bins and for each
train, the mouse was introduced to the open field and neurons were recorded for bin we defined a vector composed by a concatenation of a normalized histo-
1 h. The stimulation protocol was run again at the end of the open field session for gram for each motion-sensor variable. In the end, each trajectory was defined
confirmation. At the end of the experiment, the microbundle was advanced 50 μ​m by the concatenation of two vectors, the first representing the distributions of the
to record next day. We used six mice in these experiments. During this experiment, motion-sensor variables for the first 500 ms of initiation, and the second for the
microbundles were moved on average 433 ±​  93.1 μ​m. last 500 ms. Consequently, the final initiation vector was composed by six different
Units were resorted using an offline sorting algorithm (Offline Sorter V3, motion-sensor variable distributions. We then determined a matrix representing
Plexon Inc.) to isolate single units on the basis of waveform characteristics, inter- the distances from each initiation vector to every other vector. To calculate the
spike intervals and clustering. Single units together with the timestamps of the distances, the motion-sensor variable distribution of one vector was compared to
light stimulation provided by a pulse generator (Master 8, AMPI) were exported the same motion-sensor variable distribution of another vector (range of 0–1; with
to MATLAB for analysis. 0 indicating that the vectors are exactly the same and 1 indicating that the vectors
Criteria used to photoidentify DANs. Neural activity referenced to light pulse are maximally different). The differences between each motion-sensor variable
onset was averaged in 1-ms bins, and averaged across trials to construct a PETH, distribution were then squared and summed together to find the distance between
which was the basis for analysing amplitude and latency of light-related firing the two initiation vectors that were evaluated (range 0–6). The final distance matrix
­activity. Distributions of the PETH from −​900 to −​10 ms before light onset were was built by comparing each initiation vector in this way and squaring the final
considered baseline activity. We then determined which bins, slid in 1-ms steps result, obtaining a matrix that varied from 0 (exactly the same) to 36 (maximally
during an epoch spanning from light onset to 50 ms after, met the criteria for different). The spread values presented in Fig. 1i were determined by averaging
­significant firing rate increases. A significant increase in firing rate was defined the distances between movement initiations.
as at least four consecutive bins had a firing rate larger than a threshold of five After determining an initiation distance matrix for each session, we used a­ ffinity
standard deviations above baseline activity. The latency in modulation of photo­ propagation12 to find clusters of initiations (see the description above regarding
identification was defined as the time between light onset and the first significant this methodology). We provided the affinity clustering algorithm with the additive
bin. On the basis of the distribution of latencies of significantly modulated neurons inverse of the distance matrix as a similarity matrix. We also used maxits =​  1,000,
and in accordance with previous studies4,35, we used a very short latency (≤​7 ms) convits =​  100; lam =​ 0.9. To make sure that we were selecting a consistent ­structure
for neural response to light, combined with at least a 30% increase in firing rate for the data, we used a value for preference between the minimum and the
during the light pulse, and a high correlation coefficient between spike waveforms ­maximum similarity of each similarity matrix that provided the highest but at
during light on and off (>​0.9) as criteria for positive photoidentification (Extended the same time most stable number of clusters (that is, a value was chosen in the
Data Fig. 3). middle of an interval of consecutive values that provided the same number of
Criteria to identify neurons modulated by movement initiation. We built a clusters).
PETH for each photoidentified single unit spanning from 1,500 ms before and t-Distributed stochastic neighbour embedding for visualization of initiations.
after movement-initiation events. Neural activity was averaged in 100-ms bins, We used t-distributed stochastic neighbour embedding (t-SNE)13 to visualize and
shifted by 1 ms (100 bins, centred on current bin). Distributions of the PETH assess the existence of structure within the movement initiations of each session
from −​1,000 to −​500 ms before light onset were considered baseline activity. We (see the example in Fig. 1h). We implemented this using a MATLAB code provided
then determined which bins, slid in 1-ms steps during an epoch spanning from by the authors of ref. 13 (https://lvdmaaten.github.io/tsne/). We used a 2D t-SNE
−​500 ms to 500 ms after movement initiation, met the criteria for significant ­firing using a perplexity of 15 to produce the image in Fig. 1h.
rate changes. A significant change in firing rate was defined when at least 50 con- DAN activity and movement vigour analysis. We used the mean ­acceleration
secutive bins had a firing rate higher or lower than a threshold of 2.56 standard ­during the first 500 ms of each spontaneous initiation as a measurement of
deviations above or below baseline activity (99% confidence interval). The latency movement vigour, and separated trials into low acceleration trials (lower tertile),
to modulation was defined as the time between movement onset and the first of medium and high acceleration trials (upper tertile). We then calculated the activity
the 50 consecutive significant bins. of positively modulated neurons during 300 ms before movement initiation for
Area under the receiver operating characteristic curve (auROC) analysis. For each acceleration tertile. A neuron was considered to be vigour related if the activity
this analysis, we used a method similar to the one described previously35. We during the lower tertile trials was significantly lower than the activity during the
convolved the spike trains with a function similar to a post-synaptic potential36. upper tertile trials.
To produce the ROC curves, we compared the firing rate of each 50-ms bin to the GCaMP6f imaging using a mini-epifluorescence microscope. Mice were briefly
firing rates during baseline (–1,500 to −​1,000 ms before movement initiation) anaesthetized using a mixture of isoflurane and oxygen (1% isoflurane at 1 l min−1)
across trials. The auROC for each bin was calculated using trapezoidal numerical and the mini-epifluorescence microscope was attached to the baseplate. This was
integration. followed by a period of 20–30 min of recovery in the home cage before experiments
Identification of neuron types using affinity propagation clustering. We used started. Fluorescence images were acquired at 10 Hz and the LED power was set
the affinity propagation algorithm12 to look for subtypes of significantly modulated 10–20% (0.1–0.2 mW) with a gain of 4. Image acquisition parameters were set to
neurons (Extended Data Fig. 3f). It is an efficient clustering algorithm that takes as the same values between sessions to be able to compare the activity recorded. Three
inputs the similarities between pairs of observations in the dataset (in this case, the GCaMP6f-expressing TH-Cre mice were imaged while freely exploring an open
auROC traces for each modulated neuron), and finds exemplars and the clusters field. The same mice and one more were also imaged during the FR8 task. Data
around them by exchanging real-valued messages between data points. We used shown in Fig. 4 were obtained in two consecutive late training sessions (between
the MATLAB (Mathworks) function made available by the authors of ref. 12 at days 7 and 13).

© 2018 Macmillan Publishers Limited, part of Springer Nature. All rights reserved.
Letter RESEARCH

Calcium image processing and analysis. GCaMP6f image processing and e­ xperiments were started at the end of the FR8 training. We used two different light-
­fluorescence trace extraction. All fluorescence movies were initially processed using delivery schedules: continuous light delivery for 5 s before the first lever press
the Mosaic Software (v.1.1.2, Inscopix). First, all frames were spatially binned by in a sequence; and continuous light delivery for 5 s after the first lever press in a
a factor of 4. To correct the movie for translational movements and rotations, the sequence. For the first condition, we made the triggering of the light contingent
frames were registered to a reference image consisting of an average of the raw on the breaking of an infrared beam (IRB) positioned right next to the magazine,
fluorescence movie. This was achieved by implementing the TurboReg registration on the side of the lever. This way, mice coming from consuming the reward would
engine37 within the mosaic software. The movie was cropped after registration to break the IRB before they started the next sequence. Sessions were divided into
remove the post-registration black borders. two blocks: a first block of 15 trials without light delivery; and a second block of
GCaMP6f fluorescence trace extraction. Although calcium imaging using mini­ 10 trials with light delivery. The last 10 trials with no light delivery were used to
scopes enables researchers to image neurons in freely moving mice, it is a c­ hallenge compare with the 10 trials with light delivery. In a few trials, the mouse failed to
to adequately extract neuronal signals without background contamination. Because break the IRB before starting the action sequence. These trials were discarded
of this, we implemented the ‘constrained non-negative matrix factorization for and not included in the analysis. Sessions with no light delivery were interspersed
endoscopic data’ (CNMF-E) framework11,38. This recently described framework between sessions with light delivery and a first session with light delivery was only
is an adaptation of the CNMF algorithm39. It can reliably deal with the large used to habituate the mice to the delivery of light and it was not analysed. The same
­fluctuating background from multiple sources in the data, enabling accurate methodology was used in Jaws experiments with the exception that instead of light
source extraction of cellular signals. It includes four steps: (1) initialize spatial and on and light off blocks there was a 30% probability of switching on the laser for each
­temporal components of single neurons without the direct estimation of the back- trial and data were collected in three consecutive sessions for each experimental
ground; (2) estimate the background given the estimated spatiotemporal activity of condition (inhibition before initiation and inhibition after first press).
the neurons; (3) update the spatial and temporal components of all neurons while SNc DAN activation. Open field. Mice were introduced to the open field and a
fixing the estimated background fluctuations; (4) iteratively repeat step 2 and 3. train of blue laser light (10 ms pulses at 20 Hz, during 0.5 s) was delivered with a
Criteria to identify DANs modulated by movement initiation using GCaMP6f variable interval: after 90 s there was a 33% probability that the light was delivered
imaging. We built a PETH for each neuronal trace spanning from 3 s before to and this was repeated every 10 s until light was delivered.
3 s after movement-initiation events. For this analysis, we considered movement Closed loop experiment in the open field. For closed loop experiments, the same
initiations as transitions between a period of at least 500 ms below to a period of light pulse train was used, but it was delivered depending on the acceleration state
at least 500 ms above the acceleration threshold. Distributions of the PETH from of the mouse in the following way: acceleration of mice was monitored online
−​3 to −​1 s before movement onset were considered baseline activity. We then by feeding the analogue accelerometer data through a Cerebus recording system
determined which bins, during an epoch spanning from −​0.5 before to 0.5 s after (Blackrock Microsystems) into MATLAB (Mathworks) using Blackrock’s MATLAB
movement initiation, met the criteria for significant Δ​F changes. A significant interface (CBMEX). Using a custom MATLAB code, we processed accelerometer
change in Δ​F was defined if at least 2 consecutive bins had Δ​F higher or lower data as described above. We monitored acceleration of mice using bins of 300 ms
than a threshold of 99% above or below baseline Δ​F. and when mice reached 900 ms below the threshold used to identify immobility,
Criteria to identify lever-press-related and reward-related DANs using light was delivered with a 50% probability. There was a minimum of 30 s between
GCaMP6f imaging. We constructed a PETH for each neuron trace spanning trials. In this experiment, we considered the maximum acceleration during the
from −​3 to 3 s from lever press onset for the first, second, third, third to final, first second after each movement initiation as a measurement of initiation vigour.
second to final and final press, and also for the first lick of reward. Distributions Anatomical verification. Animals were euthanized after completion of the
of the PETH from −​5 to −​3 s before first lever press were considered baseline behavi­oural tests. First, animals were anaesthetized with isoflurane, followed
activity for all press-related activity and distributions from −​5 to −​3 s of the first by intraperitoneal injection of ketamine–xylazine (around 5 mg kg−1 xylazine;
lick of reward PETH was considered as baseline for reward-related activity. We 100 mg kg−1 ketamine). Animals were then perfused with 1×​ phosphate-­
then searched each PETH during an epoch spanning from −​0.5 s to 0.5 s for bins buffered saline (PBS) and 4% paraformaldehyde, and brains were extracted for
that were significantly different from the baseline. A significant change in fluores- ­histological p­ rocessing. Brains were kept in 4% paraformaldehyde overnight and
cence was defined as at least three consecutive bins with fluorescence higher than then transferred to 1×​PBS solution. Brains were sectioned coronally in 50-μ​m
a threshold of 99% above baseline Δ​F. slices (using a Leica vibratome (VT1000S) and kept in PBS solution before
Extracellular recordings during SNc DAN inhibition. Optic fibres and electrodes mounting or immunostaining experiments). Images were taken using a wide-
were positioned 300 μ​m above the SNc. Light intensity was around 35 mW at the field fluorescence microscope (Zeiss AxioImager) and the tip of the longest track
tip of the fibre, corresponding to an estimated40 irradiance of 70–206 mW mm−2 found was used to determine the anatomical location of the implants (lenses,
at SNc depth (200 to 400 μ​m from the fibre tip). Neural activity was recorded daily fibres and electrodes), which was represented in the corresponding Allen Brain
and the electrodes were moved 50 μ​m at the end of each recording session. We were Atlas41 slice (Extended Data Fig. 7).
thus able to record neural activity from different depths (−​3.90 mm to −​4.60 mm To estimate the specificity of the TH-Cre line, we crossed TH-Cre mice with
from the brain surface), with neurons being recorded above, within and below the ROSA26-eGFP mice. TH-Cre;ROSA26-eGFP mice express GFP in neurons
SNc. We recorded from 140 units and observed that at depths where the SNc is expressing Cre recombinase. We used slices from the brain of one TH-Cre;ROSA26-
located, more than 60% of recorded units were inhibited (Extended Data Fig. 5), eGFP mouse and used a tyrosine hydroxylase antibody (ImmunoStar) to label the
whereas above and below the SNc, very few neurons were modulated. Furthermore, ventral tegmental area (VTA) and SNc DANs (Extended Data Fig. 2). We imaged
we only observed one single unit that was modulated by light at the depth closest the VTA and SNc in three different slices (approximately −​2.9 mm, −​3.3 mm,
to the fibre where light intensity is higher (−​3.9 to −​3.95mm, 0.7% of all units −​3.8 mm from Bregma) using a confocal microscope equipped with a Diode
recorded, 7.7% of all units recorded at this depth), indicating that light delivery per 405-nm, Argon multi-line 458−​488−​514-nm and DPSS 561-nm lasers (LSM710,
se was not sufficient to change neural activity at this power. The same positioning Zeiss). We acquired z stacks (354 μ​m ×​  354 μ​m ×​  5 μ​m; 5-μ​m interslice interval)
of the fibres and light intensity was used during the open field and operant task in a tile that covered the VTA, SNc and areas 200 μ​m above and below the SNc.
inhibition experiments. We imported these images into the Stereo Investigator software (MBF Bioscience)
We used the same set-up and methodology described for the extracellular and used a stereological approach to count labelled cells (TH+ and Cre+) and
recordings of photoidentifed SNc DANs, but instead of using blue light, we used evaluate co-localization, using a 100 μ​m ×​  100 μ​m counting frame (Extended Data
green light (see ‘Optogenetics set-ups’). The mean auROC traces presented in Fig. 2a–c).
Extended Data Fig. 5a, b were calculated as described for the photoidentification We also used a stereological approach to estimate the rate and specificity of
experiments. The anatomical scheme depicted in Extended Data Fig. 5b was based infection of the AAV2/1.CAG.Flex.ArchT-GFP and the density of TH+ neurons
on the histological determined position of the electrode cannula and the amount in the SNc of ArchT and YFP TH-Cre mice (ArchT, n =​  2; YFP, n =​ 2). We imaged
of electrode travel at each recording session. every six slices in which the VTA and/or SNc were found, using the confocal micro-
Open field. Mice were introduced to the open field and green light was d ­ elivered scope described above (three slices per mouse). Using a 40×​magnification, we
continuously for periods of 15 s (mean of 22 ±​ 3 trials with a mean inter-trial acquired z stacks (354 μ​m ×​  354 μ​m ×​  5 μ​m; 5-μ​m interslice interval) in a tile that
­interval (ITI) of 64 ±​ 28 s per mouse in the ArchT group and a mean of 23 ±​  4 covered the whole SNc. These tile z stacks were imported into the stereo investi-
trials with a mean ITI of 65 ±​ 33 s per mouse in the YFP group). An open-field gator software (MBF Bioscience) and quantification of the TH+, eYFP+ or GFP+
session was done on the day before to habituate mice to the open field and to light cells was performed using a 100 μ​m ×​  100 μ​m counting frame (Extended Data
delivery (with similar trial structure except for light duration, which was 5 s). Data Fig. 2d–h).
regarding this first session are shown in Extended Data Fig. 6. Statistics. Statistical hypothesis testing was done at a 0.05 significance level
Operant task. The same groups of ArchT and YFP mice used in the open- (except for classification of neurons, which was done at a 0.01 significance level as
field inhibition experiment were trained to perform the FR8 task. Optogenetic explained above). Parametric testing was used whenever possible to test ­differences

© 2018 Macmillan Publishers Limited, part of Springer Nature. All rights reserved.
RESEARCH Letter

between two or more means. Normality was tested using the Shapiro–Wilk test, 32. Bäckman, C. M. et al. Characterization of a mouse strain expressing Cre
wheras F-tests (for unpaired t-tests) and Levene’s tests (for ANOVA) were used recombinase from the 3′​untranslated region of the dopamine transporter
to assess equality of variance. If data were not normally distributed, we first tried locus. Genesis 44, 383–390 (2006).
33. Sparta, D. R. et al. Construction of implantable optical fibers for long-term
to transform the data using the natural logarithm. If the distribution of the trans- optogenetic manipulation of neural circuits. Nat. Protoc. 7, 12–23 (2011).
formed data was still not normally distributed or there was a significant differ- 34. Mathie, M. J., Lovell, N. H., Coster, A. C. F. & Celler, B. G. Determining activity
ence in variance, an alternative non-parametric test was used. ANOVA and linear using a triaxial accelerometer. In Proc. 2nd Joint EMBS-BMES Conf. 3,
mixed models were used to check for main effects and interactions in experiments 2481–2482 (2002).
with repeated measures and more than one factor. The assumptions for linear 35. Cohen, J. Y., Haesler, S., Vong, L., Lowell, B. B. & Uchida, N. Neuron-type-specific
signals for reward and punishment in the ventral tegmental area. Nature 482,
mixed models were checked by careful inspection of the model residuals to check 85–88 (2012).
for normality and equality of variances. When main effects or interactions were 36. Thompson, K. G., Hanes, D. P., Bichot, N. P. & Schall, J. D. Perceptual and motor
significant, we did planned comparisons according to experimental design (for processing stages identified in the activity of macaque frontal eye field
example, comparing laser on and off). Fisher’s least significant difference tests neurons during visual search. J. Neurophysiol. 76, 4040–4055 (1996).
were used for comparisons after ANOVA tests and least square means tests were 37. Thévenaz, P., Ruttimann, U. E. & Unser, M. A pyramid approach to subpixel
registration based on intensity. IEEE Trans. Image Process. 7, 27–41 (1998).
used for comparison when linear mixed models were significant. Details on the
38. Zhou, P., Resendez, S. L., Stuber, G. D., Kass, R. E. & Paninski, L. Efficient and
statistical analysis used for hypothesis testing in the main figures can be found in accurate extraction of in vivo calcium signals from microendoscopic video data.
the Supplementary Table 1. Statistical tests were done using Prism (GraphPad), Preprint at https://arxiv.org/abs/1605.07266 (2016).
MATLAB (MathWorks) statistical toolbox and R (R core team 2015, v.3.1.3, 39. Pnevmatikakis, E. A. et al. Simultaneous denoising, deconvolution, and
lme442). demixing of calcium imaging data. Neuron 89, 285–299 (2016).
Code availability. MATLAB (MathWorks) codes used for data analysis are 40. Yizhar, O., Fenno, L. E., Davidson, T. J., Mogri, M. & Deisseroth, K. Optogenetics
in neural systems. Neuron 71, 9–34 (2011).
­available from the corresponding author. 41. Lein, E. S. et al. Genome-wide atlas of gene expression in the adult mouse
Data availability. Source Data for Figs 1–4 have been provided with the online brain. Nature 445, 168–176 (2007).
version of the paper and all other data that support the findings of this study are 42. Bates, D., Mächler, M., Bolker, B. M. & Walker, S. C. Fitting linear mixed-effects
available from the corresponding author upon reasonable request. models using lme4. J. Stat. Softw. 67, 1–48 (2015).

© 2018 Macmillan Publishers Limited, part of Springer Nature. All rights reserved.
Letter RESEARCH

Extended Data Figure 1 | Comparison between video-motion analysis at a constant speed (acceleration 0) is highly unlikely. c, Heat maps of
and motion-sensor data in the open field. a, Example of raw acceleration mean pixel change of video clips of 300 ms and 10 s (top and bottom,
(static and dynamic acceleration) and angular velocity collected using respectively), during which mice showed acceleration that was lower (left)
a six-axis inertial sensor. b, Bivariate histogram of log pixel change and or higher (right) than the threshold used to define immobility. d, Top,
log acceleration in the open field (n =​ 13 sessions, from three mice). comparison between a video-derived motion measurement (pixel change)
Notice the two clusters that emerge from this bivariate histogram (low and total dynamic acceleration aligned to movement initiation determined
acceleration and low pixel change cluster on the left, and high acceleration using the acceleration threshold (n =​ 454 initiations obtained from three
and high pixel change cluster on the right). The acceleration histogram mice during a total of 13 open-field sessions). Bottom, representation
provides a clear distinction between these two clusters. There is a high of the movement of mice (based on the centre-of-mass) during each
correlation between video-tracking measurements and acceleration trial within the time intervals as indicated on the x axis. The trajectories
(r =​  0.74, n =​  62,984 frames, P <​ 0.05). This also shows that animals rely were aligned to the centre-of-mass of the last frame of each 1-s interval.
on constant acceleration from their limbs to move, and that locomotion Different colours denote individual trials.

© 2018 Macmillan Publishers Limited, part of Springer Nature. All rights reserved.
RESEARCH Letter

Extended Data Figure 2 | TH-Cre line and ArchT infection of TH+ and ArchT+ cells; closed arrowheads denote examples of TH+
characterization. a, TH-Cre mice were crossed with ROSA26R-YFP and ArchT− cells. Scale bars, 20 μ​m. f, Efficiency of ArchT virus infection
mice (expression of YFP in Cre+ cells). This is an example of a midbrain (left). Specificity of ArchT virus infection (right). This was calculated by
slice of a TH-Cre ×​ ROSA26R-YFP mouse with TH+ neurons labelled quantifying the whole SNc stereologically, not only the area closest to
in red. The white line delimits the SNc, and the yellow and green lines the infection (n =​ 6 slices from two ArchT mice, 122 counting frames).
delimit areas that cover a depth of 200 μ​m above and below the nigra, g, Examples of the slices and fields used to do the stereological count
respectively, that were also targeted by stereological cell counts. Scale shown in f and h. Scale bars, 100 μ​m. h, Stereological quantification of the
bar, 100 μ​m. b, Example of a SNc sampling field. Arrowheads denote number of SNc TH+ cells in YFP- and ArchT-expressing mice after two
examples of Cre+ cells that were TH+. Scale bars, 20 μ​m. c, Quantification weeks of infection (ArchT, n =​ 6 slices from two ArchT mice, 122 counting
of the specificity of the Cre line for tagging TH+ cells (n =​ 3 slices; 117 frames; YFP, n =​ 6 slices from two YFP mice, 124 counting frames).
counting frames were analysed). d, Representative merged image of VTA i, Photomicrograph of a midbrain slice of a ArchT-expressing mouse
and SNc after two weeks of infection. ArchT+ cells are labelled in green, at the end of the experiments (open field and FR8). Red indicates TH+
TH+ cells are labelled in red and merged colours in yellow. ArchT+ cells cells and green indicates ArchT+ cells. Scale bar, 100 μ​m. Data are
are mainly confined to SNc. Scale bar, 500 μ​m. e, Detail of a SNc region mean ±​  s.e.m. (c, f, h).
labelled for TH (red) and ArchT (green) expression. Arrows are examples

© 2018 Macmillan Publishers Limited, part of Springer Nature. All rights reserved.
Letter RESEARCH

Extended Data Figure 3 | Photoidentification and clustering of SNc Fig. 2. The black trace represents the mean of spikes obtained without light
dopamine neurons. a, Photomicrograph of a midbrain slice of a TH- delivery and the blue trace represents the mean trace of spikes obtained
Cre;Ai32 mouse denoting the right SNc and VTA. ChR2 in green and during light delivery. f, Left, the area under the ROC curve (auROC)
TH+ cells in red. Initial electrode position (dashed square) and distance was calculated for each time bin of each significantly modulated neuron.
travelled (dashed triangle). Scale bar, 100 μ​m. b, Example of continuous Right, we used an affinity propagation algorithm to cluster the traces that
recording of a photoidentified neuron. Blue triangles denote 10-ms light resulted from the auROC analysis (see Methods for details). Four clusters
pulses of blue light that were delivered at 1 Hz. c, PETH of the neuron in were found, of which the PETH of the representative neuron is shown.
b aligned to blue-light delivery (100 pulses). d, Histogram of latencies to Neurons were: transiently active before the initiation of movement (blue),
modulation by light delivery. A threshold of 7 ms and an increase in transiently active before the initiation of movement followed by inhibition
at least 30% firing rate was used to define neurons as photoidentified after the initiation (grey), sustained increase in activity with movement
(blue bars). e, Mean spike traces for all photoidentified neurons used in initiation (green) or negatively modulated (red).

© 2018 Macmillan Publishers Limited, part of Springer Nature. All rights reserved.
RESEARCH Letter

Extended Data Figure 4 | Calcium imaging of TH+ neurons from the or negatively modulated and not modulated by movement initiation
SNc during movement initiation. a, Example of the average pixel per (n =​ 22 neurons obtained from three mice). c, Mean auROC trace of
pixel Δ​F of one mouse aligned to movement initiation (n =​  46 trials). positively modulated neurons based on calcium imaging (solid line, n =​  7).
Black arrowheads denote three neurons that are significantly activated d, Mean auROC trace of negatively modulated neurons according to
before movement initiation. b, Proportion of neurons that were positively calcium imaging (solid line, n =​ 4). Grey shadow denotes s.e.m. (c, d).

© 2018 Macmillan Publishers Limited, part of Springer Nature. All rights reserved.
Letter RESEARCH

Extended Data Figure 5 | In vivo external recordings reveal specific each depth, we found that the mean activity during light delivery changed
inhibition of neuronal activity in the SNc. a, Mean unit activity aligned depending on the depth, and it was only significantly different at the
to light onset (values less than 0.5 auROC indicate a decrease compared to depths at which the SNc is located, for which the percentage of inhibited
baseline and more than 0.5 auROC indicate an increase compared to units was 61.3%. This is anatomically represented in b. Depth (number
baseline) at different recording depths. The green rectangle signals of neurons): −​3.9 mm (3); −​4 mm (22); −​4.1 mm (14); −​4.2 mm (6);
the duration of light delivery. Left, mean of all units recorded. Right, −​4.3 mm (8); −​4.4 mm (10); −​4.5 mm (4); −​4.6 mm (5). Kruskal–Wallis
mean of all units except negatively modulated units. b, Top, anatomical test: H =​  18.22; P =​ 0.011. Dunn’s multiple comparison test, all means
representation31 of the mean unit activity depending on recording depth compared to mean at −​4.6 mm: 3.9 mm, P >​  0.99; −​4 mm, P =​  0.078;
and the location of the cannula of the recording electrode (red, decrease −​4.1 mm, *​P =​  0.017; −​4.2 mm, *​*​P =​  0.008; −​4.3 mm, P =​  0.67;
from baseline; blue, increase from baseline). The percentage of inhibited −​4.4 mm, P =​  0.82; −​4.5 mm, P >​ 0.99). Asterisks indicate depths with
cells was not homogeneous throughout all depths (χ24,140 =​  18.01, P <​  0.05, mean auROC significantly different from −​4.6 mm depth. c, Example of a
test based on five levels of depth from –3.9 to –4.6 mm with 150-μ​m steps). single unit inhibited by green light. The mouse brain has been reproduced
In fact, when we investigated the mean activity of all units recorded at with permission from ref. 31.

© 2018 Macmillan Publishers Limited, part of Springer Nature. All rights reserved.
RESEARCH Letter

Extended Data Figure 6 | Five-second inhibition of SNc TH+ neurons denotes the threshold used to classify acceleration state. c, Acceleration
during mobile and immobile trials. a, Acceleration during laser-off during brief laser-on (5 s inhibition) normalized to mean laser-off
and brief laser-on trials (5 s inhibition) when ArchT mice were mobile acceleration for immobile and mobile states (n =​ 17 laser-on immobile
before the start of the trial (n =​ 217 laser-on trials and n =​  212 laser-off trials obtained from 5 ArchT mice, n =​ 12 laser-off immobile trials
trials obtained from 11 ArchT mice). The horizontal dotted line denotes obtained from 7 ArchT mice; n =​ 217 laser-on mobile trials, n =​  212 laser-
the threshold used to classify acceleration state. b, Acceleration during off mobile trials obtained from 11 mice). Acceleration state significantly
laser-off and brief laser-on trials (5 s inhibition) when ArchT mice were affected normalized acceleration (linear mixed model with ‘mouse’ as a
immobile before trial start (n =​ 17 laser-on trials from 5 ArchT mice and random effect, F =​  19.57, P <​  0.0001).
n =​ 12 laser-off trials obtained from 7 ArchT mice). Horizontal dotted line

© 2018 Macmillan Publishers Limited, part of Springer Nature. All rights reserved.
Letter RESEARCH

Extended Data Figure 7 | Anatomical position of fibres, electrodes and the mouse brain and anatomical structures was obtained from the Allen
lens. a, Fibre placement (green, ArchT mice; yellow, YFP mice). b, Fibre Mouse Brain Atlas (2004) using API. Top, http://api.brain-map.org/api/v2/
placement (blue, ChR2 mice; yellow, YFP mice). c, Optrode placement. svg_download/100960073?groups=​28; middle, http://api.brain-map.org/
Horizontal blue lines denotes the cannula position and vertical lines the api/v2/svg_download/100960057?groups=​28; bottom, http://api.brain-
distance travelled by the electrodes. d, GRIN lens placement (green bar map.org/api/v2/svg_download/100960525?groups=​28.
indicates the position of the bottom of the lens). The representations of

© 2018 Macmillan Publishers Limited, part of Springer Nature. All rights reserved.
RESEARCH Letter

Extended Data Figure 8 | Lever-press significant neurons across modulated by the sequence lever presses throughout training. Data shown
training days. a, Field-of view of one of the GCamP6-expressing mice were obtained during the training of three out of the four mice used to
across different training days spanning days from the beginning to the obtain the calcium imaging data shown in Fig. 4. Data during training was
end of training. Scale bars, 100 μ​m. b, Percentage of neurons significantly not available for one mouse.

© 2018 Macmillan Publishers Limited, part of Springer Nature. All rights reserved.
Letter RESEARCH

Extended Data Figure 9 | First press- and reward-related neurons a distribution of the number of overlapping neurons for first press
populations do not overlap. a, Example of a neuron modulated by first and reward, assuming random assignment. Red lines denote the 95%
press but not reward (left) and a neuron related to reward but not first confidence interval. Dashed line represents the number of overlapping
press (right), aligned to first press (blue) and reward consumption (red). neurons found in our experiment.
b, Monte Carlo simulations (10,000 samples) were used to generate

© 2018 Macmillan Publishers Limited, part of Springer Nature. All rights reserved.
RESEARCH Letter

Extended Data Figure 10 | FR8-inhibition experiment using Jaws. We P =​ 0.019, GFP laser off − laser on P =​  0.18. b, Press rate in trials with no
replicated the result obtained in the FR8 task (Fig. 4h–j), using Jaws light delivery and trials with light delivery starting after the first press
(see Methods for details). a, Latency to initiate lever press sequence for for both Jaws (n =​ 5) and GFP (n =​ 6) groups. Two-way mixed ANOVA;
laser-off trails and trials with inhibition starting just before sequence planned comparisons between laser-on and laser-off trials using Fisher’s
initiation for both Jaws (n =​ 6) and GFP (n =​ 6) groups. Two-way mixed least significant difference tests; main effect group F1,9 =​  1.607, P =​  0.24;
ANOVA; planned comparisons between laser-on and laser-off trials using main effect laser F1,9 =​  0.53, P =​ 0.49; interaction effect F1,9 =​  1.01,
Fisher’s least significant difference tests; main effect group F1,10 =​  3.16, P =​ 0.34; planned comparisons: Jaws laser off − laser on P =​  0.86, GFP
P =​ 0.11; main effect laser F1,10 =​  9.074, P =​ 0.0131; interaction effect laser off − laser on P =​  0.23.
F1,10 =​  0.92, P =​ 0.36; planned comparisons: Jaws laser off − laser on

© 2018 Macmillan Publishers Limited, part of Springer Nature. All rights reserved.
nature research | life sciences reporting summary
Corresponding author(s): Rui M. Costa
Initial submission Revised version Final submission

Life Sciences Reporting Summary


Nature Research wishes to improve the reproducibility of the work that we publish. This form is intended for publication with all accepted life
science papers and provides structure for consistency and transparency in reporting. Every life science submission will use this form; some list
items might not apply to an individual manuscript, but all fields must be completed for clarity.
For further information on the points included in this form, see Reporting Life Sciences Research. For further information on Nature Research
policies, including our data availability policy, see Authors & Referees and the Editorial Policy Checklist.

` Experimental design
1. Sample size
Describe how sample size was determined. Based on previous studies for a power of 0.7 and alpha=0.05. N was larger than 5
in all experiments (except imaging experiments) as required for the use of
parametric statistics.
2. Data exclusions
Describe any data exclusions. No animals were excluded from the analisys.
3. Replication
Describe whether the experimental findings were inhibition experiments were carried on three different groups (with subjects and
reliably reproduced. controls) which showed the same overall result and were then pooled together
(fig. 2). Activation experiments were done using an open loop approach and then
replicated with different groups using a closed loop design (fig. 3).
4. Randomization
Describe how samples/organisms/participants were No formal method of randomization was used; littermates were equally divided
allocated into experimental groups. among the groups being compared.
5. Blinding
Describe whether the investigators were blinded to There was no blinding of experimental groups. The timing of optogenetic
group allocation during data collection and/or analysis. manipulations was controlled automatically, and not by the experimenter.
Note: all studies involving animals and/or human research participants must disclose whether blinding and randomization were used.

6. Statistical parameters
For all figures and tables that use statistical methods, confirm that the following items are present in relevant figure legends (or in the
Methods section if additional space is needed).

n/a Confirmed

The exact sample size (n) for each experimental group/condition, given as a discrete number and unit of measurement (animals, litters, cultures, etc.)
A description of how samples were collected, noting whether measurements were taken from distinct samples or whether the same
sample was measured repeatedly
A statement indicating how many times each experiment was replicated
The statistical test(s) used and whether they are one- or two-sided (note: only common tests should be described solely by name; more
complex techniques should be described in the Methods section)
A description of any assumptions or corrections, such as an adjustment for multiple comparisons
The test results (e.g. P values) given as exact values whenever possible and with confidence intervals noted
June 2017

A clear description of statistics including central tendency (e.g. median, mean) and variation (e.g. standard deviation, interquartile range)
Clearly defined error bars

See the web collection on statistics for biologists for further resources and guidance.

1
` Software

nature research | life sciences reporting summary


Policy information about availability of computer code
7. Software
Describe the software used to analyze the data in this This is provided in the methods sections. Data analisys and statistical tests were
study. done using Prism (GraphPad), Matlab (MathWorks) statistical toolbox, R (R core
team 2015, v. 3.1.3, lme 18).
For manuscripts utilizing custom algorithms or software that are central to the paper but not yet described in the published literature, software must be made
available to editors and reviewers upon request. We strongly encourage code deposition in a community repository (e.g. GitHub). Nature Methods guidance for
providing algorithms and software for publication provides further information on this topic.

` Materials and reagents


Policy information about availability of materials
8. Materials availability
Indicate whether there are restrictions on availability of Most of the materials we used are commonly available and open-source
unique materials or if these materials are only available alternatives exist for the materials that are only available for distribution by a for-
for distribution by a for-profit company. profit company. The custom materials , like accelerometers , built in-house are
open-source and can be made available through our institute hardware platform
(Champalimaud hardware platform; http://www.cf-hw.org/)
9. Antibodies
Describe the antibodies used and how they were validated Tyrosine hydroxylase antibody provided by ImmunoStar; catalog # 22941; lot #
for use in the system under study (i.e. assay and species). 1552001. Goat Anti-Mouse IgG (Alexa Fluor® 568) provided by abcam (ab175473)
Validation is provided in the data sheet of the manufacturer and also within our
paper by comparing the antibody labelling with genetic driven labelling.

10. Eukaryotic cell lines


a. State the source of each eukaryotic cell line used. no eukaryotic cell lines were used

b. Describe the method of cell line authentication used. no eukaryotic cell lines were used

c. Report whether the cell lines were tested for no eukaryotic cell lines were used
mycoplasma contamination.

d. If any of the cell lines used are listed in the database No commonly misidentified cell lines were used
of commonly misidentified cell lines maintained by
ICLAC, provide a scientific rationale for their use.

` Animals and human research participants


Policy information about studies involving animals; when reporting animal research, follow the ARRIVE guidelines
11. Description of research animals
Provide details on animals and/or animal-derived This is reported in methods "TH-Cre male mice from the FI12 mouse line1 between
materials used in the study. 3 and 5 months, DAT IRES-cre and TH-Cre:Ai32 between 2.5-6 months were used."

Policy information about studies involving human research participants


12. Description of human research participants
Describe the covariate-relevant population Did not involve human research participants
characteristics of the human research participants.
June 2017

You might also like