C. D. Bird and N. J. Emery, Insightful problem solving and creative tool modification by captive nontool-using rooks, Proceedings of the National Academy of Sciences of the United States of America, vol.106, pp.10370-10375, 2009.
DOI : 10.1073/pnas.0901008106
URL : http://www.pnas.org/content/106/25/10370.full.pdf

C. D. Bird and N. J. Emery, Rooks use stones to raise the water level to reach a floating worm, Current biology : CB, vol.19, pp.1410-1414, 2009.
DOI : 10.1016/j.cub.2009.07.033
URL : https://doi.org/10.1016/j.cub.2009.07.033

L. M. Bjursten, K. Norrsell, and U. Norrsell, Behavioural repertory of cats without cerebral cortex from infancy, Experimental brain research. Experimentelle Hirnforschung. Experimentation cerebrale, vol.25, pp.115-130, 1976.
DOI : 10.1007/bf00234897

T. Boraud, Matière à décision, 2015.

S. W. Bottjer, K. A. Halsema, S. A. Brown, and E. A. Miesner, Axonal connections of a forebrain nucleus involved with vocal learning in zebra finches, The Journal of comparative neurology, vol.279, pp.312-326, 1989.

C. M. Bradshaw, E. Szabadi, P. Bevan, and H. V. Ruddle, The effect of signaled reinforcement availability on concurrent performances in humans, J Exp Anal Behav, vol.32, pp.65-74, 1979.

H. Brumm and S. A. Zollinger, Vocal plasticity in a reptile, Proceedings. Biological sciences / The Royal Society, vol.284, 2017.
DOI : 10.1098/rspb.2017.0451
URL : http://rspb.royalsocietypublishing.org/content/284/1855/20170451.full.pdf

S. M. Cerutti and E. A. Ferrari, Operant discrimination learning in detelencephalated pigeons (Columba livia). Brazilian journal of medical and biological research = Revista brasileira de pesquisas medicas e biologicas 28, pp.1089-1095, 1995.

J. Cnotka, O. Gunturkun, G. Rehkamper, R. D. Gray, and G. R. Hunt, Extraordinary large brains in tool-using New Caledonian crows (Corvus moneduloides), Neuroscience letters, vol.433, pp.241-245, 2008.
DOI : 10.1016/j.neulet.2008.01.026
URL : http://www.bio.psy.rub.de/papers/Cnotka2008.pdf

J. H. Crook, The adaptive significance of avian social organisations, Symp. zool. Soc. Lond, vol.14, pp.181-218, 1965.
DOI : 10.1016/0003-3472(64)90041-7

G. Crosby, Fight, Flight, Freeze : Taming Your Reptilian Brain and Other Practical Approaches to Self-Improvement, 2015.

N. D. Daw, Y. Niv, and P. Dayan, Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control, Nature neuroscience, vol.8, pp.1704-1711, 2005.
DOI : 10.1038/nn1560

N. D. Daw, J. P. O'doherty, P. Dayan, B. Seymour, and R. J. Dolan, Cortical substrates for exploratory decisions in humans, Nature, vol.441, pp.876-879, 2006.
DOI : 10.1038/nature04766
URL : http://pubman.mpdl.mpg.de/pubman/item/escidoc:2615117/component/escidoc:2622431/RD_Cortical_2006.pdf

M. Desmurget and R. S. Turner, Testing basal ganglia motor functions through reversible inactivations in the posterior internal globus pallidus, Journal of neurophysiology, vol.99, pp.1057-1076, 2008.
DOI : 10.1152/jn.01010.2007
URL : http://jn.physiology.org/content/jn/99/3/1057.full.pdf

M. Desmurget and R. S. Turner, Motor Sequences and the Basal Ganglia: Kinematics, Not Habits, J. Neurosci, vol.30, pp.7685-7690, 2010.
DOI : 10.1523/jneurosci.0163-10.2010
URL : http://www.jneurosci.org/content/jneuro/30/22/7685.full.pdf

J. Diamond and A. B. Bond, A Comparative Analysis of Social Play in Birds, Behaviour, vol.140, pp.1091-1115, 2003.

A. Dickinson, Actions and Habits: The Development of Behavioural Autonomy, Philosophical Transactions of the Royal Society of London. B, vol.308, p.67, 1985.
DOI : 10.1098/rstb.1985.0010

J. D. Dougan, F. K. Mcsweeney, and V. A. Farmer, Some parameters of behavioral contrast and allocation of interim behavior in rats, J Exp Anal Behav, vol.44, pp.325-335, 1985.

R. J. Douglas and K. A. Martin, Neuronal circuits of the neocortex, Annu Rev Neurosci, vol.27, pp.419-451, 2004.
DOI : 10.1146/annurev.neuro.27.070203.144152

N. J. Emery, Cognitive ornithology: the evolution of avian intelligence, Philosophical transactions of the Royal Society of London. Series B, Biological sciences, vol.361, pp.23-43, 2006.

M. S. Fee and J. H. Goldberg, A hypothesis for basal ganglia-dependent reinforcement learning in the songbird, Neuroscience, vol.198, pp.152-170, 2011.

T. Finkenstadt, Visual associative learning: Searching for behaviorally relevant brain structures in toads, Visuomotor coordination, pp.799-832, 1989.

C. D. Fiorillo, P. N. Tobler, and W. Schultz, Discrete coding of reward probability and uncertainty by dopamine neurons, Science, vol.299, pp.1898-1902, 2003.
DOI : 10.1126/science.1077349
URL : http://doc.rero.ch/record/6011/files/tobler_dcr.pdf

P. Fitts, Perceptual-motor skill learning, Categories of human learning, pp.243-285, 1964.

E. A. Melton,

L. B. Gilbert-norton, T. A. Shahan, and J. A. Shivik, Coyotes (Canis latrans) and the matching law, Behavioural processes, vol.82, pp.178-183, 2009.

D. A. Graft, S. E. Lea, and T. L. Whitworth, The matching law in and within groups of rats, J Exp Anal Behav, vol.27, pp.183-194, 1977.

A. M. Graybiel, The basal ganglia and chunking of action repertoires, Neurobiol Learn Mem, vol.70, pp.119-136, 1998.

A. M. Graybiel, Habits, rituals, and the evaluative brain, Annu Rev Neurosci, vol.31, pp.359-387, 2008.

S. Grillner, B. Robertson, and M. Stephenson-jones, The evolutionary origin of the vertebrate basal ganglia and its role in action selection, The Journal of physiology, vol.591, pp.5425-5431, 2013.

K. Guillem and S. H. Ahmed, Preference for Cocaine is Represented in the Orbitofrontal Cortex by an Increased Proportion of Cocaine Use-Coding Neurons, Cereb Cortex, 2017.
URL : https://hal.archives-ouvertes.fr/hal-01430743

O. Gunturkun, The convergent evolution of neural substrates for cognition, Psychol Res, vol.76, pp.212-219, 2012.

M. Guthrie, A. Leblois, A. Garenne, and T. Boraud, Interaction between cognitive and motor cortico-basal ganglia loops during decision making: a computational study, Journal of neurophysiology, vol.109, pp.3025-3040, 2013.
DOI : 10.1152/jn.00026.2013
URL : https://hal.archives-ouvertes.fr/hal-00828004

S. Helie, S. W. Ell, and F. G. Ashby, Learning robust cortico-cortical associations with the basal ganglia: an integrative review. Cortex; a journal devoted to the study of the nervous system and behavior, vol.64, pp.123-135, 2015.

S. Herculano-houzel, Brains matter, bodies maybe not: the case for examining neuron numbers irrespective of body size, Annals of the New York Academy of Sciences, vol.1225, pp.191-199, 2011.

S. Herculano-houzel, Not all brains are made the same: new views on brain scaling in evolution, Brain, behavior and evolution, vol.78, pp.22-36, 2011.

S. Herculano-houzel, B. Mota, and R. Lent, Cellular scaling rules for rodent brains, Proceedings of the National Academy of Sciences of the United States of America, vol.103, pp.12138-12143, 2006.
DOI : 10.1073/pnas.0604911103
URL : http://europepmc.org/articles/pmc1567708?pdf=render

R. J. Herrnstein, Formal properties of the matching law, J Exp Anal Behav, vol.21, pp.159-164, 1974.

R. J. Herrnstein, W. Vaughan, . Jr, D. B. Mumford, and S. M. Kosslyn, Teaching pigeons an abstract relational rule: insideness, Perception & psychophysics, vol.46, pp.56-64, 1989.
DOI : 10.3758/bf03208074
URL : https://link.springer.com/content/pdf/10.3758%2FBF03208074.pdf

W. Hodos and A. B. Butler, Evolution of sensory pathways in vertebrates, Brain, behavior and evolution, vol.50, pp.189-197, 1997.

J. C. Horton and D. L. Adams, The cortical column: a structure without a function, Philosophical Transactions of the Royal Society B: Biological Sciences, vol.360, p.837, 2005.

J. C. Houk and S. P. Wise, Distributed modular architectures linking basal ganglia, cerebellum, and cerebral cortex: their role in planning and controlling action, Cereb Cortex, vol.5, pp.95-110, 1995.

M. Jahanshahi, I. Obeso, C. Baunez, M. Alegre, and P. Krack, Parkinson's Disease, the Subthalamic Nucleus, Inhibition, and Impulsivity. Movement disorders : official journal of the, 2014.

E. J. Jaldow, D. A. Oakley, and G. C. Davey, Performance of Decorticated Rats on Fixed Interval and Fixed Time Schedules, The European journal of neuroscience, vol.1, pp.461-470, 1989.

D. Kahneman, Thinking, fast and slow. Farrar, Straus and Giroux, 2011.

H. Kawase, Y. Okata, and K. Ito, Role of huge geometric circular structures in the reproduction of a marine pufferfish, Sci Rep, vol.3, p.2106, 2013.

C. Keysers and D. I. Perrett, Demystifying social cognition: a Hebbian perspective, Trends in cognitive sciences, vol.8, pp.501-507, 2004.

M. Khamassi and M. D. Humphries, Integrating cortico-limbic-basal ganglia architectures for learning model-based and model-free navigation strategies, Frontiers in behavioral neuroscience, vol.6, p.79, 2012.
URL : https://hal.archives-ouvertes.fr/hal-01219958

M. Kukleta and S. Libouban, Journal de physiologie, vol.59, p.442, 1967.

B. Lau and P. W. Glimcher, Value representations in the primate striatum during matching behavior, Neuron, vol.58, pp.451-463, 2008.

L. Masson, G. Renaud-le-masson, S. Debay, D. Bal, and T. , Feedback inhibition controls spike transfer in hybrid thalamic circuits, Nature, vol.417, pp.854-858, 2002.
URL : https://hal.archives-ouvertes.fr/hal-00124031

A. Leblois, T. Boraud, W. Meissner, H. Bergman, and D. Hansel, Competition between feedback loops underlies normal and pathological dynamics in the basal ganglia, The Journal of neuroscience : the official journal of the Society for Neuroscience, vol.26, pp.3567-3583, 2006.
DOI : 10.1523/jneurosci.5050-05.2006
URL : https://hal.archives-ouvertes.fr/hal-00173766

A. Leblois, W. Meissner, E. Bezard, B. Bioulac, C. E. Gross et al., Temporal and spatial alterations in GPi neuronal encoding might contribute to slow down movement in parkinsonian monkeys, The European journal of neuroscience, vol.24, pp.1201-1208, 2006.
DOI : 10.1111/j.1460-9568.2006.04984.x

S. Lehericy, H. Benali, P. F. Van-de-moortele, M. Pelegrini-issac, T. Waechter et al., Distinct basal ganglia territories are engaged in early and advanced motor sequence learning, Proceedings of the National Academy of Sciences of the United States of America, vol.102, pp.12566-12571, 2005.
DOI : 10.1073/pnas.0502762102
URL : http://www.pnas.org/content/102/35/12566.full.pdf

R. N. Lemon and J. Griffiths, Comparing the function of the corticospinal system in different species: organizational differences for motor specialization?, Muscle Nerve, vol.32, pp.261-279, 2005.

C. J. Logan, S. A. Jelbert, A. J. Breen, R. D. Gray, and A. H. Taylor, Modifications to the Aesop's Fable Paradigm Change New Caledonian Crow Performances, PloS one, vol.9, p.103049, 2014.
DOI : 10.1371/journal.pone.0103049
URL : https://doi.org/10.1371/journal.pone.0103049

P. D. Maclean, An evolutionary approach to the investigation of psychoneuro-endocrine functions, 1973.

N. Mallet, B. R. Micklem, P. Henny, M. T. Brown, C. Williams et al., Dichotomous organization of the external globus pallidus, Neuron, vol.74, pp.1075-1086, 2012.
DOI : 10.1016/j.neuron.2012.04.027
URL : https://doi.org/10.1016/j.neuron.2012.04.027

N. Mallet, R. Schmidt, D. Leventhal, F. Chen, N. Amer et al., Arkypallidal Cells Send a Stop Signal to Striatum, Neuron, vol.89, pp.308-316
DOI : 10.1016/j.neuron.2015.12.017
URL : https://doi.org/10.1016/j.neuron.2015.12.017

L. R. Matthews and W. Temple, Concurrent schedule assessment of food preference in cows, J Exp Anal Behav, vol.32, pp.245-254, 1979.

J. W. Mink, The basal ganglia: focused selection and inhibition of competing motor programs, Prog. Neurobiol, vol.50, pp.381-425, 1996.

S. Miyachi, O. Hikosaka, and X. Lu, Differential activation of monkey striatal neurons in the early and late stages of procedural learning, Experimental brain research. Experimentelle Hirnforschung. Experimentation cerebrale, vol.146, pp.122-126, 2002.

R. Mooney, Behavioral learning. The illuminated songbird, Current biology : CB, vol.5, pp.609-611, 1995.

G. Morris, A. Nevet, D. Arkadir, E. Vaadia, and H. Bergman, Midbrain dopamine neurons encode decisions for future action, Nature neuroscience, vol.9, pp.1057-1063, 2006.
DOI : 10.1038/nn1743

A. Nambu, H. Tokuno, I. Hamada, H. Kita, M. Imanishi et al., Excitatory cortical inputs to pallidal neurons via the subthalamic nucleus in the monkey, Journal of neurophysiology, vol.84, pp.289-300, 2000.

A. Nambu, H. Tokuno, and M. Takada, Functional significance of the cortico-subthalamopallidal 'hyperdirect' pathway, Neurosci Res, vol.43, pp.111-117, 2002.

F. Nottebohm, A. Alvarez-buylla, J. Cynx, J. Kirn, C. Y. Ling et al., Song learning in birds: the relation between perception and production, Philosophical transactions of the Royal Society of London. Series B, Biological sciences, vol.329, pp.115-124, 1990.

L. A. O'connell and H. A. Hofmann, The vertebrate mesolimbic reward system and social behavior network: a comparative synthesis, The Journal of comparative neurology, vol.519, pp.3599-3639, 2011.

R. C. O'reilly and M. J. Frank, Making working memory work: a computational model of learning in the prefrontal cortex and basal ganglia, Neural computation, vol.18, pp.283-328, 2006.

D. A. Oakley, Performance of decorticated rats in a two-choice visual discrimination apparatus, Behavioural brain research, vol.3, pp.55-69, 1981.

F. M. Ocana, S. M. Suryanarayana, K. Saitoh, A. A. Kardamakis, L. Capantini et al., The lamprey pallium provides a blueprint of the mammalian motor projections from cortex, Current biology : CB, vol.25, pp.413-423, 2015.

S. Palminteri, T. Boraud, G. Lafargue, B. Dubois, and M. Pessiglione, Brain hemispheres selectively track the expected value of contralateral options, The Journal of neuroscience : the official journal of the Society for Neuroscience, vol.29, pp.13465-13472, 2009.
DOI : 10.1523/jneurosci.1500-09.2009
URL : http://www.jneurosci.org/content/jneuro/29/43/13465.full.pdf

A. Parent and L. Hazrati, Functional anatomy of the basal ganglia. I. The cortico-basal ganglia-thalamo-cortical loop, Brain Res. Rev, vol.20, pp.91-127, 1995.

A. Parent and L. Hazrati, Functional anatomy of the basal ganglia. II. The place of subthalamic nucleus and external pallidum in basal ganglia circuitry, Brain Res. Rev, vol.20, pp.128-154, 1995.

B. Pasquereau, A. Nadjar, D. Arkadir, E. Bezard, M. Goillandeau et al., Shaping of motor responses by incentive values through the basal ganglia, The Journal of neuroscience : the official journal of the Society for Neuroscience, vol.27, pp.1176-1183, 2007.

A. Pasupathy and E. K. Miller, Different time courses of learning-related activity in the prefrontal cortex and striatum, Nature, vol.433, pp.873-876, 2005.

B. W. Patton and V. A. Braithwaite, Changing tides: ecological and historical perspectives on fish cognition, Wiley Interdiscip Rev Cogn Sci, vol.6, pp.159-176, 2015.
DOI : 10.1002/wcs.1337

P. Patton and P. Grobstein, The effects of telencephalic lesions on visually mediated prey orienting behavior in the leopard frog (Rana pipiens). I. The effects of complete removal of one telencephalic lobe, with a comparison to the effects of unilateral tectal lobe lesions, Brain, behavior and evolution, vol.51, pp.123-143, 1998.

A. R. Pfenning, E. Hara, O. Whitney, M. V. Rivas, R. Wang et al., , vol.346, p.1256846, 2014.

C. Piron, D. Kase, M. Topalidou, M. Goillandeau, H. Orignac et al., The globus pallidus pars interna in goal-oriented and routine behaviors: Resolving a long-standing paradox, Movement disorders : official journal of the Movement Disorder Society, vol.31, pp.1146-1154, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01317968

R. A. Poldrack, F. W. Sabb, K. Foerde, S. M. Tom, R. F. Asarnow et al., The neural correlates of motor skill automaticity, The Journal of neuroscience : the official journal of the Society for Neuroscience, vol.25, pp.5356-5364, 2005.

M. A. Pombal, M. Megias, S. M. Bardet, and L. Puelles, New and old thoughts on the segmental organization of the forebrain in lampreys, Brain, behavior and evolution, vol.74, pp.7-19, 2009.
URL : https://hal.archives-ouvertes.fr/hal-01082206

M. A. Pombal and L. Puelles, Prosomeric map of the lamprey forebrain based on calretinin immunocytochemistry, Nissl stain, and ancillary markers, The Journal of comparative neurology, vol.414, pp.391-422, 1999.

H. Prior, A. Schwarz, and O. Gunturkun, Mirror-induced behavior in the magpie (Pica pica): evidence of self-recognition, PLoS biology, vol.6, p.202, 2008.

L. Puelles, E. Kuwana, E. Puelles, A. Bulfone, K. Shimamura et al., Pallial and subpallial derivatives in the embryonic chick and mouse telencephalon, traced by the expression of the genes Dlx-2, Emx-1, Nkx-2.1, Pax-6, and Tbr-1, The Journal of comparative neurology, vol.424, pp.409-438, 2000.

A. Reiner, D. J. Perkel, C. V. Mello, and E. D. Jarvis, Songbirds and the revised avian brain nomenclature, Annals of the New York Academy of Sciences, vol.1016, pp.77-108, 2004.

K. Samejima and K. Doya, Multiple representations of belief states and action values in corticobasal ganglia loops, Annals of the New York Academy of Sciences, vol.1104, pp.213-228, 2007.

C. Scharff and F. Nottebohm, A comparative study of the behavioral deficits following lesions of various parts of the zebra finch song system: implications for vocal learning, The Journal of neuroscience : the official journal of the Society for Neuroscience, vol.11, pp.2896-2913, 1991.

W. Schultz, Activity of dopamine neurons in the behaving primate, Seminars in the neurosciences, vol.4, pp.129-138, 1992.

W. Schultz, Behavioral theories and the neurophysiology of reward, Annu Rev Psychol, vol.57, pp.87-115, 2006.

W. Schultz, P. Dayan, and P. R. Montague, A neural substrate of prediction and reward, Science, vol.275, pp.1593-1599, 1997.

C. A. Seger and B. J. Spiering, A critical review of habit learning and the Basal Ganglia. Frontiers in systems neuroscience 5, p.66, 2011.

G. Silberberg and J. P. Bolam, Local and afferent synaptic pathways in the striatal microcircuitry, Current opinion in neurobiology, vol.33, pp.182-187, 2015.

S. Song, K. D. Miller, and L. F. Abbott, Competitive Hebbian learning through spike-timingdependent synaptic plasticity, Nature neuroscience, vol.3, pp.919-926, 2000.
DOI : 10.1038/78829

M. Stephenson-jones, J. Ericsson, B. Robertson, and S. Grillner, Evolution of the basal ganglia: dual-output pathways conserved throughout vertebrate phylogeny, The Journal of comparative neurology, vol.520, pp.2957-2973, 2012.

G. F. Striedter, Principles of brain evolution, 2005.

D. H. Taylor and K. Adler, Spatial orientation by Salamanders using plane-polarized light, Science, vol.181, pp.285-287, 1973.
DOI : 10.1126/science.181.4096.285

O. Tchernichovski and G. Marcus, Vocal learning beyond imitation: mechanisms of adaptive vocal development in songbirds and human infants, Current opinion in neurobiology, vol.28, pp.42-47, 2014.

M. Topalidou, D. Kase, T. Boraud, and N. Rougier,

M. Topalidou, A. Leblois, T. Boraud, and N. P. Rougier, A long journey into reproducible computational neuroscience. Frontiers in computational neuroscience 9, p.30, 2015.
DOI : 10.3389/fncom.2015.00030
URL : https://hal.archives-ouvertes.fr/hal-01109483

A. M. Travis and C. N. Woolsey, MOTOR PERFORMANCE OP MONKEYS AFTER BILATERAL PARTIAL AND TOTAL CEREBRAL DECORTICATIONS, American Journal of Physical Medicine & Rehabilitation, vol.35, 1956.

R. S. Turner and M. Desmurget, Basal ganglia contributions to motor control: a vigorous tutor, Current opinion in neurobiology, vol.20, pp.704-716, 2010.
DOI : 10.1016/j.conb.2010.08.022
URL : http://europepmc.org/articles/pmc3025075?pdf=render

P. Vernier, The Brain of Teleos Fishes, Evolution of the Nervous System, pp.59-76, 2017.

E. J. Kaas,

T. L. Warren, E. C. Tumer, J. D. Charlesworth, and M. S. Brainard, Mechanisms and time course of vocal learning and consolidation in the adult songbird, Journal of neurophysiology, vol.106, pp.1806-1821, 2011.

I. Q. Whishaw, T. Schallert, and B. Kolb, An analysis of feeding and sensorimotor abilities of rats after decortication, J Comp Physiol Psychol, vol.95, pp.85-103, 1981.

L. Wilkinson, Z. Khan, and M. Jahanshahi, The role of the basal ganglia and its cortical connections in sequence learning: evidence from implicit and explicit sequence learning in Parkinson's disease, Neuropsychologia, vol.47, pp.2564-2573, 2009.

R. Willemet, Reconsidering the evolution of brain, cognition, and behavior in birds and mammals, Frontiers in psychology, vol.4, p.396, 2013.

M. F. Wullimann and P. Vernier, Evolution of the Nervous System in Fishes In: Evolution of Nervous Systems, pp.39-60, 2007.

H. H. Yin and B. J. Knowlton, The role of the basal ganglia in habit formation, Nat Rev Neurosci, vol.7, pp.464-476, 2006.

H. H. Yin, B. J. Knowlton, and B. W. Balleine, Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning, The European journal of neuroscience, vol.19, pp.181-189, 2004.

H. H. Yin, S. B. Ostlund, B. J. Knowlton, and B. W. Balleine, The role of the dorsomedial striatum in instrumental conditioning, The European journal of neuroscience, vol.22, pp.513-523, 2005.

, DA: dopamine DP: dorsal pallium GABA: gamma-aminobutyric acid GPe: external segment of the globus pallidus GPi: internal segment of the globus pallidus HL: Hebbian learning MC: motor cortex MLR: mesencephalic locomotor region MSN: medium spiny neurons OFC: orbitofrontal cortex PFC: prefrontal cortex PMC: premotor cortex RL: reinforcement learning SNr: substancia nigra pars reticulata STN, Abbreviations ACC: anterior cingulate cortex BG: basal ganglia CBG: cortex-basal ganglia (loop)