After several decades of developments in AI, has the inspiration that can be drawn from neuroscience been exhausted? Recent initiatives make the case for taking a fresh look at the intersection between the two fields.
The effects of neuroscience on artificial intelligence (AI), and the mutual influence of the two fields, have been discussed and debated in the past few decades. Not long after the seminal workshop at Dartmouth College in 1956, which launched the field of AI, artificial neural networks called perceptrons were introduced by Rosenblatt. He studied them as simple models of brain-inspired systems following earlier work, including from McCulloch and Pitts, who introduced formal models of biological neurons, and from Hebb, who postulated the conditions under which the connection strengths of biological neurons change. Research on hierarchical processing in the visual system in the 1960s inspired the development of convolutional neural networks in the 1980s. However, as AI research has evolved at a fast pace, progress over recent years has stirred a divergence from this original neuroscience inspiration. The pursuit of more powerful artificial neural systems in leading AI research labs, particularly those affiliated with tech companies, is currently focussed on engineering. This pursuit emphasizes further scaling up of complex architectures such as transformers, rather than integrating insights from neuroscience.
Credit: [Vertigo3d]/[E+]/Getty
A recent panel discussing the role of neuroscience in contemporary AI research and the extent of their mutual influence was convened at COSYNE, the leading computational and systems neuroscience conference. The panel involved Anthony Zador (Cold Spring Harbor Laboratory), Alexandre Pouget (University of Geneva), Blaise Aguera y Arcas (Google), Kim Stachenfeld (Google DeepMind and Columbia University), Jonathan Pillow (Princeton University) and Eva Dyer (Georgia Institute of Technology), with Paul Middlebrooks (host of the Brain-Inspired podcast) moderating.
Interestingly, the panellists did not seem to agree on the extent to which neuroscience currently influences and is influenced by AI research. For example, Aguera y Arcas believes that, historically, progress has resulted at times of convergence between the two fields and that, even though this does not seem to be the case now, in the future we might discover parallels between transformers and brain computation. This optimism was echoed by Zador, who argued that neuroscience has provided key insights for AI. He stated that the missing piece in current AI methods may come from basic research in neuroscience. By contrast, Pouget stated that although neuroscience labs are pushing hard to discover fundamental principles that can be incorporated into AI, nothing especially convincing has emerged in the past three decades, whereas, in contrast, neuroscience research has been profoundly influenced by recent developments in AI. This seems to be confirmed by Stachenfelds comment that the use of AI methods in brain research is a low-hanging fruit that has influenced the way neuroscience research is pursued at Google DeepMind. Dyer noted that with the shift of AI towards transformers and other complex architectures, the field seems to have moved away from its neural-inspired roots; however, AI may still look towards neuroscience for help in understanding complex information processing systems.
The COSYNE panel forms part of a recent coalition of initiatives around NeuroAI, a push to identify fresh ideas at the intersection between neuroscience and AI. For example, Neuromatch, a platform facilitating global collaboration in computational sciences, has developed a NeuroAI course scheduled for July 2024 on the common principles of natural and artificial intelligence. Other programs that promote interdisciplinary collaboration include the Cold Spring Harbor NeuroAI program, which will hold its third conference From neuroscience to artificially intelligent systems in autumn 2024. Academic institutions are embracing NeuroAI, as evidenced by NeuroAI and Intelligent Systems at Princeton University and UCL NeuroAI at University College London, which encourage collaboration between the neuroscience and AI communities.
Scientific meetings such as COSYNE have a crucial role in convening researchers drawn to ideas that transcend traditional academic boundaries. In a perspective article on the origins of COSYNE1, Zador highlights how such meetings create and nurture communities, such as theoretical and experimental neuroscientists, while facilitating the exchange of scientific languages. During the Q&A session of the COSYNE panel discussion, Pouget emphasized the roles of neuroscience, cognitive science and AI in understanding the brain, and expressed concerns about the limited representation of contributions from cognitive science and cognitive neuroscience at the conference. This frustration prompted researchers in these fields to establish the Cognitive and Computational Neuroscience Conference (CCN), which organized its first meeting in 2017. Although distinct, CCN and COSYNE complement one another, offering intriguing prospects for exploring how the different approaches systems neuroscience versus cognitive science and cognitive neuroscience shape and are shaped by AI.
Overall, the extent of the role of neuroscience in AI research, and that of AI in neuroscience research, remain open questions for the future. However, these two fields are deeply linked, and the exchange of ideas between them continues to evolve. The upcoming generation of scientists will need to possess fluency in both domains, making interdisciplinary programs such as Neuromatch and conferences such as COSYNE and CNN indispensable. The (re)emergence of NeuroAI will prompt researchers to explore the crucial questions necessary for uncovering some of the brains computational principles that have remained elusive, paving the way for the development of more intelligent machines.
Go here to see the original:
The new NeuroAI - Nature.com
- Unlocking Flow: The Neuroscience of Creative Bliss - Neuroscience News - April 15th, 2024 [April 15th, 2024]
- Revolutionizing Glioblastoma Treatment - Neuroscience News - April 15th, 2024 [April 15th, 2024]
- Decoding spontaneous thoughts from the brain via machine learning - EurekAlert - April 15th, 2024 [April 15th, 2024]
- Reducing Toxic AI Responses - Neuroscience News - April 15th, 2024 [April 15th, 2024]
- Advancing the neuroscience of human pregnancy - Nature.com - April 15th, 2024 [April 15th, 2024]
- Angela Bryan Awarded Hazel Barnes Prize | Psychology and Neuroscience - University of Colorado Boulder - April 15th, 2024 [April 15th, 2024]
- How Old Are You in Your Head? The Neuroscience of Subjective Age Reveals How to Stay Mentally Young - Inc. - April 15th, 2024 [April 15th, 2024]
- Biohaven Showcases Innovative Neuroscience Portfolio with 20 Presentations at the 2024 American Academy of ... - PR Newswire - April 15th, 2024 [April 15th, 2024]
- Those Who Use Willpower Deemed More Trustworthy - Neuroscience News - April 15th, 2024 [April 15th, 2024]
- How Sex and Gender Shape Our Cognition - Neuroscience News - April 15th, 2024 [April 15th, 2024]
- War's Toll on the Brain: Widespread PTSD and Anxiety Among Ukrainians - Neuroscience News - April 15th, 2024 [April 15th, 2024]
- Paints and Pesticides Linked to ALS Risk - Neuroscience News - April 15th, 2024 [April 15th, 2024]
- AI STORIES: A New Vision for AI and Narratives - Neuroscience News - April 15th, 2024 [April 15th, 2024]
- Neuroscience Breakthrough Unveils How We Learn and Remember - SciTechDaily - April 15th, 2024 [April 15th, 2024]
- Pregnancy's Toll: Accelerated Aging in Young Mothers - Neuroscience News - April 15th, 2024 [April 15th, 2024]
- Learning and Memory Formation's Molecular Basis - Neuroscience News - April 15th, 2024 [April 15th, 2024]
- Acetaminophen in Pregnancy Not Linked to Autism, ADHD Risk - Neuroscience News - April 15th, 2024 [April 15th, 2024]
- Childhood Loneliness Linked to Later Psychosis - Neuroscience News - April 15th, 2024 [April 15th, 2024]
- Vigil Neuroscience, Inc. (NASDAQ:VIGL) Expected to Post Q1 2024 Earnings of ($0.58) Per Share - Defense World - March 29th, 2024 [March 29th, 2024]
- International Brain Research Organisation (IBRO) Diversity Grants 2024 Opportunity Desk - Opportunity Desk - March 29th, 2024 [March 29th, 2024]
- Hereditary Alzheimer's Transmitted Via Bone Marrow Transplants - Neuroscience News - March 29th, 2024 [March 29th, 2024]
- Household Chemicals Linked to Brain Health Risks - Neuroscience News - March 29th, 2024 [March 29th, 2024]
- Cheers to Longevity: Couples Who Drink Together, Live Longer - Neuroscience News - March 29th, 2024 [March 29th, 2024]
- Sleeplessness Makes You Feel Up To Ten Years Older - Neuroscience News - March 29th, 2024 [March 29th, 2024]
- Aging Brain Cells Have Prolonged Death Process - Neuroscience News - March 29th, 2024 [March 29th, 2024]
- Anxiety Drives Wishful Thinking to Risky Levels - Neuroscience News - March 29th, 2024 [March 29th, 2024]
- Prolonged Progestogen Use Linked to Brain Tumor Risk - Neuroscience News - March 29th, 2024 [March 29th, 2024]
- The Genetic Secrets of Neuron Formation - Neuroscience News - March 29th, 2024 [March 29th, 2024]
- Vigil Neuroscience Reports Fourth Quarter and Full Year 2023 Financial Results and Provides Business Update - Yahoo Finance - March 29th, 2024 [March 29th, 2024]
- Big research, little time: Medical neuroscience student wins 3 Minute Thesis finals - Dal News - March 29th, 2024 [March 29th, 2024]
- Exploring Aphantasia: The Mind Without a Mental Picture - Neuroscience News - March 29th, 2024 [March 29th, 2024]
- Altered Brain pH Linked to Cognitive Disorders - Neuroscience News - March 29th, 2024 [March 29th, 2024]
- Emotion vs. Reason: Rethinking Decision-Making - Neuroscience News - March 29th, 2024 [March 29th, 2024]
- DNA Damage and Inflammation Key to Memory Formation - Neuroscience News - March 29th, 2024 [March 29th, 2024]
- Embracing Neurodiversity: Beyond Stigma to Strength - Neuroscience News - March 29th, 2024 [March 29th, 2024]
- Devil in the Details: The Visual World of Prosopometamorphopsia - Neuroscience News - March 29th, 2024 [March 29th, 2024]
- Rockefeller Neuroscience Institute receives $2M grant for ultrasound drug addiction treatments - Health Imaging - March 29th, 2024 [March 29th, 2024]
- Empathy Begins in Infancy - Neuroscience News - March 29th, 2024 [March 29th, 2024]
- Mapping Brain Activity with Brain-Computer Interface Technology - Neuroscience News - March 29th, 2024 [March 29th, 2024]
- Want Better Mental Focus? Neuroscience Just Found This Simple, Joyful Activity Helps Your Brain Concentrate - Inc. - March 29th, 2024 [March 29th, 2024]
- The neuroscience of groove: Why certain rhythms make us want to dance - PsyPost - March 29th, 2024 [March 29th, 2024]
- High Rates of Suicidal Ideation in Rural Black Men - Neuroscience News - March 29th, 2024 [March 29th, 2024]
- Harmony in Chaos: How BPD Influences Music Tastes - Neuroscience News - March 29th, 2024 [March 29th, 2024]
- WVU Rockefeller Neuroscience Institute receives $2M Grant - WDTV - March 29th, 2024 [March 29th, 2024]
- Study Links Diet, Diabetes, and Alzheimers - Neuroscience News - March 29th, 2024 [March 29th, 2024]
- Neuroscience and Society Series: Aligning Science with the Public's Values - The Hastings Center - March 29th, 2024 [March 29th, 2024]
- Hardwiring Your Brain: The Neuroscience Of Behaviour Change | TheHealthSite.com - TheHealthSite - March 29th, 2024 [March 29th, 2024]
- Refined Carb Intake's Effect on Facial Attractiveness - Neuroscience News - March 11th, 2024 [March 11th, 2024]
- Linking Childhood Adversity to Adult Mental Health - Neuroscience News - March 11th, 2024 [March 11th, 2024]
- Overnight neuronal plasticity and adaptation to emotional distress - Nature.com - March 11th, 2024 [March 11th, 2024]
- Less Obesity and Depression in NPD Individuals - Neuroscience News - March 11th, 2024 [March 11th, 2024]
- Unlocking Creative Flow: How the Brain Enters the Zone - Neuroscience News - March 11th, 2024 [March 11th, 2024]
- Self-Control, Not Impulsivity, Paves the Way to Power - Neuroscience News - March 11th, 2024 [March 11th, 2024]
- 3D Maps Reveal Molecular Complexities of the Brain - Neuroscience News - March 11th, 2024 [March 11th, 2024]
- Loneliness Linked to Personality Disorders - Neuroscience News - March 11th, 2024 [March 11th, 2024]
- Gen Z's Climate Anxiety: A Call for Action and Hope - Neuroscience News - March 11th, 2024 [March 11th, 2024]
- Decoding Emotions: Beyond Senses in the Human Brain - Neuroscience News - March 11th, 2024 [March 11th, 2024]
- Brain Circuit Balances Speech and Breath - Neuroscience News - March 11th, 2024 [March 11th, 2024]
- Schizophrenia and Aging Share Brain Changes - Neuroscience News - March 11th, 2024 [March 11th, 2024]
- Monitoring Spinal Cord Activity During Surgery in Real-Time - Neuroscience News - March 11th, 2024 [March 11th, 2024]
- Scientists team up with jazz musicians to reveal the neuroscience of creative flow - PsyPost - March 11th, 2024 [March 11th, 2024]
- Peer Pressure Persists Through Adulthood - Neuroscience News - March 11th, 2024 [March 11th, 2024]
- Mary Bartlett Bunge, 92, Dies; Pioneer in Spinal Injury Treatment - The New York Times - March 11th, 2024 [March 11th, 2024]
- Rethinking Reminiscence: Theater's Ageism Dilemma Unveiled - Neuroscience News - March 11th, 2024 [March 11th, 2024]
- PTSD: Virtual Reality and Magnetic Stimulation Provide Relief - Neuroscience News - March 11th, 2024 [March 11th, 2024]
- The Partisan Morality Divide: When Politics Shapes Right and Wrong - Neuroscience News - March 11th, 2024 [March 11th, 2024]
- Biological Sciences Professor Terrence Sejnowski Wins Brain Prize - University of California San Diego - March 11th, 2024 [March 11th, 2024]
- Pioneering work in computational and theoretical neuroscience is awarded the world's largest brain research prize - afp.com - March 11th, 2024 [March 11th, 2024]
- Substance Abuse Beyond Dopamine and Impulsivity - Neuroscience News - March 11th, 2024 [March 11th, 2024]
- Pioneering work in computational and theoretical neuroscience is awarded the world's largest brain research prize - Business Wire - March 11th, 2024 [March 11th, 2024]
- Dal study of football players sheds light on how concussions affect the brain - Yahoo Canada Sports - March 11th, 2024 [March 11th, 2024]
- Hebrew University's Haim Sompolinsky awarded prestigious Brain Prize for pioneering neuroscience research - The Times of Israel - March 11th, 2024 [March 11th, 2024]
- Harvard neuroscientist Haim Sompolinsky awarded Brain Prize - EurekAlert - March 11th, 2024 [March 11th, 2024]
- Rhythm in the Brain: Music Exposure Influences Rhythmic Interpretation - Neuroscience News - March 11th, 2024 [March 11th, 2024]
- Physicist Haim Sompolinsky first Israeli to win largest brain science research prize - The Times of Israel - March 11th, 2024 [March 11th, 2024]
- Prestigious 2024 Brain Prize awarded to Hebrew University's Prof. Haim Sompolinsky by Lundbeck Foundation - EurekAlert - March 11th, 2024 [March 11th, 2024]
- Pioneering work in computational and theoretical neuroscience is awarded the world's largest brain research prize - EurekAlert - March 11th, 2024 [March 11th, 2024]
- Role of AI in Neuroscience Research and Understanding of the Human Brain - Medriva - February 13th, 2024 [February 13th, 2024]
- Healis selected to present at key biotechnology and neuroscience investor conferences in Amsterdam, New York, - EIN News - February 13th, 2024 [February 13th, 2024]
- Brain's Method for Preserving Cognition in Aging Revealed - Neuroscience News - February 13th, 2024 [February 13th, 2024]