In this Directors Conversation, HAI Denning Co-Director Fei-Fei Lis guest is William Newsome, the Harman Family Provostial Professor of Neurobiology at the Stanford University School of Medicine and the Vincent V.C. Woo Director of the Wu Tsai Neurosciences Institute.

Here Li and Newsome discuss the role of computation in neuroscience, the challenges computational neuroscientists can address, whether understanding the brain at a molecular level can lead to better neural networks, AIs motivation spectrum, and the complicated definition of consciousness when it comes to both natural intelligence and artificial.

Full transcript:

Fei-Fei Li: Welcome to HAIs Directors Conversations, where we discuss advances in AI with leaders in the field and around the world. Today with me is Professor Bill Newsome. Im very, very excited to have this conversation with Bill. We have been having conversations throughout our career, and Ive been such a great admirer of Bills scholarship and leadership. Hes the Professor of Neurobiology at Stanford School of Medicine and the Director of the Wu Tsai Neurosciences Institute at Stanford. Bill has made significant contributions to understanding of neural mechanisms underlying visual perception and simple forms of decision-making. As head of Wu Tsai Institute, hes focused on multidisciplinary research that helps us understand the brain, and provide new treatments for brain disorders, and promote brain health.

So welcome, Bill. Im very much looking forward to this conversation.

Bill Newsome: Great to be here, Fei-Fei. Nice to see you again.

Li: Lets start with just defining and talking about the intersection of AI and neuroscience. What do you see as the role of computation in your field, and Wu Tsai Institutes work?

Newsome: Well, thats a great question. Computation is extremely important in the field of neuroscience today. There are two or three different ways I could answer that question, but let me try this one on you. We actually have a subfield called computational neuroscience. Weve hired faculty in this area here at Stanford, and we hope to hire more. People sometimes ask me, What is that? And I would put it this way. Computation in neuroscience has about three different areas that are really, really important. The first area is theorists: its people who actually try to theorize and extract general principles about how the brain is computing, how the brain is representing, how the brain produces action.

The second area I would call neural network kinds of people: modelers, people who really understand how to do deep convolutional networks and understand how to do recurrent neural networks, and actually model simple toy problems that we know the nervous system solves. If we can figure out how these networks solve these problems, then we can get some insight maybe into new hypotheses about the nervous system.

And then a third way that computation is really influencing neuroscience is through high-end data analytics. Like many areas of science, we are getting larger, richer, more sophisticated, and sometimes much more obscure datasets now out of the brain than weve ever been able to get in human history. And to actually understand how to deal with those data, how to treat them, how to avoid statistical pitfalls is extremely important.

I think all three of those areas of computation are really important for neuroscience. I think different computational neuroscientists may excel in two, or occasionally even all three of those, but we need more people like this in neuroscience today, not fewer, because the challenges are greater than theyve ever been.

Li: What are the biggest challenges that you feel are in need of this kind of computational neuroscientist?

Newsome: Well, let me give you some real-world examples; maybe give you one where computation has actually played a leading role and other approaches to neuroscience are lagging behind, and one where computation needs to step in and create a role in order to create understanding.

So one area that I would give to you is something in the nervous system called integration, and its familiar to anyone whos taken calculus. Its literally counting up events that happen, literally integrating some time series and saying how much you have at the end. This turns out to be a really important problem in the nervous system in many areas, including decision making, but a very simple one. Its just moving your eyes. So we know when you move your eyes from this point to this point, certain neurons give a little burst in a map of eye movement space in the brain, and when they get the burst, the eyes go out there. The amazing thing is they stay there after they get there, even though the burst is gone.

And the theorizing, the theory of computation is about integration: How could you take neural signals of the burst, integrate some value that holds the eyes in position until an animal is ready to move the eyes again? We knew some things about the physiology, we knew some things about the computation, we knew some things about the connectivity of brain structures that produce eye movements. What we really lacked was actually anatomy, in this case.

It turned out that several different computational theories that embodied physical principles could account for this, but to know which one is actually working in the brain, we needed the microanatomy of how cells are really hooked up to each other. Thats an example where computational theory actually led the way and motivated some anatomical questions.

But one that many listeners to this will resonate with today is the example of deep convolutional networks that are approaching human performance in visual categor-

Li: Surpassing in some cases.

Newsome: Surpassing in some cases, absolutely. Peoples jobs are insecure here because these networks are getting so good at visual categorization. And this presents a really interesting problem, because youre going to train a deep convolutional network that can do these things that seem almost magical, and we know almost everything there is to know about them, right? We know exactly the connections between the layers of the trained network, we know the signals that are passing, we can see the dynamics that exist, we can measure their performance. But there is still this deep angst, an intellectual angst, Id say, among neuroscientists, and I think among some people in the AI community, that we still dont understand how thats happened.

What are the algorithmic principles by which you take an array of pixels and you turn it into faces, and distinguish among faces? And somehow, the deep physical and computational principles are not there yet. We dont understand how these things are working. We understand the learning algorithm, and maybe thats as deep as itll get at some point. But heres a situation where I think computation needs to step in and teach us this, both for the artificial networks, and then for the real networks in our brains that recognize faces.

Li: Bill, I want to elaborate on that because neural networks, especially in visual recognition, are dear and near to my heart. On the one hand its phenomenal, right? We have these hundreds-layered, sometimes even thousand-layered convolutional neural network or recurrent network algorithms that are just very complex and can perform phenomenally well. When it comes to object recognition, some of these networks do surpass human capability. But in the meantime, if you look inside under the hood of these algorithms, while theyre humongous, theyre also extremely contrived compared to the brain.

Ill just take one example of the neuron-to-neuron communication. The way that its realized in todays neural network algorithm is a single scalar value, whereas the synaptic communication in the brain, as we learn more, and your colleagues will tell us, is far more complex. The neural signaling is not just one kind of neural signaling. I would love to hear more about this.

Also, on a little more system level, our brain is this organic organ that has evolved for at least the past 500 million years; the mammalian brain is about 100 million years, and it has different parts, and different modules, and all that. And todays neural network is nowhere near that kind of complexity and architecture.

So on one hand these humongous deep learning models are doing phenomenally well. On the other hand, theyre also very contrived compared to the brain. And Im just very intrigued: from your perspective, as we learn more about these computational realities of the brain at the molecular level, at the synaptic level and the system level, do you see that were going to have different insights how to build these neural networks?

Newsome: I hope so, Fei-Fei. I think this is one of the deepest intellectual questions that computationally-minded neuroscientists argue about, and thats to what extent are AI, and what I call NI natural intelligence going to converge at some point and really be useful dialogue partners? And to what extent are they simply going to be ships passing in the night, or theyre going to be parallel universes? Because there are these dramatic differences, as you point out.

One individual neuron and our brain contains about 100 billion of them is incredibly complex: incredibly complex shapes and incredibly complex biophysics, and different types of neurons in our brain have different types of physics. Theyre profoundly non-linear, and they are hooked together in these synapses and ways that form circuits, and understanding and mapping those circuits is a big fundamental problem in neuroscience.

But something that should give all of us great pause is that there are these substances that are released locally in the brain called neuromodulator substances, and they actually diffuse to thousands of synapses in the space around them in the brain, and they can completely change that circuitry. This is beautiful, beautiful work by Eve Marder, who spent her career studying this neuromodulation. You take one group of neurons that are hooked up in a particular way, spritz on this neuromodulator, and suddenly theyre a different circuit, literally.

Li: Yeah, thats fascinating. We dont have that computational mechanism at all in our deep learning architecture.

Newsome: And another feature of brain architecture, that you and I have talked about offline together, is that brain architecture is almost universally recurrent. So area A of the brain has a projection to area B. You can kind of imagine that as one layer in the deep convolutional network to another layer. But inevitably, B projects back to A. And you cant understand the activity of either area without understanding both, and the non-linear actions, the dynamical interactions that occur to produce a state that involves multiple layers simultaneously.

Many of us think today that understanding those dynamical states that are distributed across networks are going to be the secret to understanding a lot of brain computation.

I know that recurrence is starting to be built into some of these DCNs now. I dont know where exactly that field sits, but that certainly is one of the ways you get dynamics.

Dynamics are, again, another universal feature of brain operation. They reflect the dynamics in the world around them, and the input but also the dynamics in the output. Youve got to have dynamical output in order to drive muscles to move arms from one place to the other, right? So the brain is much richer, in terms of dynamics.

Another thing about the brain is it operates on impressively low power.

Li: I know, I was going to say the 20-watt problem. Thats dimmer than any lightbulbs we have. We hear about these impressive neural networks like GPT-3 or a neural architecture search or burst, an image that algorithms are all burning GPUs much more massively.

So how do you think about that?

Newsome: Well, I dont think about it very much, except that our contrived devices are very, very inefficient and very wasteful.

We have a colleague at Stanford, Kwabena Boahen, who studies neuromorphic engineering, and trying to build analog circuits that compute in a much more brain-like way. And his analog circuits certainly are much, much more efficient in power usage than digital computers. But they havent achieved nearly the level of impressive performance and the kinds of sort of cognitive-like tasks that DCNs have achieved so far. So theres a gap here that needs to be crossed.

Li: Yeah, I think this is a very interesting area of research. You mentioned the word cognitive, and I want to elaborate on that because I know we started talking about computational neuroscience, but cognitive neuroscience is part of neuroscience, and also in the field of visual where I sit.

First of all, half of my PhD was cognitive neuroscience. Second of all, in the past 30 years, I would give cognitive neuroscience a lot of credit in the field of vision to show to the AI world what are the problems to work on, especially the phenomenal work coming from the 70s and 80s in psychophysics by people like Irv Biederman, Molly Potter, and then getting to neurophysiology and cognitive neurophysiology, like Nancy Kanwisher, Simon Thorpe, showing us the phenomenal problem of object recognition, which eventually led to the blossom of computer vision object recognition research in the late 90s and the first 10 years of the 21st century.

So I want to hear from you, do you still see a role of cognitive neuroscience in, I guess, two sides of this: one is in todays AI, which I think I have an opinion, but also AI coming back to help?

Newsome: I am not nearly as well versed or trained in cognitive neuroscience as you were. That was your graduate training. I think in a very simple-minded way about cognitive neuroscience, that may make our colleagues, may make you shudder, Fei-Fei, Im not sure. I was trained as a sensory neuroscientist, trained in the visual system, the fundamentals of Hubel and Wiesel, and the receptive-field properties in the retina. And then the first processing in the brain, and then the cortex.

I was sort of getting into the brain, back in the 1970s and 1980s, thinking about signals coming from the periphery. We all called ourselves sensory neuroscientists, but there was another whole group of neuroscientists who were coming the opposite direction. They were having animals make movements: a right eye movement, like weve already talked about, or arm movements, and theyre looking at the neurons that provide input to those movements, and then theyre tracing their inputs back into the brain. And this was a motor science kind of effort.

And the sensory side and the motor side has enjoyed listening to each other talk, but they didnt really talk about it very much. But they had to meet eventually. And I think one part of my career was playing a part in hooking those two things up. And we did it by studying simple forms of decision making. So giving animals sensory stimuli that was my comfort zone asking animals to make a decision about what they were seeing, and then make an operant movement. And if they got it correct, they got a reward.

Well, how did the sensory signals that are the result of a decision get hooked up to steering the movement? And that there, youre squarely in cognition land. Some people refer to that as the watershed between sensory systems in the brain and motor systems in the brain. How do you render decisions?

You can think about sensory representations in the brain as kind of being like evidence, providing evidence about whats out there in the world. But then you can think about these cognitive structures in the brain that have to actually make a decision, render a decision, and instruct movements. You cant move your eyes to the right and to the left at the same time. Not going to happen. Sometimes you simply have to make decisions.

Thats how I kind of got into the cognitive neuroscience. And I think its one of the most interesting fields in all of neuroscience right now. I am hoping that AI and computational theory ... well, I know that computational theory is making contributions because some of the integration problems, integration of evidence from noisy stimuli, those kinds of theories, those kinds of theoretical models have deeply informed my own work in decision making. So computation theory are certainly making contributions.

I sometimes wonder about the other way around: What is that we are learning from vision and neuroscience that could inform AI? And you and I have had conversations about that as well.

Li: Right. So Ill give you an example of a group of us, Stanford neuroscience people like Dan Yamins, Nick Haber, they are the young generation of researchers who are actually taking developmental cognitive inspiration into the computational modeling of deep learning framework. They are building these learning agents that you can think of as learning babies as a metaphor, where the AI agent is trying to follow the rules of the cognitive development of early humans, in terms of curiosity, exploration and so on, and learn to build a model of the world and also improve its own dynamic model of how to interact with this world.

I think the arrow coming from cognitive developmental science actually is coming to AI to inspire new computational algorithm that transcends the more traditional, say, supervised deep learning models.

Newsome: One example where neuroscience has really led the way for artificial intelligence and for convolutional networks and artificial vision is the deep understanding of the early steps of vision in the mammalian brain, where set field structures filtering for spatial and temporal frequencies have particular locations in space; the multiscale nature of that; assembling those units in ways that extract oriented Gabor filters. Thats typical of the oriented filter, typical in the early stages of cortex processing in all mammals. And that now is baked into artificial visual.

That was the first thing. You dont even bother to train a DCN on those steps. You just start with that front end, and that front end came honestly from neuroscience, from the classic work of Hubel and Wiesel, as you know. Coming through some principle psychophysics and statistical analysis input from people like David Field. I think if I had to point to one thing that neuroscience has given to AI it would be the front end of a lot of the vision.

Li: Thats a really big thing, so absolutely.

Newsome: Fei-Fei, let me just say that the other challenges there and I think yeomans of the young generation who are working on visual would acknowledge, I think everyone acknowledges this, really is that the artificial visual systems even though they can surpass human performance in some cases after theyre trained, the learning process is so different for humans from the artificial systems.

The artificial systems need tens of thousands of examples to get really, really good, and they have to be labeled examples, and they have to be labeled by human beings, or what is your gold standard. Whereas I have this little 5-year-old daughter at home, and by the time she was two or three, she had looked at a dozen examples of elephants, and she could recognize elephants anywhere. She could recognize line drawings, photographs, different angles, different sizes, different environments. And she can play Wheres Waldo on the common childrens magazine. And this is profoundly different.

So heres an example where human cognitive neuroscience and the study of visual development in young humans and young animals, I think, presents a real challenge for artificial vision, artificial intelligence.

Li: Yeah, I actually wanted to emphasize on a point you just made because it truly, using your word, is profound because the way humans learn biologically, your NI, natural intelligence system learn is so different. I still remember 20 years ago, my first paper in AI was called One-Shot Learning of Object Categories, but until today, we do not have a truly effective framework to do one-shot learning the way that humans can do, or few-shot learning. And beyond just training example-based learning, there is unsupervised learning, there is the flexibility and the capability to generalize, and this is really quite a frontier of just the overall field of intelligence, whether its human intelligence, or artificial intelligence.

Newsome: Yeah, I think both AI and NI have to be appropriately humble right now about this. Were almost equally ignorant about exactly how that happens.

Li: In a way, I almost think it has a social impact for those of us who are scientists. We need to share with the public about the limitations because the hype talk of AI today, of machine overlord and all that, is built upon some of the lack of knowledge of the limitations of the AI system, and also the phenomenal capability of human intelligence to stumble.

Bill, I want to switch topic a little bit because I think what you are doing at Wu Tsai goes beyond some of these more lower level modeling. One of the most important charter mission of Wu Tsai is neuro disorder and healthcare-related. Here, Im going to say something that I hope that you can even disagree on: should we view AI and machine learning more like a tool for our researchers and doctors, clinicians to use this modern tool of data-driven methodology to help discover mechanism of diseases and treatments? Are there any examples of work at Wu Tsai like that? Just in general, how do you view AI through that lens of studying neuro disorders?

Newsome: Yeah, thats a really good question. Is AI really more of a tool to enable us to get on with the business of doing serious biology, or do the actual processes and algorithms and architectural structure of AI lend understanding to their correspondence inside the brain?

And I think the answer is both. So let me just give you a little Bills-eye-view of neuro disease. There are some neurological diseases that have psychiatric comorbidities, where the biggest problem is simply that cells in the nervous system, somewhere in the nervous system, start dying, for reasons we dont know yet. Parkinsons disease is an example, where its a particular class of cells, the dopamine arginic cells that start dying, and we dont know why. And Alzheimers disease, cells start dying all over the brain. Theres some areas that are particularly sensitive but by the time an Alzheimers patient shows up in the clinic complaining of symptoms, theyve already lost probably billions of nerve cells; certainly hundreds of millions of nerve cells by the time they become symptomatic.

And those diseases, I think, are going to be solved ultimately at a molecular and cellular level. Something is going wrong in the life of cells, and whether thats in the metabolic regime, whether its in the cleanup regime, keeping the cell whole and safe and free of pollutants, whatever it is, the secrets to that are going to be in cell biology, and AI can certainly help us tremendously just by providing tools to assemble all the data that were acquiring at that genetic and molecular level inside of cells.

On the other hand, there are neural diseases that smack of the more systems type of pathology; the problems are not lying in single cells probably. So you take some of the symptoms of Parkinsons disease, for example, the tremor and things like this, they can actually be rectified by putting stimulating electrodes inside the brain and doing a process called deep brain stimulation. Any of the listeners who arent familiar with this can just Google deep brain stimulation, or go to YouTube, and you can see amazing videos of remission of symptoms with this. Not a cure for Parkinsons but its a treatment for the symptoms.

And there are things like depression, which themselves dont kill people; its not like its a progressive degenerative disease. In depression, people come in, they come out. Its a dynamic kind of process. It smacks of the state system inside the brain, and that state can go through multiple systems, some of which are depressed, some of which we would characterize as more normal or positive kind of outlook.

And that kind of dynamics of complex systems, I think, is going to be part and parcel of the AI computational neuroscience thrust: understanding how these densely interconnected networks, based on certain inputs, can assume different states, fluctuate between them. I think could give some insight into the actual disease itself.

So I think it depends on which disease youre talking about, on whether AI is primarily going to be a tool or whether it might actually suggest some intellectual insights into the sources and explanations for some of them.

Li: That speaks of the broadness of machine learning AIs utility in this big area. Where we sit at HAI, we see already a lot of budding collaborations between the school of Medicine, Wu Tsai Institute, and HAI researchers, where all of these topics are touched. I know theres reinforcement learning algorithms in neurostimulation for trauma patients. Or there is computer vision algorithms to help neuro-recovery, in terms of physical rehabilitation. And also all the way down to the drug discovery, or those areas. So very excited to see this is also a budding area of collaboration between AI and neuroscience.

Newsome: I think that this is going to grow, that interface is going to grow. I think ultimately well diagnose depression much better through rapid real-time analysis of language that people use, and adjectives that they use, than expensive interaction with physicians. I dont think the algorithms are going to replace physicians, but theyll be very useful.

Can I bug you about something Im wondering about?

Li: Sure.

Newsome: In some of the first discussions that led up to the formation of AI that I was privileged to sit in upon, we raised a question of when youre a biologist you think about a human or animal performing a task; doing a discrimination task, or making a choice between this action that action. And the question that comes up is motivation. What is the organism motivated to do at the time?

And this gets very complicated. In all kinds of social situations with humans, we worry about whats fair, and we may do things that are against our economic interest because we are striking out for fairness. There are these values, there are these motivations, there are these incentives. And I wonder: what is the motivation in an artificial agent? To the extent that I know anything about motivation in artificial agents, its minimizing some cost function. Is that all there is to understand about incentives and motivation?

Is that all these complex feelings that we have, are they just reduced to cost functions, or is there a whole world there that AI needs to discover that they havent even scratched the surface of yet?

Li: This is a beautiful question. When you talk about motivation, I was thinking: what kind of reward objective mathematical functions I can write? And I come up very simple ones, like in the game of Go, I maximize the area that my own color block occupy. Or in the self-driving car, I will have a bunch of quantifiable objectives, that is: stay in the lane, dont hit an obstacle, go with the speed, and so on. So yes, the short answer is motivation is a loaded word for humans, but when it comes to todays AI algorithm, they are reduced to mathematical reward functions, sometimes as simple as a number, or what we call scalar functions. Or a little more complex, a bunch of numbers, and so on. And thats the extent.

This clearly creates an issue with communication with the public because on one hand, people are claiming incredible performances of vision language, especially those confusing language applications where you feel the agent actually is talking to you, but the under the hood its just an agent optimizing for similar pattern it has seen.

So we dont have a deep answer to this at all. My question to flip this is: both as a neuroscientist, as well as more objective observer of AI, do you see this as a fundamentally insurmountable gap, hiatus, between artificial intelligence and natural intelligence that would potentially touch on philosophical issues like awareness, consciousness? Or do you think this is a continuum of computation? At some point when computation is more and more sophisticated, things like motivation, awareness, or even consciousness would emerge?

Newsome: Well let me answer that in a couple of ways. First, I dont think that its a fundamental divide. I dont think that theres anything magical inside our brains associated with the molecules carbon and oxygen, hydrogen and nitrogen. I do this thought experiment sometimes with groups where I say, Ive got a 100 billion neurons in my brain, but imagine I could pull one of them out and replace it with a little silicone, or name your substance, neuron that mimicked all the actions of that natural neuron perfectly. It received its inputs, it gave its outputs to the downstream neurons, can even modulate those connections with some neuromodulator substance, it can sense some: would those still be Bill with this one artificial neuron inside my brain along with a 100 billion natural ones? And I think the answer would be yes. I dont think thered be anything fundamentally different about my consciousness and about my feeling. And then you just say, Well what if its two?

Li: Right.

Newsome: What if its three? And you get up to 100 billion, after a while, and my deep feeling is that if those functional interactions are well mimicked by some artificial substance, that we will have a conscious entity there. I think it may well be that entity needs to be hooked up to the outside world through a body because so much of our learning and our feeling comes through experience. So I think robotics is a big part of the answer here. I dont like the idea of disembodied conscious brains inside a silicon computer somewhere. Im deeply skeptical of that.

Li: Its like the movie, Her.

Newsome: Yeah. I dont think the divides fundamental, I dont think its magic. But the only place I know that consciousness exists, and that these intense feelings take place, is in the brains of humans, certainly in a lot of other mammals, maybe all other animals, but probably in birds and others as well.

But I think that neuroscience is kind of suited now, and artificial intelligence as its constituted now, there may be a fundamental divide just because they start with different presumptions, different goals of the kind that weve discussed here for the last half hour.

Does that make any sense to you, or am I just babbling here?

Li: No, no, its making some sense to me but let me try to share my point of agreement and disagreement. My point of agreement is that, like you said, where we are, the deep learning algorithm and also our understanding of the brain, is still so rudimentary. And from the AI point of view, its just so far, the gap between what todays AI or foreseeable AI can do to what this natural intelligence from computation to emotion to consciousness, its just so far I really dont see that the current architecture and mathematical guiding principle can get us there. What I dont have an answer is when you say 100% of your neurons are replaced.

Newsome: But perfectly mimicking the functional relationships of the originals.

Li: First of all, I dont know what perfectly mimicking means in that because were in counterfactual scenario. Like, maybe we can perfectly mimic up to this point of your life where your neurons are replaced, but what about all the future? Is that really Bill? Its almost a philosophical question, that I dont know how to answer. But I think this consciousness question is at the core of some of neuroscience researchers pursuit, as well as a very intriguing question for AI as a field.

Newsome: So consciousness, I call it the C word, and mostly I dont utter the C word. But it is maybe the single most real, as Descartes thought, and interesting feature of our internal mental lives, so its certainly worth thinking about, both from a neuroscience point of view and an artificial intelligence point of view.

A lot of the muddiness about that word comes because we use it to mean so many different things. We use it to mean a pathological state, somebodys unconscious rather than conscious. We use it to mean a natural state called sleep, and people are asleep and not conscious. Or we use it to mean: Im conscious of this TV screen in front of me and Im not conscious of the shoes on my feet at this particular point in time. Or we can use it at a much higher level, that I am conscious of the fact that Im going to exist, that Im going to die, that I have a limited time on this planet and I need to find as much meaning from those years as possible.

And so you have to sort of hone in on what youre really trying to understand with the word. I think the one thats most common is simply what were conscious of at any moment, what were aware of-

Li: Awareness.

Newsome: A phenomenal awareness, like the philosophers call it. Many of your listeners will be familiar with David Chalmers and his notion of the hard problem of consciousness and the easy problem of consciousness. If youre not, its definitely worth getting familiar with them. Chalmers says that theres some things that neuroscientists are going to solve. Were going to solve the easy problems. Were going to solve attention, were going solve memory, were going to solve visual perception, were going solve visual coordination: all these features of conscious beings were going to solve, because we can see in principle the outlines of an answer to them, even though were far from having any details.

But what he says is the hard problem is why should some biological machinery hooked together in a particular way, why should there be any internal feelings at all that go along with that, that were conscious of? Conscious of being happier, conscious of being sadder, conscious of seeing red, or conscious of seeing green. Why is there that phenomenal experience?

And one of the things Ive learned as a neurobiologist is that I can ask questions up to a certain point in animals, like I can electrically stimulate different parts of the brain, and I can elicit very sophisticated kinds of responses and behavioral responses, and yet, I do not know what that animal is actually feeling at the moment. Theres this first-person experience of our beings, and presumably of other animals beings, that is very difficult to know how we would describe that in any kind of objective terms, any kind of math that you could-

Li: The Qualia experience.

Newsome: Qualia, exactly. And thats the hard problem. Ill tell you, most neuroscientists, the large majority of neuroscientists, would deny that there was a hard problem of consciousness. Its almost an ideology, honestly, because neuroscientists believe in the supremacy of their field. Its a very deep commitment, and that once we get a mature neuroscience 500 years from now, however long it takes, there will be nothing about the brain or the mind left to explain.

And people who take the hard problem of consciousness seriously say, It may be that an intrinsically third-person science cannot account for what is intrinsically first-person experience. That there just may be a category of mismatch. And so I give credibility to that, but Im an unusual neuroscientist in giving credibility to that.

Li: Yeah, youre a very open-minded neuroscientist. I remember as a physics student at Princeton some physicists said that humanity is incapable of understanding the universe to its deepest depth because we are part of it, and its hard to study within something, the totality of that thing.

But just to be a little more concrete on a consciousness note for AI, one of the narrower definitions of consciousness is awareness; not even this deep awareness, but contextual awareness. And one of my favorite quotes of AI come from the 70s, that goes like this (and keep in mind, this is the 70s). It says: The definition of todays AI is the computer can make a perfect chess move without realizing the room is on fire. Of course, we can change the word chess move to a different game, like Go or anything else, but todays AI algorithm, not to mention the deeper level of awareness, does not even have that contextual awareness. And this is five decades later, so we have a long way to go.

Read more from the original source:
What is Computation's Role in Neuroscience? - Stanford University News