Numenta Numenta Talks, 12 Feb 2013

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Building Brains to Understand the World's Data

Description

Google Tech Talk
February 12, 2013
(more info below)
Presented by Jeff Hawkins.

ABSTRACT

The neocortex works on principles that are fundamentally different than traditional computers. In this talk I will describe recent advances in understanding the neocortex and how we are applying them to model millions of high velocity data streams.
The talk will start with a description of sparse distributed representations, which are the fundamental units of information in brains. I will then discuss how these representations are learned and how the brain processes them to build predictive models from sensory data. Numenta has built a product called Grok that emulates these capabilities of the neocortex. Grok is being used to understand high velocity machine generated data in many different domains. I will give a brief introduction to Grok and speculate on the future of machine intelligence.

A

Alan: so [inaudible] actually invited me to dinner with jeff here a.

A

Couple weeks, ago., and I think we probably talked for three hours in that.

A

And we probably could have talked for 10 hours., because the area that he's interested is one that larry's.

A

Also interested in,, which is machine intelligence., and how do we push the next generation? and it's obviously really important to our company.

A

But he has an entire career where he's basically built.

A

From graduate school on a mechanism to basically allow.

A

Him to study what is, I think, one of the most fascinating.

A

Fields that any of us will ever be involved in.

A

and it's biologically inspired machine intelligence.

A

And for me, it combines two really, really interesting: things. one is obviously computing and how we commute and things like that, but, more importantly, how we think, how humans, think.

A

And I think what was really exciting to me is the advances.

A

Made in biology to understand what the mind does and how it.

A

Processes things and the different mechanisms it uses.

A

And what really came to me was it's an entirely different.

A

Computing model. and I think that's what's so exciting about it., so I won't go into the long and illustrious history.

A

I'll let jeff do that., but I am just so pleased and happy, both that he could come.

A

And all the interest in the room here., so thank you very much., jeff hawkins:, thanks, alan.

B

Audience: [applause] jeff hawkins:. I should be good with this mic.

B

Hopefully,, you all can see me. well, thanks for coming out here and just keep piling in and sit wherever you want,. I guess.

B

it's a pleasure to be here., I'm not going to tell you about my long career.

B

I'll skip all that.. I've had two careers-- one in mobile computing and now another one in brains and neuroscience., but really, it's the brains and neuroscience. That's been the one that's been going on for a long time..

B

So I'm going to talk about machine intelligence., I'm going to talk about what it is. I'm going to talk about, how I believe we can get there and what we're going to do when we get there.

B

and some of the parts of the talk will be pretty technical.. Some will be less so., I'm going to start off with little sort of an intro.

B

History here. my approach to this-- hopefully,. This is going to work now--. Let's try this. oh,. I had that down., that's it.! My approach to this has been the following..

B

It's a very biological approach., it's first to discover the operating principles of the neocortex., and once we understand those principles,, we can then build machines that work on those principles.

B

and the neocortex,, just in case you've forgotten,. It's the big, wrinkly thing on the top of your brain., it's about 75%, of the volume of your brain.. It's where all high level thought,, language, vision, occurs..

B

Anything you can tell me about the world is stored in your neocortex. mine's speaking.. Yours is listening., that's an organ of intelligence..

B

Our approach is like the follow-- oops. oh,, I'm going backwards. Here. I got to get used to this.. Our approach is the following.. We start with very detailed anatomy and physiology.

B

I'm more of a neuroscientist than I am a machine learning person in some ways.. I view the brain as a set of constraints..

B

This is the one proof case. We know that this can be done.

B

and we know a lot about the anatomy and physiology of the.

B

Brain and all kinds of stuff., and if we're going to have a theory about what intelligence is,, it has to be consistent with that., we don't have to emulate all of that., but we at least have to realize that that is a set of constraints. from that,. We develop theoretical principles..

B

We can test those empirically back into neuroscience., but we can also test them by building the stuff in software.

B

And experimenting with it.: this is what we're doing today. ultimately,. This is going to go into silicon.. We've actually got one project starting this year with another major computing company to do some silicon of our algorithms. but today,, it's all in software.

B

now,. I thought-- I added a few slides here to begin in my talk,, which I don't normally do..

B

I wanted to give you a little sort of historical perspective, because I know there's a lot of people here in the machine learning community and some really experts., and I just wanted to give you a little bit of my view of where we've come from and how we're getting there..

B

So I'm going to go back in time. we're going to start a history of ai.

B

this guy alan turing is where I began in ai.

B

Starting in the 1930s,, he started talking about computers as universal machines--, the universal turing machine, as we call them now. and he was very much interested in computer intelligence. and he thought we can make computers intelligent..

B

He didn't want to get in arguments about it..

B

He wrote about this.. He said,. I didn't want to argue with people whether it's possible,, whether machines can be conscious., so he said,. I came up the idea of the turing test, specifically., so he just said, look,. If a machine could pass the turing test,, we'll just have to agree it's intelligent., and so that's what he did.

B

and he wrote that paper in 1950,, the one that's shown right, here. and this is sort of the beginning of the ai movement. unfortunately,. What this did is this set the idea that the goal of ai is to do things that humans do.

B

and I don't think that's the goal of machine intelligence.

B

We don't have to replicate what humans do.. We can do things that are super or less..

B

It's not that specifically.. So the field of ai went on for many years..

B

It's still going on.. I call it the no neuroscience approach. there's been many projects and techniques developed over the years,, some quite successful,, some less so.

B

I've shown some pictures of some of the great achievements here-- playing chess, winning at "jeopardy.". I put the google car there.. I want one-- major initiatives.. My summary of this is the good news about it,. You can come up with good solutions to problems. We care about.

B

The bad thing is that they're very task, specific. they're kind of brittle. the google car- doesn't know how to play chess..

B

It's not going to do my laundry. and it's not going to think about physics.

B

and so they're very task specific. and they have limited or no learning.

B

and what makes intelligence for humans, of course,. Is we.

B

Learn about everything. and I can do all those things. and so can you., and so I never viewed this as a really great way of getting to true machine intelligence..

B

Now I'll just talk about the history of artificial neural networks--, so the brain approach,, if you will..

B

I start this back with these two guys, warren mcculloch and.

B

Walter pitts., they wrote a paper in 1943 where they talked about, well,.

B

Neurons could be like logic gates.

B

and if we put them together,, we can do computing with them..

B

So that's an interesting idea. well,. It's really not the way brains work at all., but what they did is they introduced the idea of an.

B

Artificial neuron that can be used in an artificial neural, network. now, their approach was kind of odd.. On the left,. You see a real neuron. in the middle,. You see what is a classic artificial neuron,.

B

Which is a sort of sum to weights and activation function.? That's nothing at all like a real neuron.

B

and on the right is what mcculloch and pitts show,, which is these little, really,. Really ridiculous. Neurons were doing ands and ors and nots., but that was beginning of the artificial neural network. Error.

B

over the years, there's been many, many different things in this category.. You really can't put them under one category.

B

But I call it minimal: neuroscience.

B

you'll see in a moment., so starting in the '80s,. We had a real resurgence and.

B

Interest in artificial neural, networks,, back propagation,, boltzmann, machines, and so on.. This has continued on today into the field of machine learning. and the current hot topic. There is deep belief: networks.

B

And I would say the good news about this is, well,. These are.

B

Learning systems., that's good., they're distributed., that's good., they're, really good classifiers.! That's what mostly they're used for,, so sort of classification problems.. The downside is they're very limited.. They don't do much more., there's a few exceptions to that.

B

and they're, not brain-like at all., and it didn't feel like this is-- when these became hot again in the mid-'80s,, and I was working on this in the mid-'80s,. I was very disappointed., because people weren't really paying attention to the neuroscience.. They were just saying, hey,. We have these neuron-like things.

B

and we're doing stuff with them., and we know a lot from the brains.. We should be going back to them. and lately,. There's been another thrust, here, which you might call the whole brain simulator.. This is maximal neuroscience.. You might have heard about this.. There's a project in europe under henry markram called the human brain project..

B

They just got huge amounts of funding.. Their goal is to simulate an entire brain from the ion.

B

Channels to the spikes to the neurons, to everything, up to.

B

Psychology. that chart in the middle is the principal researchers on.

B

This project., it tells you how many people are working on this..

B

They do these great simulations.. The problem with this is there's no theory., they'll, admit this., there's no theory.. They have no idea what this is supposed to do..

B

They hook it all up and see what happens.

B

and it's not going to lead to machine intelligence..

B

We need theory., we need principal ways of going about this..

B

So that takes me back to my approach,, which is essentially like,. Look, you've got to pay attention to the brains..

B

We don't have to copy everything that goes on in a brain., but you better understand what it's doing before you decide what else to do. and that's the approach I've been taking., so I'm going to walk you through the progress we've been making recently. and I think it's really cool..

B

First of all, we have to talk a little bit about the neocortex.. It's a memory system.. So if you think about it as a computer, forget it., it's not., it's a memory system.

B

when you're born,, it's a blank memory system. and as you grow up, you fill it up and you learn things.

B

now,. It's a memory system. That's attached to some of.

B

Your senses. and you learn everything through your senses..

B

You have from your eyes,. The optic nerve is about a million fibers.. Your somatosensory nerve is about a million fibers..

B

Your auditory nerve is about 30,000., so you got a couple million inputs going into your brain.

B

they're, fairly high velocity,, not in computer terms., but they're changed on the order of tens of milliseconds or hundreds of milliseconds.. Your eyes are moving every few hundred milliseconds-- a completely new innovation going on.

B

and my speech is changed on the orders of tens of milliseconds.. So you've got this fast data stream coming into the brain..

B

The brain has to build a model of the world.

B

When you're born,, you don't know about things like google., you don't know about buildings and chairs, and cars and computers and operating systems and bananas--.

B

None of that stuff. you have to learn everything., it's an amazing amount of stuff. and you have to learn it through this fast stream of data coming in., and so the neocortex builds a model of the world.

B

And from that model, it does three basic things..

B

It makes predictions about future events., it says, hey,, given my current state and what's coming in,, what's going to happen, next? it can detect anomalies,, which are just predictions that don't come true. and it can take actions. and it turns out. Actions are actually the same as predictions., and so when we take actions,, we back-interact with the world.

B

and so actually,. It turns out that most of the things that you experience in the world, most of the changes on your sensory organs, are caused by your own actions..

B

So, as I move around the room- and I turn my eyes and so on,.

B

I'm controlling the patterns that are changing here.

B

and so there's this real big type feedback loop. That goes.

B

On between a sensory and motor action., and if I were to sum this all up, and say,, what is this system doing,? This is what it's doing..

B

The neocortex learns a sensory motor model of the world.

B

It learns,, given a sequence of sensory patterns and a sequence of actions,. What's going to happen next--? What do I have-- my expectations of what's going to happen? Next.

B

can I predict the future?, and can I predict what I should do to get the future that I want?, and this is basically what it's all about., it's building a sensory motor model of the world., and we want to know how it does that.

B

well,. We know a lot about it. we've learned a lot over the years. and I'm going to give you the top six principles right, now.

B

And this is in no particular order.

B

and I made these up. I mean,, I didn't make them up.. I made the list up., but we're just going through them. Here.

B

first, number one--, it's an online learning system..

B

So it's a memory system., but it's got to work in an online fashion,, meaning it's got to work in a streaming. Mode., there's no batch processing.! The brain doesn't get to look at the statistics of a database..

B

It says it's coming in. I got to act on it immediately.. I have to incorporate it into my model immediately., it's an online learning system. and this is essential.

B

in a world where patterns are always changing and where the underlying structure in the world is changing,, you have to have an online learning system.. You can't do this in a batch, mode.

B

brains, don't work in a batch mode.. They don't know statistics in that sense..

B

The second thing is: we know that the neocortex is a hierarchy..

B

It looks like a sheet of cells., it's just two or three millimeters thick.. It's about the size of a dinner napkin for a human.

B

And all of it looks very, very similar., but we know from anatomy and other reasons that it's.

B

Actually different regions that are connected together with these nerve, bundles in a hierarchical fashion., there's an estimated-- anywhere between dozens and maybe a couple of hundred regions in the neocortex--, a human neocortex,, depending how you're counting..

B

We know that these regions are in this hierarchy..

B

We know the information flows up the hierarchy and down the hierarchy.. We also know that the regions, amazingly, seem to be doing the same thing.. There are slight variations to this., but the basic idea is that every region is doing the same, thing. they're all doing the same type of memory function., and so it doesn't matter if you say, well,. This is a visual area of the neocortex..

B

It's visual, because it's getting input from the optic.

B

Nerve or other visual regions and auditory areas because of.

B

Where it's getting input from. and we can rewire the brains. and these regions take on new meanings and new roles..

B

So we have this hierarchy of memory, regions that are all.

B

Doing the same thing,, which tells us that we understand what one region is doing, and we understand how the hierarchy works, we're a long way towards our goal.

B

The third thing is: what is the kind of memory that it's storing. 90%--, not all of it-- but 90% of what the neocortex is storing.

B

Is sequence: memory. it's patterns over time.. This may not be obvious to you.. Let me walk you through it..

B

Almost all the inference in motor behavior is sequence memory., so you're listening to my speech. and hopefully,, I'm not talking too quickly., but the patterns are coming in over time.

B

the order. Matters.. You have in your brain stored what words sound like and what.

B

Certain phrases, sound like. and your brain is matching them up in time.. If we move the order and pattern of those patterns in a.

B

Different order,, it would be garbage-- totally garbage.

B

and people tend to think like,. Well, vision's, not like that,, is it. vision is like that. real vision is you are moving constantly through the world..

B

Your eyes are moving every two, three, four times a second. and every time it's this constant change..

B

These are not images that are just randomly represented to you.. Your brain is directing this. and it's figuring out what patterns., and so when I look to the right,, I know what to expect..

B

If I look to the left,, I should see alan over here again. there he is., and so I have these expectations about the world..

B

So even vision is this--. All inference. france, you think about language, music, vision,, even.

B

When I touch things., it's all temporal patterns..

B

The second thing is: we generate motor behavior.

B

And motor behavior is, of course, another sequence..

B

My speech right now is involving dozens of muscles.

B

Being exercised in very precise, patterns--.

B

Extremely precise patterns-- over time to generate these speech patterns. and that's true for all my behavior.

B

and so we're playing these back.. These are stored. Patterns.

B

they're stored., I could repeat, them. they're stored.. I can repeat them because I've got these things in my head.

B

I know these. I've learned how to do these things.. I could give this talk blind and probably in my sleep., not true--, just for you guys., so it's all about sequence, memory. and that's the key. and that's an area that has not been explored. Enough..

B

The fourth item here is that when you look in the brain,, we.

B

Find the same type of representations., it's called sparse, distributed representations.

B

everywhere, you look,, you see lots of neurons., it doesn't matter where in the brain. very few are active. most are relatively inactive.. This is true on the sensor streams, as well..

B

We now understand a lot about this. and it's a critical component of how the whole system works.

B

I'm going to go into detail in this talk..

B

The fifth one here is that we used to think that the regions of the brain-- that some were motor regions and some were center. Regions. like this is the primary visual area., and this is the primary motor area and so on..

B

We now know this is not true.. Every region in the neocortex has cells that are both.

B

Inference or sensory and motor.

B

and there's differentiated-- the layer, 5 cells or the motor cells., but everywhere you go,, even primary visual cortex has cells that project to something that's motor--, the muscles that make your eyes move..

B

So there is no pure sensory or pure motor.

B

in fact,. This is another beautiful, discovery.

B

essentially,. What every part of the cortex is doing is sensory motor learning., and so we want to figure out how it does that.

B

finally,. The last of my six elements here is attention.

B

There's different types of attention.: I'm not going to go into detail here, today., but essentially,. I need to be able to attend the various parts. My input stream, various parts of what I'm doing, at different points in time. now,. I claim these are the primary six things that are.

B

Going on in the neocortex. and I'll make a further claim., I think they're both necessary and sufficient for biological.

B

And machine intelligence., I don't think you're going to get there without these elements., it doesn't mean there aren't other things. We can do.

B

But these, in my mind, are necessary and sufficient.

B

they're necessary to learn a sensory motor model of the world.. All mammals have a neocortex.

B

and they all have these principles from a mouse to a human., dolphins, monkeys, cats, dogs--. They all have these principles operating in their brains., so you don't have to be human level to need these things., but they all have this going. On..

B

There's things I didn't put in this list. for example,, I didn't put language., you don't need to have language to be smart.

B

You need it to be human smart, yes., but to build a model of the world, no.

B

dolphins are really smart. and they have very limited language.. I didn't put other things-- episodic, memory, dreaming., you don't even have to have a body..

B

You have to have motor output., but that could be all virtual in some cyberspace. Someplace.

B

So there's a lot of things you don't have to have to build machine intelligence,, but I believe these six elements.

B

and if you're going to forget everything else, I talk about today,. Just remember: there's six things. and the most important one is sparse, distributed representations,, which I'm going to talk about next.

B

I'm going to talk about three of these, actually., I'm talking about sparse, distributed representations., but I'm going to talk about sequence, memory. and I'm going to talk about the online learning..

B

We know a lot about some of these., but there's a lot of things. We don't know., there's a ton of stuff, I still don't know and don't understand., but we know enough that we're actually starting to build this stuff. and it works pretty well.

B

we're going to jump into sparse, distributed representations.. The best way to understand, sparse distributed representations is to think compare it to the way we do things in computers,, which I'll call dense, representations. so,. What do we do in computers?? We want to represent something,. We take a word-- 8 to 128 bits..

B

I don't know what we're up to these days..

B

We consider all combinations of 1 and 0s, from 0000 to 1111..

B

An example, of course, is the ascii code.

B

and that's the representation for the letter m.

B

now,. We can say things like, well,. What do the bits mean in this code?? They don't mean anything. if I say,. What's the third bit in an ascii code, mean?, it doesn't mean anything., the whole number means something., somebody could say, well,. It means an 8 bit., that's not what it means.. It doesn't tell me anything about the letter m.

B

and these representations are arbitrary.

B

We could've assigned a different representation of the letter m. and it would have been just fine, as long as we all use the same convention. in brains,. It works very differently..

B

First of all,. You always have lots of things..

B

When I talk about bits,, you can think of it as a neuron.

B

and when I say the bit's, a 1,, the neuron's active. and the bit's a 0,, the neuron's, not active., so we have many, many bits--, thousands of them. and they're, mostly inactive., so mostly zeroes and a few ones.

B

in our work very often, and for this talk, I'm going to stick.

B

To an example where we're using 2,000, bits, of which 2% are active., so I have 40 1s and 1,960 0s..

B

That's how I'm going to represent everything., there's many, many ways I can pick from those., but that's how I'm going to represent everything.

B

now, there's several key things about sparse, distributed representations., but this one is that each bit has semantic meaning.

B

You can actually say what it means if you knew.

B

These are learned. no one's going to assign it in a brain or an intelligent, machine., it's learned., but it's relatively stable. and they mean something.

B

and so,. When we want to pick a representation,, it's sort of a.

B

Competitive process. we take the top 40 semantic attributes.

B

And those are the ones that are going to be in our representation.. If I want to represent the letters of the alphabet using sparse, distributed representations-- and I would not do this--, this is just purely for example--.

B

And I wanted to engineer this, I could say, ok,. I would have.

B

Bits that represent is this a constant or a vowel??

B

What does it sound like?? Is it an a,, e, I,, o sound.? Is it a fricative? Sound? is a hard sound,, a soft sound?? How do I draw it?? Do I have ascenders or descenders?? Is it a closed shape?? Where is it in the alphabet?? What's it next to?? What other meanings does this thing have?

B

and I could come up with all these attributes. and then I'd pick the top 40 to represent any particular letter.. That's the basic idea.! Now there's some properties with sparse, distributed.

B

Representations., I'm going to go through a few of them here that are really, really important.. The first is semantic similarity.

B

basically,. If I took two sparse distributed representations, and I compare them bit for bit,- if they share a bit in the same location,, then they're sharing semantic meaning.. This is not arbitrary.. This doesn't happen by chance.. It's meaningful. and even just a few bits of overlap between two representations is statistically very significant., but it's also semantically significant.

B

Now,, what if I asked you to store one of these patterns??

B

I want to remember this. and I'm going to ask you, here's a new pattern coming in.. I want you to tell me if you've seen it before.

B

So you might say, well, I'll store, 2,000 bits. and then, when the new 2,000 bits comes in, I'll check and see if it's the same thing., that's not the way we're going to do. It. we're going to store the indexes of the 1 bits., so we're going to say, ok,.

B

All you need to remember are where the 1 bits are., and so I have 40 1 bits in my representation., so I'll have 40 indices to the 1 bits., and if I see a new representation--, I looked in those locations, and if I see 1s, I know I got the same representation., because every representation has 40 1s..

B

What, if I told you couldn't do that? I said, you can only sub-sample.. You can only sample a few of the 1 bits..

B

You can't store the locations of all 40., so I'll, say 10.. You can only pick 10., we'll randomly pick a 10.. Now you have indices to the 10 of the 1 bits..

B

Now I'm seeing a new pattern. you say, is this the same pattern? and you look and say, yes.. The 1s are all in the same location-- the 10 1s. I know about., is it the same pattern or not?

B

well, you say, well,? I don't know. what about the other 30 bits?? They could be different. well,. It turns out that it's very unlikely they'd be different., but even if they were different,, I'd be making a mistake, but a mistake with something: that's semantically very similar to the thing I stored.- and this is the key to generalization in the brain,- is that you don't need to store the location of all the.

B

Bits and know what everything is. basically,, when you make errors, you're, making errors of semantic generalization. in fact,. I could say,, you know what,, it's good enough to just match five or eight of these things. and still I'd have a semantic generalization..

B

So I have a way of scaling it back, up and down..

B

I'm going to tell you the last property, here. and you'll see why all this works in a moment--.

B

How we're going to use this-- is one of union membership..

B

Let's say I took 10 sparse, distributed representations.

B

and I [? ord ?] them together.. So now you have 2,000 bits., but instead of 2% of the bits being active,, it's about 20% of the bits being active. and that's a one-way street.. I can't undo that.. I can't say, oh,. What were the 10 bit that were in there?

B

can't do it., but I can do something almost as good..

B

I can show you a new sparse, distributed representation and.

B

Ask, is this one of the original 10 by looking at the union., and I can do that., I can say, well, just look for the ones that are in the new one and see if they're in the union.

B

and if they are, I'm going to claim it's one of the original 10. now, you might say, hey,. It could make a mistake..

B

It could be picking some 1s from the first one and some 1s from the second one and so on. statistically, extremely astronomically unlikely to happen., but even if it did make a mistake,, it wouldn't matter., because I'm going to be making a mistake for something. That's semantically very similar to the thing I stored earlier.

B

and that's good enough. in fact,. It's what we want.. It's not even good enough.. It's actually desirable.

B

again,. If you want forget everything else and zone out the rest of the talk,. Remember the future of intelligent.

B

Machines is sparse, distributed representations., I'm telling you, there's no other way around it.- and I was just talking to john down here earlier about this,.

B

I believe, is the future of understanding language, as well, and text., because this is how the brain does it.

B

we're now going to skip to the next thing-- sequence memory..

B

This is 90% of what's being stored in your brain., the various types of sequence- memory,, it's not so simple,, but the various types. and we spent years trying to figure out how this works.

B

and we think we got it.. Let me just give you some of the neuroscience. zoom in on any section of the neocortex.. It doesn't matter. Where. you'll see, there's these layers of cells--, typically five layers of cells., I'm arguing that they all are a type of sequence, memory.

B

They have similar attributes.. It doesn't really matter what layer you look at.. What I'm talking about here would apply to any layer of cells. they're, all different types of sequence, memory..

B

So if we zoom in on one of those layers,, what you'll see is you'll see the cells packed in there really tight. there's about 10,000 per cubic millimeter., but they have two organizations which are worth noting. one's shown by the green arrow,, which is that cells that are in a very skinny vertical column have similar.

B

Response properties,, especially a feed-forward response property., they all seem to respond to the same thing in the world in a feed-forward basis.

B

however, 90% of the connections are horizontal connections, across the columns in different areas of the brain.. So 90% of the connections are elsewhere, where they have this very strong, vertical orientation..

B

If we zoom in further and look at one of those cells,, we see.

B

That the cells are dominated by this dendritic arbor,, which is this tree-shape structure around it., all the connections--, the positive connections-- to the cell are on the dendrites.

B

they're, not on the cell body. and so on. A typical neuron, there's anywhere from several thousand to a few tens of thousands of connections on those dendrites.. If we zoom in further, and now you're looking at one little.

B

Section of a dendrite in this picture here,, you can actually see the synapses in this electromicrograph.

B

there's those little spines coming off to about 1 micron apart ranged along the dendrite there..

B

We now know-- and we didn't know this 15 years ago--, but we now know that there's a very nonlinear effect. That's.

B

Happening here.: if a number of these synapses become active at the same time--, relatively the same time-- with a few milliseconds-- and a short distance from each other-- within about 40 microns of each other--, and enough of them happen at that time,. Then you get a very nonlinear event., you generated, what's called the dendritic spike.

B

and it goes to the cell body. and it depolarizes the cell body.. The cell body, goes in a hyperactive mode..

B

It's ready to fire., it's anticipating., it's predicting.. So every little section of the dendritic tree is like a.

B

Coincidence, detector. it's a threshold of coincidence, detector. it says, if I see a bunch of inputs at the same time, bingo..

B

If I see the same number of inputs spread out over time or spread over the dendritic arbor,, nothing happens.

B

This is such an important feature.. There's. Hardly anybody who's modeling, this today., but this is a key to understanding how the whole thing works.. We didn't know about it too many years ago., we model all this.

B

and here's a picture of one of our simulations.

B

On the left, there's a layer of cells with.

B

Four cells per column., I'm going to show more detailed pictures of this.

B

our neurons--, our artificial neurons-- capture, a fair amount of depth of which is going on in the brain in real neurons.. These colored dots represent the synapses.

B

and I'm only showing some of them in this picture..

B

The green ones are ones that are close to the cell body., I'm not going to talk to them. Further.. Those are how we form the sparse distributed. Representations. the blue ones are on the distal dendrites..

B

These are 90% of the connections.. This is how we're going to learn sequences. and we can model these as a cell--. Each cell is a set of coincidence, detectors.

B

and when the pattern comes in,, if it detects it,, it's going to make the cell into a predictive state.. How does this all work??

B

How does this learn? Sequences?, let's start with a picture., here's a picture of our sparse distributor representation., but now we're showing it as a sheet of cells.

B

and the red cells are the ones that are active.

B

and the light ones are the ones that are inactive.. This is just a part of our 2,000 bits.

B

This is, is a reminder., I'm not going to tell you how we formed this., but it's through a local inhibitory, competition.

B

At any point in time,, I have some pattern on here.

B

And at another point in time, I have a different pattern.

B

And so, as I'm talking, and as you move around the world,, this is what's going on in your brain. everywhere you look,, you see these cells sparsely activated.

B

oops,. I went too far. There. and you've got these patterns that are changing over in time like this., and we want to learn the sequence here.. We want to learn. How do I learn the sequence of these distributed patterns?

B

and the answer is that the brain? Does it a cell at a time.? Each cell learns to predict its own activity., so when a cell becomes active, what it does, is it says,? Let.

B

Me look around for guys who were previously active just a moment. Ago.. Let me see if I can find a bunch of them. and I'm going to form connections to them.

B

and I'm going to form those connections,, as you see on the bottom right here, on one of my dendritic segments..

B

So if I see that pattern again,, I will predict my own activity., and this is the beginning of sequence. Memory..

B

If we did this,- and let's say I showed it- a pattern.

B

Here's a situation where I've showed it a pattern.. The red cells are the cells that are getting a feed-forward, input., they're active., the yellow ones, are hyperpolar or depolarized..

B

They are predictive, states. now,. Why are there more yellows than reds?? What if I train the system--, an a followed by b and then a.

B

Followed by c and a followed by d.- and I show it a?.

B

I'm going to predict b, c and d. this is a union of.

B

Predictions., this goes back to our union property earlier.

B

I'll have a union of predictions., and I can tell if what happens next was one of things I predicted or not,, even though I'm predicting multiple things.

B

At the same time,, which is really what we're always doing. now, this memory, I've just showed you,. This is a transition memory., it's a first order, transition, memory,, meaning I can only.

B

Make a prediction based on my current or this previous time: step. what's happening, now, I can make a prediction [inaudible].. I can't use a history of time., but we need a high order, memory..

B

The reason we need a high order, memory,, because that's the way the world is structured., the high order memory says I'm may need to go back a long way to make the correct prediction. so,. Imagine I'm listening to a melody..

B

I can't predict the next note by just listening to the previous note.. I may need to hear five notes or six notes or 10 notes.

B

the same with speech., to predict what I'm going to say or understand. My speech,.

B

You have to understand a long context.

B

and the same if you're walking down the hallway.. This is a high order. Temporal pattern., you know,, it's just like, oh,. You have door, door, door,, then the third door on the left type of thing..

B

This is the way the world is., so we need to make a high order memory., and this is a first order memory..

B

So the way we're going to do that is we're going to use columns of cells., and let me explain how we think this works.

B

So, imagine I gave you a sparse distributed representation., but instead of each bit being a cell,, I'm going to make each.

B

Bit be a column of cells., so in this case, I show 10 cells per bit.

B

and I'm going to randomly choose one of the cells to be.

B

Active in that column., so if it's a 1 bit, and I pick a column,, I pick.

B

One of those cells.

B

I have a much sparser representation now. instead of 2,000 cells,. I have 20,000 cells.

B

Now,, I could pick the same, sparse, distributed representation a moment later and use a different set of cells.. I just randomly pick a different set of cells in the columns., and so I have a different representation.. It's the same, sparse, distributed representation, the same columns, but different cells..

B

If you just think about this,, we have 40 active columns., there's 10 cells per column., so there's 10 to the 40th different ways that represent the same input in different context..

B

So here's an example., I'm going to say a sentence that has a sound repeated four times..

B

There are too many tutus to count.

B

now,. The sound "to" was used four times in that sentence.

B

You didn't get confused. if it was a first order, memory, you would get confused., but you didn't. and you heard them,, even though it was the same sound, that you had different meanings at different points..

B

So at one point in the brain,, you had to have the same representation because the same sound's coming in on your cochlea. at another point in the brain,, you had to have a different representation because you didn't hear them as the same.

B

and that's what's going on here.. We have these columnar representations. and it allows us to create very long, high order. Sequence memories., I'm not going to walk you through all the details of how this works. you'll just have to take my word.. You can read it on our website if you want., but in the end,. If you do this, and you use the same.

B

Type of learning rules- I was just talking about a moment. Ago--, you form a sequence, memory of sparse, distributed, representations., it's variable order.. It can be as high order as the statistics allow..

B

So it's not like fixed order., it's distributed.. It can do multiple, simultaneous predictions about. What's going to happen, next., it's very high capacity.. This little memory here can learn millions of transitions.

B

and it allows for a semantic generalization..

B

Imagine if I train this on a series of patterns., and now I give it a new series of patterns that are not.

B

Exactly the same representations., but they have some bits overlapping with them., so they're, semantically similar.. I can apply my sequence memory to what was a previous.

B

Learning to a new input that is semantically similar.

B

And that's what the brain does.

B

My last thing I'm going to talk about is how we do online learning.. This is the third of my six elements. I'm going to talk about here. and what's this all about?

B

well, basically,, it means because we're doing online learning,. We have to train on every moment in time--, every new input to the system. and essentially,. You don't know if it's noise or something valuable,. So you have to train on it.

B

and basically,. If it doesn't repeat,, you forget it.

B

and if it repeats,, you want to remember it..

B

So that's pretty much what it is. now,, here's a little bit of neuroscience. You probably don't know., maybe you do., but probably, you don't.. We used to think-- just pay attention,, just listen to me for a second.. We used to think that all memory and formation in the brain was the strengthening and weakening of synapses.

B

and clearly,. That happens to some extent..

B

But we've now learned that something much more important happens in memory,, which is we can form new, synapses very rapidly., and we can forget them very rapidly.. So, instead of just strengthening a connection,, we can form new ones. and that's a much bigger pool of potential things you can connect to.. We can do this on the order of just a few tens of a seconds that you can form a completely new connection..

B

So even one exposure is enough to do this, often to form a new neuron., so these guys on the dendritic trees or those spines,. If you look on real neurons,, some of them are there for very long periods of time.. Some come and go every day as you're learning, things.

B

So there's much higher information capacity in.

B

Forming new synapses than strengthening old ones.

B

in fact, in the real brains, synapses are highly stochastic., they're, very unreliable.. So if anyone shows you a neural model that has precision of two digits or one digit of precision, that's required in a synaptic weight, forget it..

B

It doesn't work like that..

B

So the way we do this is we model this growth.

B

We say that we have something called the permanence,, which is a scalar.. It goes from between 0 and 1,, which is essentially modeling the growth of a synapse..

B

So I can start growing a synapse and not make a connection. if the permanence gets above a threshold,. We now say the.

B

Synapse is connected. and we just give it away to one. binary weights--. We don't try to be more fancier than that., but we have this idea of a permanence. and once I'm over a threshold,. If I keep reinforcing this, my.

B

Permanence can go up., the connection doesn't get stronger., but the permanence goes up. and it makes it harder to forget..

B

So you want to do that because, if things repeat over many times or you want to make it so it's very hard to forget..

B

So that's how we do that.. If you put this all together, and you say, hey,, I want to simulate one of these things,, which is what we do all day. Long. you have 2,000 columns.. We do 30 cells per column,, 128 segments per cell,, 40.

B

Connections per segment.- these are all very realistic numbers in neuroscience..

B

You put this all together.. You basically have about 300 million in this little model-- about 300 million synapses.. Each one has a connection index and a connection permanence.. The connections are very, very sparse.. There's a lot of tricks. We can do to make this run. Fast.

B

and noticeably,. There's no single points of failure. Here.

B

you can drop out. Synapses, drop out, dendrites, drop out, cells, drop out columns.. The system keeps behaving very nicely..

B

This has a lot of appeal for hardware guys, who--.

B

As we talked about building this stuff in silicon.

B

I'm now going to switch gears., I'm going to talk about-- and I think it's very important to build this stuff and make it work and prove it and make commercial value out of it..

B

So we're going to do that.. We have been doing that. we're applying this in the space of data..

B

I'm going to give you more on my take on data.. This is the data company., I'm nervous as hell talking to anybody about data here.

B

Because you guys are the data., you own, the data., you be the data.

B

but today,. This is my view of the world--. My simplistic view of the world. today, we're getting huge numbers of sources of data.. It's growing exponentially.. We stick them in data bases..

B

The vast majority of the data in the world is never looked at ever., it just sits there.. We have two ways of getting value out of it.: one is the visualization tools. and the other is creating models..

B

And then, if we [inaudible] those models,, we can act on them.. There are challenges. Here.. One of the biggest challenges is that this whole system is not very automated.

B

and it takes data scientists-- people like you-- to do this stuff. and we want to get to a world where there's not just hundreds or thousands or millions of models..

B

We want to get to one where there's billions of models--, the internet of things-- everything in the world's going to be creating data., and we need to be able to model all this stuff., the other problem, is-- and so today,. It takes lots of people., it's not automated.. The other problem is the models can get obsolete.

B

if you're not doing online learning, and most techniques today are not online learning,. You have to rebuild your models all the time, because the patterns in the world change. and people just aren't really looking at temporal data, very much., much of the patterns in high velocity data,, especially high.

B

Velocity data, is temporal patterns.

B

and that's almost very rarely do people take.

B

Advantage of that. they actually try to get rid of it..

B

So my view of the world tomorrow,, it's not like the current world's going to go away., but this is where I think the growth is going to be, is we're going to go to a world where there's literally--, I'm not joking-- billions of machine learning models out, there. the data's going to stream right into the models..

B

There's no storage, required. you're, not to save this stuff.. The models are going to build and continually update, themselves. and you're going to immediately take it to actions..

B

And so, if you look at it,, it looks just like what brains do-- go over back to what I said: earlier., I said, whoa, look at that.. So let's try to apply our techniques to this., and so that's what we've been doing..

B

The key criteria here is: you need to have automated model creation for billions of models.. You need to have continuous learning.

B

and you need to be able to find the temporal, as well as the spatial patterns in the data..

B

So we built a product called grok.

B

It's an engine for acting on data streams., it's essentially a productized version of the thing I was just telling you about. on the left,. You can see. We have streams-- the records of data coming in through time.. It can be one or more fields..

B

We run those fields through encoders,, which are just like your sensory organs., literally, they're modeled after sensory organs-- modeled after cochlea., and we can turn them into sparse, distributed representations.. Those encoders can be fairly generic..

B

We do not have to do new ones to do every different problem. We solve. we use a set of generic encoders..

B

We then get sparse distributed. Representations.

B

And by the way, we can put in field-- any kind of numbers, categories, text, dates, times.. You can do custom things, as well,. If you want to-- semi-structured data.. We run this through the sequence memory. I was just telling you about. and it basically looks for the spatial and the temporal statistics of that data..

B

It can make predictions. it can detect anomalies. and then from that,. We take actions.

B

what the used has to do in this case,. They have to define the problem.. This is actually tricky.. They have to do a good job at this.. Then they have to stream. The data. grok creates the models.. It learns the spatial temporal patterns in the data., it outputs predictions with percentages.

B

or you know,, it's a probability distribution.

B

and it can detect anomalies. and we're finding lots of applications for this.

B

we're finding in energy and I'll tell you some more-- product, forecasting, anomaly, detection, server, loads., I'm just going to walk you through a few simple examples., and then I'm going to speculate a little bit for you. today,. This is all running on an amazon cloud..

B

It doesn't have to be., but that's just the way we implemented it to begin with., there's our simple rest api to use it and some web apps to help you get started,, although it's only in a private mode. Still. we're still doing this with customers, hand, holding them.

B

We see a lot of applications, I'm going to show you this one, because it's very simple to see. and that's the main reason I'm going to start with this..

B

It's very simple.. You may not be realizing this. there's a thing called demand response,, which is large.

B

Consumers of electricity actually bid on price of power.

B

Throughout the day. and the utilities will say,, if you can use x, amount of power at 3:00, I'll, give you this price.. If you use y amount of power, I'll, give you this price.

B

and they're, trying to figure out how to do all this.

B

and if you could predict both your demand or the supply,. You.

B

Can save energy and you can save money. so there's a lot to be saved. Here., here's a factory in france-- in paris, actually.- and this is a very simple one.. It's just showing the electrical usage throughout a week.. You can see the five days.

B

they're, not working on the weekend, apparently., because it's kind of low there at the last two days.

B

and the problem that the customer wanted to do. Is they said, at midnight,? They have to sort of make their bids.

B

And at midnight, they want to make predictions every hour for the next 24 hours.. We had to put a little wrap around this learning algorithm to get this to work., but we can do that.

B

and what we do is you get something like this.. Now: here's the actual and predicted. now,. This looks: great. pay, [inaudible] attention.! You really can't tell if it's good or not, because you have to really look at statistics and look at the data carefully., but it turns out. This was very good..

B

The customer was happy with this.. The red is predicted., the blue is actual.. We can follow this pretty well.. Here's a situation where the system was just trained on a.

B

Few months of data.- and here we are. on wednesday and thursday morning,- it starts picking up.

B

and it says, hey, [inaudible] pick up. and it didn't happen. and the reason was because it was a holiday. and we didn't know about this holiday. and the system was never trained on holidays., so it says, oop..

B

Then it says, that wasn't right and starts to say this looks like a weekend., so it started acting like a weekend., here's another example. same idea,, but a little more complex..

B

You get the sense that it's not so obvious, all the time..

B

This is a company that does video encoding.

B

They have a service level agreement with their customers.. They have to guarantee a quick turnaround., so they have to leave extra servers running on the cloud.

B

All the time in case the peak in demand., so they're always try to manage how many servers do I leave running,, which are wasting energy and electricity.

B

And power and money., but I have to meet my service level agreement.. If they could predict customer demand better,, then they could leave fewer of these extra servers running around..

B

So here you can see the data.. It's quite spiky., there's no obvious patterns in it.. We can't predict all the spikes. it's impossible., but the question is,. Can we discern some patterns in this data-- do better than any other technique? They've had?, and can we do this in an automated way??

B

And the answer is yes to both those..

B

We can do it better than they can do it. and we can do it in an automated way.. So in a sense, basically, we just feed the data in and grok this thing.. I won't go through all the details of it., but it was a successful application..

B

I want to give you a little sense of what it's like if you looked inside of this system., so just pay attention to the right side of these images.

B

Here we're looking down on the--, actually 2,048--, but 2,000 columns., and the green dot means that this was predicted.

B

And it actually occurred. so we're sort of probing inside of this cortical learning algorithm right now., and this is a case where what occurred was exactly what was predicted.. This occurs quite a lot.. It's not unusual., here's a situation where we predicted multiple things., but one of the ones that we predicted occurred..

B

So we have more of these little blue circles of things that were predicted but didn't occur., but that's not a mistake, as long as the things that did occur were predicted.. Those are the green dots., so I have 40 green dots and maybe 80 blue dots--, something like that., here's a situation where things didn't work too well.

B

and I'm sorry. You probably can't see this too well in the back of the room.. There's a bunch of red circles in here, as well.

B

and those red circles are things that weren't predicted but did occur.. Those are true anomalies.. I didn't expect this to happen. and it did happen., but this is so just so. Typically what happens? Here., it's not an all or nothing. Affair..

B

An anomaly is not one thing..

B

It's like, well,. Some of the things I predicted did occur.

B

some of the things I predicted didn't occur. and some of the things that occurred: weren't predicted..

B

So if I wanted to,, I could go in here and say, well, semantically,. What was wrong, and what was right?.

B

We don't do that per se., but that's how the system works on its own..

B

So there's a lot of subtlety here. here's a case where we used it with a offshore windmill.

B

And this is looking at the oil temperature and the gear case and a large offshore windmill in the north sea..

B

The blue line is the temperature. and it's going up and down throughout the day as the windmill's speeding up and slowing down. and the question is,. Could we detect anomalous behavior?.

B

And the red line at the bottom is the anomaly score,, which.

B

Grok is putting out., and here you can see an interesting event.. We had two peaks here.

B

the earlier stuff is when the system was first started being trained., but here we have two peaks., and the important thing is the first peak is: when the system start acting a little bit unusual., it wasn't out of range..

B

It wasn't out of spec in terms of it was too high or too low-- the temperature., but it was sort of oscillating in a way that hadn't seen before. so grok says,, that's unusual., I'm not able to predict that as well., and so you have a peak.

B

and then the second peak is when the system actually went down for failure. and they worked on it.. We think there's a ton of applications here, detecting anomalies., here's, my dangerous slide., my dangerous slide, says, hey,. If I was google,, how would I use this? I'd love to have you guys as a customer.?

B

That's not why I'm here., but I'd love to have you as a customer.. I said, well, we've had a lot of interesting advertising. Space-- online advertising. and we've shown that we can do for people who basically have.

B

Real estate to sell, they're always trying to pick what ad network to pick., and so we've shown that we can predict the expected return on.

B

A particular ad network, which changes throughout the day all the time. you want to do this almost on a 15-minute basis..

B

We can do that on a per network, per app, per demographic basis. and essentially,, the user can decide,. How do I prioritize where I serve my ads? From.? We don't really care what the patterns mean..

B

It just [inaudible] patterns there. and they change. and we find them.. We can't get it right. All the time. again, we're just trying to do it better than they're doing today.. We have a lot of interest in the finance world..

B

You can't predict stock prices. forget it., it's not going to happen., but you can, and we've shown, that we can successfully.

B

Predict volume and volatility better than the industry standards today., and this is valuable for various reasons..

B

We also believe--. We haven't done this yet--, but we have a lot of interest in detecting anomalous trading..

B

Both this is internal to companies, because they're trying to figure rogue traders..

B

We also think we can do it across a huge number of.

B

Obtuse,, weird trading combinations., so when something becomes all the sudden more predictable,, it represents a trading opportunity, which, for some.

B

Reason,, not many people in trading are saying, bingo.. You could do that., it's not my favorite application., but I think there's going to be a lot of applications there..

B

I mention this because google-- because you guys,, I would have to admit, you're, not first in everything. yahoo's still ahead of you in finance,, I think. and you could add some really cool things to your financial stuff. If you had these kind of capabilities., you guys do a lot of computers..

B

You have the biggest server farms in the world..

B

We found some really interesting applications in managing computer resources. Like I mentioned with the earlier example-- predicting demand-- resource balancing., I've even heard a crazy idea--, a great idea--, where someone says, you know, different servers have different efficiencies, running different applications., and if you can predict the efficiency,, you could switch.

B

Down some servers and bring up others and save energy.- I think that's really cool.

B

a lot of work in the energy space for us.

B

we're getting hit on this all the time.. You guys are involved in smart grids,, solar, wind, demand response.. This could be something great for you guys. and finally,. I love your cars.

B

and maybe something if you'd predict where parking spots are going to be or routing people-- things like that.

B

If you want more details on grok or you want more details on these algorithms, there's a white paper on our website., and you can read about this stuff on our website., I'm now going to switch to my last part of this presentation,, which I'm going to just speculate a little bit.

B

About the future of machine intelligence., because I'm really passionate about this stuff,, as you probably can tell. so,, what's the future?, is it like this? skynet,, "the, matrix,", "the, terminator"--, ah!.

B

I'm not a big science fiction fan., but I'm told these are bad things.

B

Or is the future something nice, like this,, like you, know, little robot butlers like c-3po?, or we're going to play, games of [inaudible]. or maybe we'll come up with new ways of entertaining ourselves.? Is that the future?

B

or is the future ambiguous??

B

Maybe it's good., but it turns bad..

B

So I don't know., but I'm going to tell you some things.. I have some prognostications here. I'll. Just tell you where I think this is going..

B

Here's some things, I think, is definitely going to happen. and I'm not talking 100 years from now.. This is going to happen. and the reason I'm here is because I'm trying to happen sooner.

B

we can make machine intelligence, that's faster and bigger than biological intelligence..

B

So we can definitely make machine intelligence a million times faster than biological. Brains.

B

neurons can't do anything less than five milliseconds., that's their maximum throughput..

B

We can do a lot better than that. now,. I can't just speed up a brain if don't speed up its sensory organs and I don't speed up its data streams and so on., but I don't see any reason why we can't do that.

B

in virtual worlds,. We should be able to make machines that are a million times faster and think a million times faster.

B

Than humans think., we can make them bigger., that's not the only goal., but there's no reason at all. We can't make bigger neocortexes. and you can't make it smarter just by making it bigger.

B

That's a mistake., you can't just say, make it bigger, and it'll be smarter.. You still have to learn.. You still have to be exposed to things.. It takes 20 years to train a human..

B

We have to come up with--. These are our training systems. and they have to be exposed to environments..

B

But there's no question in my mind that we can make deeper.

B

Thinking machines than humans.

B

This is the area I get very excited about.. We can do super senses.. We should not be thinking about the senses of machine, intelligent machines as hearing and vision and touch.

B

I was just showing--: we have sensors that are looking at oil temperatures.. We can have sensors that look at anything.. We could have distributed sensors.. We could have microscopic sensors that work inside of cells.

B

all kinds of things where humans, we have an impedance mismatch because of our own senses..

B

We spend a tremendous amount of time trying to come up with ways of looking and thinking and experiencing stuff that we can't normally experience., but we could build artificial brains that experience it naturally.. We can do fluid robotics.

B

we're nowhere close to this today., but I think we can get there. and finally,. This is another idea..

B

The neocortex is a hierarchy. and in the brain, they're all co-located, because we have to run these wires between them and the neurons between them., but in a machine intelligent world,. We don't have to do that.. We can have parts of the hierarchy all over the place.

B

and we can have a distributed hierarchy.. We can have hierarchies on top of hierarchies.. I don't even know where that's going to go yet., but the idea that it doesn't have to be co-located.

B

And as long as we get the communications right,, that would be very interesting stuff.. This is all going to happen. here's some things that might happen., I don't know., maybe they will., maybe they won't. humanoid, robots.

B

maybe., maybe not. will we have something like c-3po?. I think it's probably technical possible..

B

It's going to be very, very difficult, because if you want it to be human like,, they have to all kinds of other stuff.

B

That makes them human-like., they have to have the rest of the brain. and they have to have all these emotional things and so on.

B

and I'm not sure, that's really where the business is going to be. you know,. I know a lot of people want to do this., but to me,. It's like this is sort of a sideshow.

B

and when new technologies come along,, we always imagine these things.. When the steam engine came along,, they imagined steam engine robots, right?, that's where the term robot came from., but it didn't happen.. So I don't know. it may happen..

B

Will we have computer brain interfaces for all, like "the matrix"?, you plug it in the back and go, whoa,, you know., I don't know. maybe., maybe not. there's a lot of technical problems. There. I'm not sure we really want to have that.

B

who knows? here's some things I don't think are going to happen.

B

I don't think you're going to upload your brain to anything.

B

Sorry to say. there's two reasons for this, really.. One is forget about the incredible.

B

Difficult technical problems. just forget about that., but the memory in your brain is intimately tied to the.

B

Wetware of your brain and the wetware of your body., and you would have to recreate the entire thing in some sense, to get those connections to be meaningful in another form.

B

I also think it'd be quite unsatisfactory..

B

Imagine if I went up to you right today and said, you know,. You can upload your brain to this computer.. Do you want to do it? and you say, yeah, sure. and you say, yeah,? I want to live forever.

B

and then we say, oh, yeah. We did it.. Then the computer comes up., hey,, that's great., I'm awake., and then we say, we're done with you.. We can get rid of you. and you say, whoa. wait a second., I'm still here.. I mean, it's like-- audience: [laughing], jeff, hawkins: you're, not going to feel so good.

B

and in the end,. Then those two things will diverge.

B

You might as well just have kids. it's the same thing. audience: [laughing].

B

Jeff hawkins: finally,, I don't think we're going to have evil robots.. These things aren't going to one day become sentient and say,. I don't want to be controlled. Anymore., you know--, you are dead., it's not going to happen..

B

These are not replicating things.. These are not emotional things.. These are not humans.. They don't want to have sex. they're, not hungry., we're just trying to use the principles by which the brain works. To build really,, really useful things for society.

B

and finally,. We can be certain that it's not going to be only for friendly uses, as well. people will do bad things with this., but that's true of every technology. all right,, my last slide.. Why do this?? Why do we care?? Why am I so passionate about this??

B

Why do I try to get other people to be passionate about it? well,? There's two reasons.. The first is to live better..

B

There's no question in my mind,: just like computers have improved our lives tremendously. and the products that you guys build, have improved our lives.

B

Tremendously. and my life has benefited from that.. I think having intelligent machines is a way of improving our lives.. We can make the world safer., we can make it more energy efficient.. We can make the world-- better health-- all the things we want to do..

B

There's no question at all that this is the ability to.

B

Move that needle significantly.

B

but there's another reason, too,, which is to learn more.

B

If I sit back and say, what's the purpose in life?, why should anyone care that I live here and you.

B

Live here and so on? in the end, long after many drinks and so on,. I come to.

B

The conclusion that the goal in life is to acquire.

B

Knowledge and to make sure that knowledge is preserved., and this is what we do as scientists.. This is what we do because we're inquisitive species.. We want to understand how the world works. we want to understand the universe. we want to understand. When did it begin, and when did it end.?

B

I want to know those answers, too. and we could use tools to help us do this.

B

Imagine we could have physicists that are a million times smarter and faster than us and never get tired.

B

And they think about this stuff.. What if we want to explore the universe?

B

we're finding human, earth-like planets only 13.

B

Light years, away. isn't that great?. That was in the news, this morning., I think that's wonderful.. How long would it take to get a human there?

B

and will they survive?, probably not.? If we want to explore the universe,, I think we have to do it with machines that don't breathe oxygen and are not.

B

Sensitive to the things we are sensitive, to.

B

so, to me, in the end here,, it's all about accelerating knowledge, accretion. and, I think, there's a way of amazingly accelerating that.

B

So that's the end of my talk. thank you., audience: [applause].

A

Jeff hawkins: that was really good.

A

Alan: so with that,, we have a few minutes for questions..

A

If you have questions,, please come to the mic. ray.

B

Jeff hawkins: sure., hi, ray.

C

Ray: hi, jeff. great presentation.

C

on your model,. I like it.,.

C

And I agree with the thrust of it..

C

I wanted to focus on one aspect of it,, which is the use.

C

Of scalars., you mentioned scalars in the context of the completion of a.

C

Connection with a view towards its permanence.

C

But the properties are basically represented by binary values.

C

Either there is a fricative. or the loop is closed. or it isn't. jeff, hawkins:, yes. ray:. So in building systems that have at least many of the.

C

Attributes of your model and trying both binary properties.

C

And then probabilistic properties-- there's an 82% chance, there's a fricative-- and then using [inaudible] and [inaudible] to combine them. Appropriately, I've gotten better results.

C

With the probabilistic-- jeff hawkins: yes. ray: --properties., so I was wondering--.

B

Jeff hawkins: yeah., so I'll rephrase the question just to make sure everyone understands. it's a great question.

B

and I'll expand it., because we've done two things. one is our neuron. Activations are binary, as well.

B

And our synapses are binary., the synaptic weights are binary. and the question is,. Can you get better results or you get better results using probabilistic or scalar values for those?, and we actually know for certain that in the brain that neurons actually have scalar outputs., they have firing rates., and we know that synapses are also scalars.

B

now,. I mentioned earlier also that synapses are very.

B

Stochastic. so a large percent of the time,, they don't work at all.

B

So that's an argument for not relying on scalar properties.

B

But the thrust of the answer here is.

B

We've taken a shortcut., we've said that, because we have distributed.

B

Representations,, you do not need to rely on the accuracy.

B

Of any scalar value anywhere in the system.

B

And it's much quicker and simpler to implement this as binary activations and binary synaptic weights.

B

I'm not saying it's realistic., but given the principles-- I understand what's going on--, I can back off to it. and it makes my system run much more reliably..

B

We've spent a great deal of time, trying to make grok run fast.. We can do a learning inference cycle in 10, milliseconds.

B

And we need to do this., because if you were going to build a practical system,, you have to make the things before them.. So that was an engineering choice. We made. it's not a biological choice.

B

and I'm not disagreeing with you.. It probably would get better results. If I did it with a scalar.

C

Ray: just a quick question on your view of markram's project.

C

Because I've had this debate with him over the past summer.

C

and he expects simulating at the molecular level,, which of.

C

Course is not the right way to build ai., but it may be a good way to verify our models of biology.

C

But by 2020, he'll be able to simulate it at.

C

100 times real, time. and you'll be able to actually have a conversation with it.

C

and I said,. How are you going to have a conversation with it?

C

because, if you're absolutely perfect in your model,, it's.

C

Not to do anything, just like human brain doesn't do anything unless it's gone through years of learning.

C

and if you're at 100 times real time,. How are you going to have it learn about the world and have a conversation?.

C

Jeff hawkins: yeah.

B

There's a lot of fundamental issues with that project.

B

I would agree. but look,, I'm excited anybody wants to do any of this stuff.

B

And maybe we'll learn something from it.

B

and so look at the positive side.. I think they've now taken that project and view it more as a way of simulating drug interactions and all different kinds of things like that.

D

Yes? audience:, so I want to extend ray's question a little bit,, which is. I appreciate that you've taken the last 15 years.

D

Of advanced neural, architectural understandings.

D

And built that into your model. fantastic. in the past, 15 years, there's also been an advance in things like slope, [inaudible],, hormonal, neural, response, and so on. and people like antonio damasio and joe ledoux are.

D

Saying that that's actually fundamental to cognition., and yet it doesn't appear to be in your model, anyplace.

B

So how do you reconcile that? jeff hawkins:? Can I sum it up in sort of the emotional affective content of the brain.? Is that a reasonable-- audience:, but there's also underlying neural and hormonal.

D

Mechanisms-- jeff hawkins: yeah, sure. audience: --account for a lot of that.

B

Jeff hawkins: yeah., so I want to make sure I address the question.

B

So there's a lot of stuff in the brain--, a lot. you've picked one that I didn't talk, about-- the synchronies., there's all kinds of rhythms and so on., and so this particular one is that there.

B

Are hormonal aspects. there are multiple neural modulators that are distributed throughout the neocortex that are fundamental for learning., but again,. When you look at it, and you can say, well,, is it important for machine intelligence to have those?.

B

We have ones that are based on fear and based on reward and so on..

B

We have an emotional system in our system and in our models.

B

It's a switch., it says, learn or don't learn.

B

and it's a very crude emotional system.

B

But it's good enough for what we need to do.

B

If I were to build a system, that's interacting in social.

B

Networks with people and having conversations and.

B

Trying to get food and trying to have sex and trying to stay warm,, there's a whole bunch of other things. You might want to have-- other affective, things. and then, just to be clear. in the brain,. The parts of the brain that actually evaluate.

B

Emotional content or emotional saliency are not in the neocortex.. There are small areas. they're subcortical.. They project the neural transmitter throughout the neocortex., so they have a global affect, like learn. This., don't forget this., you just nearly died..

B

This was a bad piece of chicken., don't eat it. Again.

B

But from what we're trying to do,, which is figure patterns,.

B

And data and structure data and so on,, it's not necessary at this point in time.

B

It's a fundamental aspect of being a human., but it's not a fundamental aspect of intelligence.

B

audience:, all right. jeff hawkins:. That's how I'd probably put that.

E

Audience: in all of your examples of practical.

E

Applications,, you seem to be predicting one-dimensional data.. Did you use only one dimension of input, as well?.

E

Jeff hawkins: now, so,, when you say one dimension,, I.

B

Assume you mean, like multiple factors.

E

Audience: I mean that it's a scalar value.

B

Jeff hawkins: well,, the scalars, we handle one or more.

B

Fields of scalars-- enumerated types,, dates, and times., and so did I answer that question yet?.

B

E

What we do is we end up forming a signal-- audience:. Does your model perform significantly worse if.

E

It doesn't have that.

B

Jeff hawkins: well, we find out.. So I didn't tell you about how this works with the way the actual user would use grok. if they provide multiple data streams,, they tell us what.

B

They want to predict., we do an evolutionary search through model space to figure.

B

Out, which factors help make better predictions and which.

B

Don't and then how to encode those factors.

B

So in the end, you end up with--, and sometimes we actually run these as ensembles of models..

B

We have multiple models running at the same time.

B

and they are competing with each other.

B

So the answer to the question is: grok tries to figure out what, of all the data you give it,, which ones are the best and most predictive. or which factors help-- how to use them., sometimes some factors help..

B

Sometimes it doesn't. for example, in that particular case with the windmill,. If you included wind speed as well as oil.

B

Temperature,, it's usually helpful., but it does pretty well without it., so it depends. it really depends. audience: all right.

E

Now,, what you've described is a system for predicting data.

E

That does not seem to me to be a complete solution. To, shall.

E

We say, general intelligence or an autonomist system.

E

What do you see as being necessary to complete the.

E

System in that sense?.

B

Jeff hawkins:, I hope everyone heard that question. so there's a lot.. I only showed three of my six elements.

B

We did not have a motor component., we don't have attention. and we don't have a hierarchy.. We built something. That's very small.. We built something: that's one-millionth the size of a human neocortex-- one-thousandth the size of a mouse neocortex..

B

It is really small.. It's 60,000 neurons., it's teeny., I'm not calling that a sentient being..

B

This is like a teeny little piece of cortex, that's learning patterns., but the key elements--. My argument is that if you get all six of those elements--.

B

All six of those things-- including--, so the hierarchy is basically a scale-- necessary for scale.. The sensory motor is a huge component of this because you have to explore the world.

B

and I'm working on that right, now. we're making good progress on that-- and then the [inaudible] components.. So you have to add all this stuff together before you can.

B

Start claiming you've got something: that's close to machine intelligent., audience: ok, thank you.

A

Alan: great., it's 12:00 right now.. So thank you all for coming. and thank you, jeff.. It's been a really, really, great talk.

D

Jeff hawkins: thank you.