Press "Enter" to skip to content

Platform for the Future of AR & VR | David Smith | TEDxBeaconStreet


how many of you have ever used a

how many of you have ever used a Macintosh or a Windows system or a cell

Macintosh or a Windows system or a cell

Macintosh or a Windows system or a cell phone smartphone do you ever wonder

phone smartphone do you ever wonder

phone smartphone do you ever wonder where they came from do you ever wonder

where they came from do you ever wonder

where they came from do you ever wonder what the vision behind those systems

what the vision behind those systems

what the vision behind those systems were I’m going to tell you some

were I’m going to tell you some

were I’m going to tell you some interesting stories about the past and

interesting stories about the past and

interesting stories about the past and what it means to us in the future and

what it means to us in the future and

what it means to us in the future and I’m going to start with 1968 which in my

I’m going to start with 1968 which in my

I’m going to start with 1968 which in my opinion was the most important year in

opinion was the most important year in

opinion was the most important year in computer history one thing that happened

computer history one thing that happened

computer history one thing that happened that year by the way was Intel was

that year by the way was Intel was

that year by the way was Intel was founded but I’m not going to talk about

founded but I’m not going to talk about

founded but I’m not going to talk about that another thing that happened that

that another thing that happened that

that another thing that happened that year we were introduced to series and

year we were introduced to series and

year we were introduced to series and Alexa’s older brother Hal 9000 I’m not I

Alexa’s older brother Hal 9000 I’m not I

Alexa’s older brother Hal 9000 I’m not I talk about that when we talk about is

talk about that when we talk about is

talk about that when we talk about is these three gentlemen these guys had the

these three gentlemen these guys had the

these three gentlemen these guys had the vision of what the future was going to

vision of what the future was going to

vision of what the future was going to be and what that future is is the one

be and what that future is is the one

be and what that future is is the one you’re living in but more importantly

you’re living in but more importantly

you’re living in but more importantly they knew where this future was going to

they knew where this future was going to

they knew where this future was going to take us and we’re not there yet so the

take us and we’re not there yet so the

take us and we’re not there yet so the left to right is Ivan Sutherland and

left to right is Ivan Sutherland and

left to right is Ivan Sutherland and then Doug Engelbart and Alan Kay and

then Doug Engelbart and Alan Kay and

then Doug Engelbart and Alan Kay and what I want to talk about first is their

what I want to talk about first is their

what I want to talk about first is their ideas what they wanted to see happen and

ideas what they wanted to see happen and

ideas what they wanted to see happen and what they created and then I’m going to

what they created and then I’m going to

what they created and then I’m going to show you some ideas we have about where

show you some ideas we have about where

show you some ideas we have about where this might take us this is a video of

this might take us this is a video of

this might take us this is a video of Ivan Sutherlands head mount that he did

Ivan Sutherlands head mount that he did

Ivan Sutherlands head mount that he did 1968 before that he had invented

1968 before that he had invented

1968 before that he had invented interactive computer graphics in 1963

interactive computer graphics in 1963

interactive computer graphics in 1963 with a system called sketchpad

with a system called sketchpad

with a system called sketchpad he called it sketch pad because the user

he called it sketch pad because the user

he called it sketch pad because the user would sketch and then the computer would

would sketch and then the computer would

would sketch and then the computer would complete it complete that sketch

complete it complete that sketch

complete it complete that sketch basically a symbiotic relationship so

basically a symbiotic relationship so

basically a symbiotic relationship so what he thought was what’s the next step

what he thought was what’s the next step

what he thought was what’s the next step ultimate display where it’s always

ultimate display where it’s always

ultimate display where it’s always available you can always see it this is

available you can always see it this is

available you can always see it this is actually an augmented reality device

actually an augmented reality device

actually an augmented reality device it’s not just a virtual immersive system

Doug Engelbart is most well known for

Doug Engelbart is most well known for having created the mouse which you’ve

having created the mouse which you’ve

having created the mouse which you’ve probably also used and but more than

probably also used and but more than

probably also used and but more than that 1968 he gave a demonstration of the

that 1968 he gave a demonstration of the

that 1968 he gave a demonstration of the future that was so profound and so

future that was so profound and so

future that was so profound and so rockin that everything after that was

rockin that everything after that was

rockin that everything after that was like this dividing line befores and

like this dividing line befores and

like this dividing line befores and afters and what he showed was not just

afters and what he showed was not just

afters and what he showed was not just the mouse but a bitmap display an

the mouse but a bitmap display an

the mouse but a bitmap display an ability to interact with graphical

ability to interact with graphical

ability to interact with graphical systems hypertext and collaboration and

systems hypertext and collaboration and

systems hypertext and collaboration and even video conferencing that’s a

even video conferencing that’s a

even video conferencing that’s a demonstration called the mother of all

demonstration called the mother of all

demonstration called the mother of all demos and by the way what’s really

demos and by the way what’s really

demos and by the way what’s really fascinating about this next year is the

fascinating about this next year is the

fascinating about this next year is the 50th anniversary of the things I’m

50th anniversary of the things I’m

50th anniversary of the things I’m talking about 50 years ago this was one

talking about 50 years ago this was one

talking about 50 years ago this was one of his big idea is the idea of

of his big idea is the idea of

of his big idea is the idea of bootstrapping where we take the steady

bootstrapping where we take the steady

bootstrapping where we take the steady state of the technology we have today it

state of the technology we have today it

state of the technology we have today it allows us better to manipulate

allows us better to manipulate

allows us better to manipulate information which improves the state of

information which improves the state of

information which improves the state of technology and of course what you’re

technology and of course what you’re

technology and of course what you’re looking at is a spiral so that literally

looking at is a spiral so that literally

looking at is a spiral so that literally we’re moving up so the next Alan Kay who

we’re moving up so the next Alan Kay who

we’re moving up so the next Alan Kay who I’ve worked with since really 1990 had a

I’ve worked with since really 1990 had a

I’ve worked with since really 1990 had a vision of what the next thing would be

vision of what the next thing would be

vision of what the next thing would be he was greatly influenced by Doug and

he was greatly influenced by Doug and

he was greatly influenced by Doug and many others but this is my favorite

many others but this is my favorite

many others but this is my favorite quote in the world man is much more than

quote in the world man is much more than

quote in the world man is much more than a tool builder he’s an inventor of

a tool builder he’s an inventor of

a tool builder he’s an inventor of universes this first appeared in a paper

universes this first appeared in a paper

universes this first appeared in a paper called a personal computer for children

called a personal computer for children

called a personal computer for children of all ages what’s interesting about

of all ages what’s interesting about

of all ages what’s interesting about that title it’s the first time the idea

that title it’s the first time the idea

that title it’s the first time the idea of a personal computer the words

of a personal computer the words

of a personal computer the words personal computer appeared he and he’s

personal computer appeared he and he’s

personal computer appeared he and he’s known as the father of computer for many

known as the father of computer for many

known as the father of computer for many reasons but that is actually the

reasons but that is actually the

reasons but that is actually the beginning of it and in that paper he

beginning of it and in that paper he

beginning of it and in that paper he described this

described this

described this the Dynabook he had seen small LCD

the Dynabook he had seen small LCD

the Dynabook he had seen small LCD displays before this and he realized

displays before this and he realized

displays before this and he realized that someday you’ll have that display to

that someday you’ll have that display to

that someday you’ll have that display to be quite large and you’ll be able put

be quite large and you’ll be able put

be quite large and you’ll be able put the computer behind it the other things

the computer behind it the other things

the computer behind it the other things he did was he invented a language called

he did was he invented a language called

he did was he invented a language called small talk which is the first

small talk which is the first

small talk which is the first object-oriented programming language and

object-oriented programming language and

object-oriented programming language and he even coined the term and he also

he even coined the term and he also

he even coined the term and he also meant by the way invented overlapping

meant by the way invented overlapping

meant by the way invented overlapping windows and his team at Xerox PARC

windows and his team at Xerox PARC

windows and his team at Xerox PARC literally invented the interface we

literally invented the interface we

literally invented the interface we think of today when we use the PC the

think of today when we use the PC the

think of today when we use the PC the Mac or our smartphones this is a picture

Mac or our smartphones this is a picture

Mac or our smartphones this is a picture he drew that was in that in that paper

he drew that was in that in that paper

he drew that was in that in that paper and what you see is two children using a

and what you see is two children using a

and what you see is two children using a Dynabook but what’s really interesting

Dynabook but what’s really interesting

Dynabook but what’s really interesting if you look at the screens you’ll see

if you look at the screens you’ll see

if you look at the screens you’ll see that they’re collaborating they have the

that they’re collaborating they have the

that they’re collaborating they have the same image on both they’re actually

same image on both they’re actually

same image on both they’re actually programming space floor and they’re

programming space floor and they’re

programming space floor and they’re sharing that experience and then playing

sharing that experience and then playing

sharing that experience and then playing it you’ve probably heard the story about

it you’ve probably heard the story about

it you’ve probably heard the story about how Steve Jobs went to Xerox PARC and

how Steve Jobs went to Xerox PARC and

how Steve Jobs went to Xerox PARC and saw the stuff that they had done there

saw the stuff that they had done there

saw the stuff that they had done there and I’m gonna give you a quick video of

and I’m gonna give you a quick video of

and I’m gonna give you a quick video of him describing the impact on him and

him describing the impact on him and

him describing the impact on him and they showed me really three things but I

they showed me really three things but I

they showed me really three things but I was so blinded by the first one that I

was so blinded by the first one that I

was so blinded by the first one that I didn’t even really see the other two one

didn’t even really see the other two one

didn’t even really see the other two one of the things they showed me was

of the things they showed me was

of the things they showed me was object-oriented programming

object-oriented programming

object-oriented programming they showed me that but I didn’t even

they showed me that but I didn’t even

they showed me that but I didn’t even see that the other one they showed me

see that the other one they showed me

see that the other one they showed me was really a networked computer system

was really a networked computer system

was really a networked computer system they had over a hundred Alto computers

they had over a hundred Alto computers

they had over a hundred Alto computers all networked using email etc etc I

all networked using email etc etc I

all networked using email etc etc I didn’t even see that I was so blinded by

didn’t even see that I was so blinded by

didn’t even see that I was so blinded by the first thing they showed me which was

the first thing they showed me which was

the first thing they showed me which was the graphical user interface I thought

the graphical user interface I thought

the graphical user interface I thought it was the best thing I’d ever seen in

it was the best thing I’d ever seen in

it was the best thing I’d ever seen in my life now remember it was very flawed

my life now remember it was very flawed

my life now remember it was very flawed what we saw was incomplete they done a

what we saw was incomplete they done a

what we saw was incomplete they done a bunch of things wrong but we didn’t know

bunch of things wrong but we didn’t know

bunch of things wrong but we didn’t know that at the time it still though they

that at the time it still though they

that at the time it still though they had the germ of the of the idea was

had the germ of the of the idea was

had the germ of the of the idea was there and they done it very well and

there and they done it very well and

there and they done it very well and within you know 10 minutes it was

within you know 10 minutes it was

within you know 10 minutes it was obvious to me that all computers would

obvious to me that all computers would

obvious to me that all computers would work like this and they all do they all

work like this and they all do they all

work like this and they all do they all work that way so one of the interesting

work that way so one of the interesting

work that way so one of the interesting things right by the way this is sort of

things right by the way this is sort of

things right by the way this is sort of the great-grandson of the system that

the great-grandson of the system that

the great-grandson of the system that was built at Xerox PARC that ran the

was built at Xerox PARC that ran the

was built at Xerox PARC that ran the alto and the thing that Steve saw was a

alto and the thing that Steve saw was a

alto and the thing that Steve saw was a system called small talk 78 and I’m

system called small talk 78 and I’m

system called small talk 78 and I’m going to show that to you here this is

going to show that to you here this is

going to show that to you here this is not a picture it’s actually a system

not a picture it’s actually a system

not a picture it’s actually a system running inside of the browser what we’re

running inside of the browser what we’re

running inside of the browser what we’re actually emulating the alto and to show

actually emulating the alto and to show

actually emulating the alto and to show that I’m going to just do a really quick

that I’m going to just do a really quick

that I’m going to just do a really quick demo here and we’re now inside of

demo here and we’re now inside of

demo here and we’re now inside of literally the same things that Steve saw

literally the same things that Steve saw

literally the same things that Steve saw we’re running in a system in this case

we’re running in a system in this case

we’re running in a system in this case it’s only 40 years old so it’s

it’s only 40 years old so it’s

it’s only 40 years old so it’s relatively young but you’re looking at a

relatively young but you’re looking at a

relatively young but you’re looking at a system that is just as live today as

system that is just as live today as

system that is just as live today as anything that you’re working on on the

anything that you’re working on on the

anything that you’re working on on the web and in fact it’s that life so I’m

web and in fact it’s that life so I’m

web and in fact it’s that life so I’m going to do one of the neat things that

going to do one of the neat things that

going to do one of the neat things that they had then was every part of this

they had then was every part of this

they had then was every part of this system was written in the system so we

system was written in the system so we

system was written in the system so we have a full browser a full ability to

have a full browser a full ability to

have a full browser a full ability to compile to interact and every single

compile to interact and every single

compile to interact and every single thing that you see on that screen is

thing that you see on that screen is

thing that you see on that screen is accessible every single thing is

accessible every single thing is

accessible every single thing is modifiable this goes back to this

modifiable this goes back to this

modifiable this goes back to this bootstrapping concept where the system

bootstrapping concept where the system

bootstrapping concept where the system allows you to extend the system and in

allows you to extend the system and in

allows you to extend the system and in those days it was necessary to invent

those days it was necessary to invent

those days it was necessary to invent the world that they were going to be

the world that they were going to be

the world that they were going to be using remember overlapping windows

using remember overlapping windows

using remember overlapping windows hadn’t been invented pop-up menus hadn’t

hadn’t been invented pop-up menus hadn’t

hadn’t been invented pop-up menus hadn’t been invented bitmap displays how do you

been invented bitmap displays how do you

been invented bitmap displays how do you scroll hadn’t been invented they used

scroll hadn’t been invented they used

scroll hadn’t been invented they used this platform to create everything that

this platform to create everything that

this platform to create everything that you think of and you see your PC and

you think of and you see your PC and

you think of and you see your PC and your smartphone so what’s the next step

your smartphone so what’s the next step

your smartphone so what’s the next step we been working on these ideas for

we been working on these ideas for

we been working on these ideas for obviously many many years and this is

obviously many many years and this is

obviously many many years and this is where we’re getting to what you’re

where we’re getting to what you’re

where we’re getting to what you’re looking at is a full 3d environment that

looking at is a full 3d environment that

looking at is a full 3d environment that is just as

is just as

is just as malleable and accessible as a system you

malleable and accessible as a system you

malleable and accessible as a system you were just looking at this system runs on

were just looking at this system runs on

were just looking at this system runs on a phone so it’s intended obviously to be

a phone so it’s intended obviously to be

a phone so it’s intended obviously to be a VR kind of operating system but you

a VR kind of operating system but you

a VR kind of operating system but you don’t absolutely need it you probably

don’t absolutely need it you probably

don’t absolutely need it you probably probably figured out by now I’m actually

probably figured out by now I’m actually

probably figured out by now I’m actually running in a browser and I can literally

running in a browser and I can literally

running in a browser and I can literally modify the code of the system and what

modify the code of the system and what

modify the code of the system and what you see here is the top buttons here is

you see here is the top buttons here is

you see here is the top buttons here is a little closed X and I just changed it

a little closed X and I just changed it

a little closed X and I just changed it to have an open X not a big change but

to have an open X not a big change but

to have an open X not a big change but it’s one that demonstrates that the

it’s one that demonstrates that the

it’s one that demonstrates that the system is actually alive see it’s we’ve

system is actually alive see it’s we’ve

system is actually alive see it’s we’ve now modified that one of the things

now modified that one of the things

now modified that one of the things we’re really interested with this

we’re really interested with this

we’re really interested with this platform it’s not just about being able

platform it’s not just about being able

platform it’s not just about being able display 3d things inside of small

display 3d things inside of small

display 3d things inside of small devices or on your PC the reality is

devices or on your PC the reality is

devices or on your PC the reality is that we’re looking at a world where the

that we’re looking at a world where the

that we’re looking at a world where the information that you have in these

information that you have in these

information that you have in these worlds is going to be shared I’m going

worlds is going to be shared I’m going

worlds is going to be shared I’m going to be able to express some ideas I’m

to be able to express some ideas I’m

to be able to express some ideas I’m going to be able to talk to you and the

going to be able to talk to you and the

going to be able to talk to you and the computer is going to be listening and

computer is going to be listening and

computer is going to be listening and generating a simulation based upon what

generating a simulation based upon what

generating a simulation based upon what we’re talking about we’re gonna have

we’re talking about we’re gonna have

we’re talking about we’re gonna have what I refer to as an augmented

what I refer to as an augmented

what I refer to as an augmented conversation so when you think about

conversation so when you think about

conversation so when you think about that this is actually an example of what

that this is actually an example of what

that this is actually an example of what we’re after when we get this guy out of

we’re after when we get this guy out of

we’re after when we get this guy out of the way and this is a million particles

the way and this is a million particles

the way and this is a million particles running in a simulation and that’s

running in a simulation and that’s

running in a simulation and that’s pretty neat but you’ve probably seen

pretty neat but you’ve probably seen

pretty neat but you’ve probably seen some of that before but we’ve also

some of that before but we’ve also

some of that before but we’ve also developed a new language that allows us

developed a new language that allows us

developed a new language that allows us to express that simulation where it’s

to express that simulation where it’s

to express that simulation where it’s only about 40 lines of code that allows

only about 40 lines of code that allows

only about 40 lines of code that allows us to do this this is a language by the

us to do this this is a language by the

us to do this this is a language by the way it was designed for middest middle

way it was designed for middest middle

way it was designed for middest middle school kids to be able to do these kinds

school kids to be able to do these kinds

school kids to be able to do these kinds of explorations so we’re pretty excited

of explorations so we’re pretty excited

of explorations so we’re pretty excited about the ability to enable other people

about the ability to enable other people

about the ability to enable other people to start exploring these ideas and more

to start exploring these ideas and more

to start exploring these ideas and more importantly share them dynamically so

importantly share them dynamically so

importantly share them dynamically so I’m gonna show another example that’s

I’m gonna show another example that’s

I’m gonna show another example that’s maybe a little more grown-up

maybe a little more grown-up

maybe a little more grown-up this is a spreadsheet but it’s a giant

this is a spreadsheet but it’s a giant

this is a spreadsheet but it’s a giant spreadsheet so you’re seeing a lot of

spreadsheet so you’re seeing a lot of

spreadsheet so you’re seeing a lot of data at one time and I can select this

data at one time and I can select this

data at one time and I can select this data but one of the things you don’t

data but one of the things you don’t

data but one of the things you don’t usually see in a spreadsheet is ability

usually see in a spreadsheet is ability

usually see in a spreadsheet is ability to dynamically plot the data and of

to dynamically plot the data and of

to dynamically plot the data and of course we can do that and so what we’re

course we can do that and so what we’re

course we can do that and so what we’re after is this interesting fusion of

after is this interesting fusion of

after is this interesting fusion of collaboration control and understanding

collaboration control and understanding

collaboration control and understanding of very very large scale information but

of very very large scale information but

of very very large scale information but this will wrap around you when you’re in

this will wrap around you when you’re in

this will wrap around you when you’re in VR and it’s still alive and one of the

VR and it’s still alive and one of the

VR and it’s still alive and one of the particularly exciting things about this

particularly exciting things about this

particularly exciting things about this this is my smartphone that systems

this is my smartphone that systems

this is my smartphone that systems running on here what does that mean I

running on here what does that mean I

running on here what does that mean I should as I mentioned it’s all running

should as I mentioned it’s all running

should as I mentioned it’s all running in a browser we can build a system that

in a browser we can build a system that

in a browser we can build a system that anyone in the world who has a smartphone

anyone in the world who has a smartphone

anyone in the world who has a smartphone and a lot of people are getting

and a lot of people are getting

and a lot of people are getting smartphones before they get indoor

smartphones before they get indoor

smartphones before they get indoor plumbing are fully enabled to be

plumbing are fully enabled to be

plumbing are fully enabled to be creators and controllers of their world

creators and controllers of their world

creators and controllers of their world smartphones were designed to be consumer

smartphones were designed to be consumer

smartphones were designed to be consumer devices primarily Apple didn’t even

devices primarily Apple didn’t even

devices primarily Apple didn’t even allow programming on the system’s until

allow programming on the system’s until

allow programming on the system’s until they allowed scratch to come on at about

they allowed scratch to come on at about

they allowed scratch to come on at about four months ago

four months ago

four months ago now there’s no limits there’s no

now there’s no limits there’s no

now there’s no limits there’s no barriers we can create a workstation

barriers we can create a workstation

barriers we can create a workstation that’s as big as the world and allow

that’s as big as the world and allow

that’s as big as the world and allow anybody to control that world create in

anybody to control that world create in

anybody to control that world create in that world anyone anywhere who has one

that world anyone anywhere who has one

that world anyone anywhere who has one of these so that’s the exciting thing to

of these so that’s the exciting thing to

of these so that’s the exciting thing to me about these technologies this vision

me about these technologies this vision

me about these technologies this vision that started 50 years ago is going to

that started 50 years ago is going to

that started 50 years ago is going to not just change our lives it already has

not just change our lives it already has

not just change our lives it already has is going to touch everyone and empower

is going to touch everyone and empower

is going to touch everyone and empower everyone thank you

everyone thank you

everyone thank you [Applause]

”

Be First to Comment

Leave a Reply

Your email address will not be published. Required fields are marked *