[Music] [Applause]
[Applause]
[Applause] when I was a kid I knew I wanted to make
when I was a kid I knew I wanted to make
when I was a kid I knew I wanted to make things I studied mechanical engineering
things I studied mechanical engineering
things I studied mechanical engineering and soon discovered that when I worked
and soon discovered that when I worked
and soon discovered that when I worked as an engineer what I loved most was the
as an engineer what I loved most was the
as an engineer what I loved most was the human side of products why people love
human side of products why people love
human side of products why people love them or hate them or how they made them
them or hate them or how they made them
them or hate them or how they made them feel and then I discovered that there
feel and then I discovered that there
feel and then I discovered that there was a field called product design that
was a field called product design that
was a field called product design that does exactly this so I went back to
does exactly this so I went back to
does exactly this so I went back to school and switch gears and became a
school and switch gears and became a
school and switch gears and became a product designer I worked on many
product designer I worked on many
product designer I worked on many products in my career and my focus has
products in my career and my focus has
products in my career and my focus has always been physical things that had
always been physical things that had
always been physical things that had some kind of digital component because
some kind of digital component because
some kind of digital component because for me this is where I really saw human
for me this is where I really saw human
for me this is where I really saw human empathy taking place that I could design
empathy taking place that I could design
empathy taking place that I could design things that actually had a conversation
things that actually had a conversation
things that actually had a conversation with the person using them one of the
with the person using them one of the
with the person using them one of the most exciting projects I’ve had in my
most exciting projects I’ve had in my
most exciting projects I’ve had in my career has been the opportunity to
career has been the opportunity to
career has been the opportunity to design a robot I worked with a woman
design a robot I worked with a woman
design a robot I worked with a woman named dr. Andrew Tomas at the Georgia
named dr. Andrew Tomas at the Georgia
named dr. Andrew Tomas at the Georgia Tech socially intelligent machines lab
Tech socially intelligent machines lab
Tech socially intelligent machines lab and I was part of the core team where I
and I was part of the core team where I
and I was part of the core team where I was responsible for the creative design
was responsible for the creative design
was responsible for the creative design aspects of a robot called Simon which
aspects of a robot called Simon which
aspects of a robot called Simon which you see here the purpose of Simon is to
you see here the purpose of Simon is to
you see here the purpose of Simon is to study how we might interact with
study how we might interact with
study how we might interact with machines in a really human and natural
machines in a really human and natural
machines in a really human and natural way so just as I’m gesturing to you now
way so just as I’m gesturing to you now
way so just as I’m gesturing to you now or I might look at someone in the eye
or I might look at someone in the eye
or I might look at someone in the eye the robot can do the same thing you can
the robot can do the same thing you can
the robot can do the same thing you can handle objects it’s got cameras in its
handle objects it’s got cameras in its
handle objects it’s got cameras in its eyes and microphones and it can also
eyes and microphones and it can also
eyes and microphones and it can also respond with human gestures here you see
respond with human gestures here you see
respond with human gestures here you see Simon looking coolly or putting his
Simon looking coolly or putting his
Simon looking coolly or putting his attention to a flower or listening or
attention to a flower or listening or
attention to a flower or listening or being ashamed we’ll watch a quick video
being ashamed we’ll watch a quick video
being ashamed we’ll watch a quick video and I’ll show you how Simon can actually
and I’ll show you how Simon can actually
and I’ll show you how Simon can actually learn from a person here he’s doing a
learn from a person here he’s doing a
learn from a person here he’s doing a sorting exercise to sort objects in two
sorting exercise to sort objects in two
sorting exercise to sort objects in two different colored bins so someone said
different colored bins so someone said
different colored bins so someone said Simon where does this go well he says I
Simon where does this go well he says I
Simon where does this go well he says I don’t know he does this gesture and he
don’t know he does this gesture and he
don’t know he does this gesture and he can record the color that the camera
can record the color that the camera
can record the color that the camera sees when she says it goes in the green
sees when she says it goes in the green
sees when she says it goes in the green bin he parses the sentence and pulls out
bin he parses the sentence and pulls out
bin he parses the sentence and pulls out the word green and then he knows where
the word green and then he knows where
the word green and then he knows where it goes the next time so now he’s going
it goes the next time so now he’s going
it goes the next time so now he’s going to put it in the green
to put it in the green
to put it in the green this is just one example of many many
this is just one example of many many
this is just one example of many many many tasks that the robot can be taught
many tasks that the robot can be taught
many tasks that the robot can be taught the next robot that I worked on again
the next robot that I worked on again
the next robot that I worked on again with the social intelligent machines lab
with the social intelligent machines lab
with the social intelligent machines lab is curry curry is a bit more
is curry curry is a bit more
is curry curry is a bit more sophisticated in terms of features and
sophisticated in terms of features and
sophisticated in terms of features and movement as you can see here but it’s a
movement as you can see here but it’s a
movement as you can see here but it’s a similar platform in the sense that it’s
similar platform in the sense that it’s
similar platform in the sense that it’s about human robot interaction and the
about human robot interaction and the
about human robot interaction and the empathy between a person as a machine in
empathy between a person as a machine in
empathy between a person as a machine in this next video from TEDx peachtree dr.
this next video from TEDx peachtree dr.
this next video from TEDx peachtree dr. tomas is going to show how a gesture as
tomas is going to show how a gesture as
tomas is going to show how a gesture as simple as pointing that we take for
simple as pointing that we take for
simple as pointing that we take for granted can really increase
granted can really increase
granted can really increase communication the robot doesn’t have to
communication the robot doesn’t have to
communication the robot doesn’t have to say the thing that’s 17 inches from the
say the thing that’s 17 inches from the
say the thing that’s 17 inches from the table yes it is and that was a much more
table yes it is and that was a much more
table yes it is and that was a much more reasonable way to ask that question the
reasonable way to ask that question the
reasonable way to ask that question the most recent project that I’ve worked on
most recent project that I’ve worked on
most recent project that I’ve worked on with the socially intelligent machines
with the socially intelligent machines
with the socially intelligent machines lab now at UT Austin is Paulie
lab now at UT Austin is Paulie
lab now at UT Austin is Paulie so Paulie is a robot that can also be
so Paulie is a robot that can also be
so Paulie is a robot that can also be taught different tasks but my bigger
taught different tasks but my bigger
taught different tasks but my bigger goal is to really abstract the features
goal is to really abstract the features
goal is to really abstract the features so we don’t need to have eyeballs and
so we don’t need to have eyeballs and
so we don’t need to have eyeballs and eyelids and necessarily limbs but here
eyelids and necessarily limbs but here
eyelids and necessarily limbs but here the robot is essentially a box that’s a
the robot is essentially a box that’s a
the robot is essentially a box that’s a camera on a stick but I worked with the
camera on a stick but I worked with the
camera on a stick but I worked with the team to really design it as something in
team to really design it as something in
team to really design it as something in between a machine and the social entity
between a machine and the social entity
between a machine and the social entity so the head is still very social it can
so the head is still very social it can
so the head is still very social it can do similar things with gaze and
do similar things with gaze and
do similar things with gaze and attention I emphasized the field of
attention I emphasized the field of
attention I emphasized the field of vision I also emphasized the ears so
vision I also emphasized the ears so
vision I also emphasized the ears so people know that they can talk to it and
people know that they can talk to it and
people know that they can talk to it and it’s been used in trials in the hospital
it’s been used in trials in the hospital
it’s been used in trials in the hospital settings so that the nurses can have the
settings so that the nurses can have the
settings so that the nurses can have the robot do fetch and deliver tasks while
robot do fetch and deliver tasks while
robot do fetch and deliver tasks while they spend more time in the rooms with
they spend more time in the rooms with
they spend more time in the rooms with the patient’s I even worked with a
the patient’s I even worked with a
the patient’s I even worked with a fashion designer this time to develop a
fashion designer this time to develop a
fashion designer this time to develop a soft shell to give the robot a bit of a
soft shell to give the robot a bit of a
soft shell to give the robot a bit of a more human creature you look and here’s
more human creature you look and here’s
more human creature you look and here’s an example of how well Paulie was
an example of how well Paulie was
an example of how well Paulie was received the nurses even wanted to take
received the nurses even wanted to take
received the nurses even wanted to take selfies with her so I try to make
selfies with her so I try to make
selfies with her so I try to make everything I design that is
everything I design that is
everything I design that is appropriately a robot some kind of
appropriately a robot some kind of
appropriately a robot some kind of social interaction
social interaction
social interaction in this case this is the neato bot FAQ
in this case this is the neato bot FAQ
in this case this is the neato bot FAQ so even something as simple as a vacuum
so even something as simple as a vacuum
so even something as simple as a vacuum cleaner can be a social entity I worked
cleaner can be a social entity I worked
cleaner can be a social entity I worked closely with the CEO and the engineers
closely with the CEO and the engineers
closely with the CEO and the engineers in the company to use light sounds and
in the company to use light sounds and
in the company to use light sounds and motions to have the robot be as friendly
motions to have the robot be as friendly
motions to have the robot be as friendly and as possible and have a personality
and as possible and have a personality
and as possible and have a personality here you see I’ve broken down some of
here you see I’ve broken down some of
here you see I’ve broken down some of the main points of interaction cleaning
the main points of interaction cleaning
the main points of interaction cleaning cleanings complete it’s talking now and
cleanings complete it’s talking now and
cleanings complete it’s talking now and I really devised every aspect of the
I really devised every aspect of the
I really devised every aspect of the robots gestures so when it says hello it
robots gestures so when it says hello it
robots gestures so when it says hello it sees a person and it can actually back
sees a person and it can actually back
sees a person and it can actually back up and then go back and do its task I
up and then go back and do its task I
up and then go back and do its task I even went so far as to work with a
even went so far as to work with a
even went so far as to work with a composer to translate some of these
composer to translate some of these
composer to translate some of these moments into very quick but human
moments into very quick but human
moments into very quick but human understandable sounds so here’s just a
understandable sounds so here’s just a
understandable sounds so here’s just a sample of a few of them this is how it
sample of a few of them this is how it
sample of a few of them this is how it sounds when it’s about to go to work and
sounds when it’s about to go to work and
sounds when it’s about to go to work and this is when cleaning is done and this
this is when cleaning is done and this
this is when cleaning is done and this is if it recognizes a person with its
is if it recognizes a person with its
is if it recognizes a person with its laser it says oh hello and then there
laser it says oh hello and then there
laser it says oh hello and then there are negative sounds – like if it’s
are negative sounds – like if it’s
are negative sounds – like if it’s scared because it’s trapped or it’s
scared because it’s trapped or it’s
scared because it’s trapped or it’s about to run out of battery and it can
about to run out of battery and it can
about to run out of battery and it can also just kind of go to sleep and say
also just kind of go to sleep and say
also just kind of go to sleep and say good boy so I’m continuing to work on
good boy so I’m continuing to work on
good boy so I’m continuing to work on how we can make everyday objects imbued
how we can make everyday objects imbued
how we can make everyday objects imbued with robotics this next project is from
with robotics this next project is from
with robotics this next project is from my studio and it’s a clever coat rack so
my studio and it’s a clever coat rack so
my studio and it’s a clever coat rack so it’s connected to the Internet
it’s connected to the Internet
it’s connected to the Internet when a person approaches it it will wake
when a person approaches it it will wake
when a person approaches it it will wake up to greet them and then it lets them
up to greet them and then it lets them
up to greet them and then it lets them know what the current temperature is
know what the current temperature is
know what the current temperature is outside as well as the upcoming weather
outside as well as the upcoming weather
outside as well as the upcoming weather and conditions so the person knows what
and conditions so the person knows what
and conditions so the person knows what to bring with them when they go out oh
to bring with them when they go out oh
to bring with them when they go out oh and I’m starting to envision lots of
and I’m starting to envision lots of
and I’m starting to envision lots of other products that are going to have
other products that are going to have
other products that are going to have robotics in them a lamp that might nag
robotics in them a lamp that might nag
robotics in them a lamp that might nag you to wake you up in the morning a
you to wake you up in the morning a
you to wake you up in the morning a bathroom mirror that will know your
bathroom mirror that will know your
bathroom mirror that will know your health stats and keep you up to date on
health stats and keep you up to date on
health stats and keep you up to date on how to be better a bicycle that might
how to be better a bicycle that might
how to be better a bicycle that might help you with the next appointment and
help you with the next appointment and
help you with the next appointment and give you directions or a pen that
give you directions or a pen that
give you directions or a pen that remembers your emails and sends them out
remembers your emails and sends them out
remembers your emails and sends them out to the necessary people a door that
to the necessary people a door that
to the necessary people a door that greets
greets
greets when you come home maybe even a sous
when you come home maybe even a sous
when you come home maybe even a sous chef in the kitchen I would like that so
chef in the kitchen I would like that so
chef in the kitchen I would like that so what we know is that the robots are here
what we know is that the robots are here
what we know is that the robots are here and it’s up to us then to know our
and it’s up to us then to know our
and it’s up to us then to know our limits whether we want them in our lives
limits whether we want them in our lives
limits whether we want them in our lives or not for example your washing machines
or not for example your washing machines
or not for example your washing machines gonna be kind of a robot and to tell you
gonna be kind of a robot and to tell you
gonna be kind of a robot and to tell you the truth I don’t have any problem with
the truth I don’t have any problem with
the truth I don’t have any problem with it doing the wash for me
it doing the wash for me
it doing the wash for me the elevators kind of a robot and my
the elevators kind of a robot and my
the elevators kind of a robot and my doctor might tell me and you might want
doctor might tell me and you might want
doctor might tell me and you might want to take the stairs and it’s gonna get a
to take the stairs and it’s gonna get a
to take the stairs and it’s gonna get a lot tougher there is more than one
lot tougher there is more than one
lot tougher there is more than one startup working on something like this a
startup working on something like this a
startup working on something like this a dog walking robot or how about this
dog walking robot or how about this
dog walking robot or how about this a nanny robot there is a startup working
a nanny robot there is a startup working
a nanny robot there is a startup working on this as well so it’s gonna get tough
on this as well so it’s gonna get tough
on this as well so it’s gonna get tough so what we have to remember is that
so what we have to remember is that
so what we have to remember is that rather than trying to replace ourselves
rather than trying to replace ourselves
rather than trying to replace ourselves what we can do is we can enhance the
what we can do is we can enhance the
what we can do is we can enhance the human relationships using technology and
human relationships using technology and
human relationships using technology and robotics so in the next couple of
robotics so in the next couple of
robotics so in the next couple of projects I’m going to show you some work
projects I’m going to show you some work
projects I’m going to show you some work that I’ve done with my students at UPenn
that I’ve done with my students at UPenn
that I’ve done with my students at UPenn in a course called Smart Objects one of
in a course called Smart Objects one of
in a course called Smart Objects one of the students worked on a plant that
the students worked on a plant that
the students worked on a plant that helps people in long distance
helps people in long distance
helps people in long distance relationships so two people have these
relationships so two people have these
relationships so two people have these connected plants and the plants are able
connected plants and the plants are able
connected plants and the plants are able to know when they’re being watered and
to know when they’re being watered and
to know when they’re being watered and broadcast that information to someone
broadcast that information to someone
broadcast that information to someone halfway across the world
halfway across the world
halfway across the world so in this video
so in this video
so in this video we see that when one plant is watered
we see that when one plant is watered
we see that when one plant is watered the other person is aware that that
the other person is aware that that
the other person is aware that that plant is getting taken care of so it
plant is getting taken care of so it
plant is getting taken care of so it becomes kind of a joint nurturing system
becomes kind of a joint nurturing system
becomes kind of a joint nurturing system [Music]
[Music]
[Music] in this next project we see something
in this next project we see something
in this next project we see something called a swear jar which is a way that
called a swear jar which is a way that
called a swear jar which is a way that people can agree to avoid saying certain
people can agree to avoid saying certain
people can agree to avoid saying certain words that they don’t want to say in
words that they don’t want to say in
words that they don’t want to say in front of each other so I’ll let the
front of each other so I’ll let the
front of each other so I’ll let the video explain it it’s by two students
video explain it it’s by two students
video explain it it’s by two students named Allan Kittleman and John Johnston
named Allan Kittleman and John Johnston
named Allan Kittleman and John Johnston from my smart objects course at UPenn
so there you have it it points in the
so there you have it it points in the direction of the offending person pops
direction of the offending person pops
direction of the offending person pops down the cork and taunts them with the
down the cork and taunts them with the
down the cork and taunts them with the word that they said so there you have it
word that they said so there you have it
word that they said so there you have it the robots are here we can have them
the robots are here we can have them
the robots are here we can have them toward us we can have to coach us you
toward us we can have to coach us you
toward us we can have to coach us you can have them nag us we can have them
can have them nag us we can have them
can have them nag us we can have them encourage us to be better but it’s up to
encourage us to be better but it’s up to
encourage us to be better but it’s up to us to know our limits thank you
us to know our limits thank you
us to know our limits thank you [Applause]
”
Be First to Comment