Press "Enter" to skip to content

Trusting Automation….or Not | Bond R. “Dick” Hattershire | TEDxDayton


several years ago my company did

several years ago my company did aerospace research for NASA at Ames

aerospace research for NASA at Ames

aerospace research for NASA at Ames Research Center in San Jose California

Research Center in San Jose California

Research Center in San Jose California they have a very powerful air traffic

they have a very powerful air traffic

they have a very powerful air traffic control control tower simulator that

control control tower simulator that

control control tower simulator that they can use to evaluate improvements to

they can use to evaluate improvements to

they can use to evaluate improvements to existing airports study new airports and

existing airports study new airports and

existing airports study new airports and solve their traffic problems real

solve their traffic problems real

solve their traffic problems real controllers to direct real pilots flying

controllers to direct real pilots flying

controllers to direct real pilots flying this aircraft that you see in this video

this aircraft that you see in this video

this aircraft that you see in this video the real pilots fly the simulator from

the real pilots fly the simulator from

the real pilots fly the simulator from another room but they are at a computer

another room but they are at a computer

another room but they are at a computer terminal and each one can control two to

terminal and each one can control two to

terminal and each one can control two to four aircraft so there’s a lot of

four aircraft so there’s a lot of

four aircraft so there’s a lot of traffic possibilities the interesting

traffic possibilities the interesting

traffic possibilities the interesting thing about the facility is it can

thing about the facility is it can

thing about the facility is it can simulate virtually any airport almost

simulate virtually any airport almost

simulate virtually any airport almost anywhere in the world

anywhere in the world

anywhere in the world that’s very cool stuff especially if

that’s very cool stuff especially if

that’s very cool stuff especially if you’re researcher

you’re researcher

you’re researcher the toughest problem in airports is not

the toughest problem in airports is not

the toughest problem in airports is not landing aircraft and taking them off the

landing aircraft and taking them off the

landing aircraft and taking them off the toughest problem is what do you do with

toughest problem is what do you do with

toughest problem is what do you do with them on the ground there’s a lot of them

them on the ground there’s a lot of them

them on the ground there’s a lot of them they all need to go get to where they’re

they all need to go get to where they’re

they all need to go get to where they’re gonna go whether it’s takeoff or a gate

gonna go whether it’s takeoff or a gate

gonna go whether it’s takeoff or a gate and so they you have to orchestrate that

and so they you have to orchestrate that

and so they you have to orchestrate that so they don’t run into each other this

so they don’t run into each other this

so they don’t run into each other this is really true in airports like Chicago

is really true in airports like Chicago

is really true in airports like Chicago O’Hare Kennedy in New York and this is

O’Hare Kennedy in New York and this is

O’Hare Kennedy in New York and this is Los Angeles that you’re looking at

Los Angeles that you’re looking at

Los Angeles that you’re looking at they all have multiple runways they all

they all have multiple runways they all

they all have multiple runways they all have many taxiways and those of you like

have many taxiways and those of you like

have many taxiways and those of you like me who have waited on a taxiway to

me who have waited on a taxiway to

me who have waited on a taxiway to either take off or get to a gate can

either take off or get to a gate can

either take off or get to a gate can relate to the problem so orchestrating

relate to the problem so orchestrating

relate to the problem so orchestrating this aircraft dance is a bit of a

this aircraft dance is a bit of a

this aircraft dance is a bit of a challenge but a local researcher had

challenge but a local researcher had

challenge but a local researcher had studied the problem and he felt he had a

studied the problem and he felt he had a

studied the problem and he felt he had a fully automated solution and it worked

fully automated solution and it worked

fully automated solution and it worked perfectly on his laboratory so they

perfectly on his laboratory so they

perfectly on his laboratory so they brought it out to Ames put it on the

brought it out to Ames put it on the

brought it out to Ames put it on the simulator and it worked perfectly then

simulator and it worked perfectly then

simulator and it worked perfectly then they introduced the human element a

they introduced the human element a

they introduced the human element a controller and a pilot and you get one

controller and a pilot and you get one

controller and a pilot and you get one of you two head of me which is it

it didn’t take long for the simulation

it didn’t take long for the simulation that was chugging along to slow down and

that was chugging along to slow down and

that was chugging along to slow down and ultimately it ground to a halt and

ultimately it ground to a halt and

ultimately it ground to a halt and here’s the point the simulation the

here’s the point the simulation the

here’s the point the simulation the automation worked exactly as it was

automation worked exactly as it was

automation worked exactly as it was designed to do perfectly what the

designed to do perfectly what the

designed to do perfectly what the designer didn’t do it didn’t take into

designer didn’t do it didn’t take into

designer didn’t do it didn’t take into account the human decision process that

account the human decision process that

account the human decision process that other real people go through and so the

other real people go through and so the

other real people go through and so the captain the the guy flying the airplane

captain the the guy flying the airplane

captain the the guy flying the airplane and the guy controlling the guy flying

and the guy controlling the guy flying

and the guy controlling the guy flying the airplane who were used to being in

the airplane who were used to being in

the airplane who were used to being in charge right didn’t trust the simulation

charge right didn’t trust the simulation

charge right didn’t trust the simulation Trust is an important part of our daily

Trust is an important part of our daily

Trust is an important part of our daily lives we trust our friends to be

lives we trust our friends to be

lives we trust our friends to be reliable and supportive we trust our car

reliable and supportive we trust our car

reliable and supportive we trust our car to start when we want it to and above

to start when we want it to and above

to start when we want it to and above all we trust for all of our electronics

all we trust for all of our electronics

all we trust for all of our electronics to be available to work every time we

to be available to work every time we

to be available to work every time we want them to whether they’re charged or

want them to whether they’re charged or

want them to whether they’re charged or not so how do we define trust what are

not so how do we define trust what are

not so how do we define trust what are the factors well the dictionary

the factors well the dictionary

the factors well the dictionary definition works pretty well for humans

definition works pretty well for humans

definition works pretty well for humans it is it’s a firm belief and the

it is it’s a firm belief and the

it is it’s a firm belief and the reliability truth ability of someone or

reliability truth ability of someone or

reliability truth ability of someone or something not bad but the definition

something not bad but the definition

something not bad but the definition that two of the most prominent human

that two of the most prominent human

that two of the most prominent human factors researchers in trust and

factors researchers in trust and

factors researchers in trust and automation have come up with is probably

automation have come up with is probably

automation have come up with is probably more accurate for what we’re talking

more accurate for what we’re talking

more accurate for what we’re talking about the attitude that an agent will

about the attitude that an agent will

about the attitude that an agent will help an individual’s goals in the

help an individual’s goals in the

help an individual’s goals in the situation characterized by uncertainty

situation characterized by uncertainty

situation characterized by uncertainty and vulnerability the words to take away

and vulnerability the words to take away

and vulnerability the words to take away our reliability and uncertainty trust

our reliability and uncertainty trust

our reliability and uncertainty trust between humans is learned over time by

between humans is learned over time by

between humans is learned over time by association and by reliable behavior but

association and by reliable behavior but

association and by reliable behavior but it can be lost when those conditions are

it can be lost when those conditions are

it can be lost when those conditions are no longer true there’s evidence that

no longer true there’s evidence that

no longer true there’s evidence that most people believe that machines are

most people believe that machines are

most people believe that machines are nearly perfect so that results in an

nearly perfect so that results in an

nearly perfect so that results in an initial trust of

initial trust of

initial trust of that’s pretty high however the moment

that’s pretty high however the moment

that’s pretty high however the moment those machines don’t behave in a way

those machines don’t behave in a way

those machines don’t behave in a way that humans recognize as being reliable

that humans recognize as being reliable

that humans recognize as being reliable and appropriate that trust can be lost

the piece of technology is astonishing

the piece of technology is astonishing but the ability that we have to adapt to

but the ability that we have to adapt to

but the ability that we have to adapt to it lags way behind the pace of research

it lags way behind the pace of research

it lags way behind the pace of research however is glacial awful so one of the

however is glacial awful so one of the

however is glacial awful so one of the most challenging problems with

most challenging problems with

most challenging problems with automation is stuff goes wrong this is

automation is stuff goes wrong this is

automation is stuff goes wrong this is the cost of concordia 32 people lost

the cost of concordia 32 people lost

the cost of concordia 32 people lost their lives

their lives

their lives oh no on this this wreck and it happened

oh no on this this wreck and it happened

oh no on this this wreck and it happened because the captain didn’t trust the

because the captain didn’t trust the

because the captain didn’t trust the navigation of the of the boat took it

navigation of the of the boat took it

navigation of the of the boat took it over took manual control and he steered

over took manual control and he steered

over took manual control and he steered it into a rock okay that’s the serious

it into a rock okay that’s the serious

it into a rock okay that’s the serious part it’s possible to trust automation

part it’s possible to trust automation

part it’s possible to trust automation too much we love them but they take us

too much we love them but they take us

too much we love them but they take us in 20 places sometimes it also makes for

in 20 places sometimes it also makes for

in 20 places sometimes it also makes for good TV if any of you ever watch The

good TV if any of you ever watch The

good TV if any of you ever watch The Office you may have seen in the episode

Office you may have seen in the episode

Office you may have seen in the episode where Steve Carell is character Michael

where Steve Carell is character Michael

where Steve Carell is character Michael trusted his GPS so literally he drove it

trusted his GPS so literally he drove it

trusted his GPS so literally he drove it into a lake driverless cars can save

into a lake driverless cars can save

into a lake driverless cars can save lives and uber Google the Ottawa

lives and uber Google the Ottawa

lives and uber Google the Ottawa industry lots of people are involved but

industry lots of people are involved but

industry lots of people are involved but uber the first car on your left had a

uber the first car on your left had a

uber the first car on your left had a little problem it missed six I’m sorry

little problem it missed six I’m sorry

little problem it missed six I’m sorry that’s six

that’s six

that’s six red lights in a test in San Francisco

red lights in a test in San Francisco

red lights in a test in San Francisco the Tesla in the middle there was a

the Tesla in the middle there was a

the Tesla in the middle there was a famous Florida crash where a truck

famous Florida crash where a truck

famous Florida crash where a truck pulled into the path of the car the car

pulled into the path of the car the car

pulled into the path of the car the car could not recognize it react to it

could not recognize it react to it

could not recognize it react to it quickly enough and the guy lost his life

quickly enough and the guy lost his life

quickly enough and the guy lost his life he even didn’t take control of the

he even didn’t take control of the

he even didn’t take control of the vehicle even though he was getting

vehicle even though he was getting

vehicle even though he was getting visual warnings to do so

visual warnings to do so

visual warnings to do so and the cute one on the right

and the cute one on the right

and the cute one on the right originally by Google now it’s called way

originally by Google now it’s called way

originally by Google now it’s called way mo and it is fully autonomous if any of

mo and it is fully autonomous if any of

mo and it is fully autonomous if any of you know anything about autonomy this is

you know anything about autonomy this is

you know anything about autonomy this is somewhere between level 4 and level 5

somewhere between level 4 and level 5

somewhere between level 4 and level 5 and that’s there’s the didactic part of

and that’s there’s the didactic part of

and that’s there’s the didactic part of the talk that’s what that’s done with

the talk that’s what that’s done with

the talk that’s what that’s done with that means that you don’t get to do

that means that you don’t get to do

that means that you don’t get to do anything except get in turn it on when

anything except get in turn it on when

anything except get in turn it on when you get there you turn it off and you

you get there you turn it off and you

you get there you turn it off and you get out but it has been pulled over by a

get out but it has been pulled over by a

get out but it has been pulled over by a cop

who was driving too slow pilotless

who was driving too slow pilotless airplanes had the potential to have

airplanes had the potential to have

airplanes had the potential to have safety benefits and economic benefits

safety benefits and economic benefits

safety benefits and economic benefits this one happens to be from Airbus but

this one happens to be from Airbus but

this one happens to be from Airbus but in a recent UBS survey only 17% of the

in a recent UBS survey only 17% of the

in a recent UBS survey only 17% of the people responding to the survey said

people responding to the survey said

people responding to the survey said they actually fly online and in truth

they actually fly online and in truth

they actually fly online and in truth even if you would they’re still going to

even if you would they’re still going to

even if you would they’re still going to have neat ground monitoring for the

have neat ground monitoring for the

have neat ground monitoring for the longest period of time because somebody

longest period of time because somebody

longest period of time because somebody needs to take over if something goes

needs to take over if something goes

needs to take over if something goes wrong in the air trust and automation

wrong in the air trust and automation

wrong in the air trust and automation can also evolve over time how many of

can also evolve over time how many of

can also evolve over time how many of you like me counted your money

you like me counted your money

you like me counted your money religiously the first few times you used

religiously the first few times you used

religiously the first few times you used an ATM I’ll come on you know you did I

did I still do sometimes and but

did I still do sometimes and but ultimately we get to the point where you

ultimately we get to the point where you

ultimately we get to the point where you realize they’re pretty reliably going to

realize they’re pretty reliably going to

realize they’re pretty reliably going to work all the time so the common element

work all the time so the common element

work all the time so the common element and all of these things is that few if

and all of these things is that few if

and all of these things is that few if any designs take into account the human

any designs take into account the human

any designs take into account the human and they particulate human need for

and they particulate human need for

and they particulate human need for reduced uncertainty but an advance of

reduced uncertainty but an advance of

reduced uncertainty but an advance of technology is going on no matter what so

technology is going on no matter what so

technology is going on no matter what so finding a way to deal with this

finding a way to deal with this

finding a way to deal with this uncertainty is going to be critical for

uncertainty is going to be critical for

uncertainty is going to be critical for the future that requires more and better

the future that requires more and better

the future that requires more and better research human focused research and a

research human focused research and a

research human focused research and a lot of the human-computer human-machine

lot of the human-computer human-machine

lot of the human-computer human-machine stuff is going on today in academia and

stuff is going on today in academia and

stuff is going on today in academia and in in industry

in in industry

in in industry Microsoft and Disney are two examples

Microsoft and Disney are two examples

Microsoft and Disney are two examples but virtually none of it none of them

but virtually none of it none of them

but virtually none of it none of them addresses trust trust and automation

addresses trust trust and automation

addresses trust trust and automation research is however strong in the

research is however strong in the

research is however strong in the Department of Defense in fact some is

Department of Defense in fact some is

Department of Defense in fact some is going on in our backyard at

going on in our backyard at

going on in our backyard at wright-patterson where the human

wright-patterson where the human

wright-patterson where the human resource Laboratory has an office

resource Laboratory has an office

resource Laboratory has an office specifically chartered to do that kind

specifically chartered to do that kind

specifically chartered to do that kind of research the loyal wingman program is

of research the loyal wingman program is

of research the loyal wingman program is a good example imagine if you will a

a good example imagine if you will a

a good example imagine if you will a manned aircraft could be an f-35 but a

manned aircraft could be an f-35 but a

manned aircraft could be an f-35 but a manned aircraft flying and joined in

manned aircraft flying and joined in

manned aircraft flying and joined in formation by a

formation by a

formation by a the unmanned aircraft fully automated

the unmanned aircraft fully automated

the unmanned aircraft fully automated capable of breaking off and executing a

capable of breaking off and executing a

capable of breaking off and executing a mission when this aircraft commands it

mission when this aircraft commands it

mission when this aircraft commands it to do so yeah I thought so too

to do so yeah I thought so too

to do so yeah I thought so too so clearly research in this whole area

so clearly research in this whole area

so clearly research in this whole area is behind the power curve and this

is behind the power curve and this

is behind the power curve and this lagging behind the pace of technology

lagging behind the pace of technology

lagging behind the pace of technology development but wouldn’t our lives be so

development but wouldn’t our lives be so

development but wouldn’t our lives be so much easier and more productive if we

much easier and more productive if we

much easier and more productive if we could count on some human touch in the

could count on some human touch in the

could count on some human touch in the automation we occur there may be some

automation we occur there may be some

automation we occur there may be some hope this reconnaissance vessel is

hope this reconnaissance vessel is

hope this reconnaissance vessel is called a sea hunter it is fully

called a sea hunter it is fully

called a sea hunter it is fully autonomous it has human design elements

autonomous it has human design elements

autonomous it has human design elements that were programmed into it from the

that were programmed into it from the

that were programmed into it from the very beginning it is programmed to obey

very beginning it is programmed to obey

very beginning it is programmed to obey all the laws of maritime operation and

all the laws of maritime operation and

all the laws of maritime operation and can operate worldwide the difference is

can operate worldwide the difference is

can operate worldwide the difference is that although it can do maritime

that although it can do maritime

that although it can do maritime operation and it can determine right

operation and it can determine right

operation and it can determine right away with between itself and other ships

away with between itself and other ships

away with between itself and other ships in the area it does so with the

in the area it does so with the

in the area it does so with the knowledge that it can maneuver out of

knowledge that it can maneuver out of

knowledge that it can maneuver out of the way in a manner in which a human

the way in a manner in which a human

the way in a manner in which a human would maneuver

would maneuver

would maneuver thus conveying trust to the other ships

thus conveying trust to the other ships

thus conveying trust to the other ships nearby so I’m gonna leave the last word

nearby so I’m gonna leave the last word

nearby so I’m gonna leave the last word to Elon Musk where he said artificial

to Elon Musk where he said artificial

to Elon Musk where he said artificial intelligence will be the best thing or

intelligence will be the best thing or

intelligence will be the best thing or the worst thing ever for Humanity so

the worst thing ever for Humanity so

the worst thing ever for Humanity so let’s get it right

”

Be First to Comment

Leave a Reply

Your email address will not be published. Required fields are marked *