Improving Life for People with Disability | David Hobbs | TEDxFulbrightMelbourne

[Music]

[Music] so this is probably my favorite photo

so this is probably my favorite photo

so this is probably my favorite photo from one is to work a leading children’s

from one is to work a leading children’s

from one is to work a leading children’s disability sensor in Adelaide but let me

disability sensor in Adelaide but let me

disability sensor in Adelaide but let me give you the background to the photo so

give you the background to the photo so

give you the background to the photo so you know why this image means so much to

you know why this image means so much to

you know why this image means so much to me

me

me so more than 15 years ago a colleague of

so more than 15 years ago a colleague of

so more than 15 years ago a colleague of mine in Toronto Canada professor Tom

mine in Toronto Canada professor Tom

mine in Toronto Canada professor Tom Chow letter team that developed an

Chow letter team that developed an

Chow letter team that developed an amazing piece of software called the

amazing piece of software called the

amazing piece of software called the virtual music instrument or VMI what the

virtual music instrument or VMI what the

virtual music instrument or VMI what the VMI did was it was a software program

VMI did was it was a software program

VMI did was it was a software program and when you plugged it into a webcam it

and when you plugged it into a webcam it

and when you plugged it into a webcam it translated movements or gestures into

translated movements or gestures into

translated movements or gestures into music so we had to do was move your arm

music so we had to do was move your arm

music so we had to do was move your arm or pop your head and you can play music

or pop your head and you can play music

or pop your head and you can play music you interacted with the colored shapes

you interacted with the colored shapes

you interacted with the colored shapes that you can see on the screen but the

that you can see on the screen but the

that you can see on the screen but the application was the inspiration so Tom’s

application was the inspiration so Tom’s

application was the inspiration so Tom’s team developed this program to help

team developed this program to help

team developed this program to help children with a disability who couldn’t

children with a disability who couldn’t

children with a disability who couldn’t hold or play music to be musical they

hold or play music to be musical they

hold or play music to be musical they became the instrument so this photo was

became the instrument so this photo was

became the instrument so this photo was taken from the very first trial on the

taken from the very first trial on the

taken from the very first trial on the software here in Australia when I

software here in Australia when I

software here in Australia when I trialed it in Adelaide and to be honest

trialed it in Adelaide and to be honest

trialed it in Adelaide and to be honest I didn’t really know what was going to

I didn’t really know what was going to

I didn’t really know what was going to happen so I borrowed a laptop from a

happen so I borrowed a laptop from a

happen so I borrowed a laptop from a colleague a data projector from another

colleague a data projector from another

colleague a data projector from another colleague I got the cheapest possible

colleague I got the cheapest possible

colleague I got the cheapest possible webcam that I could afford at the time

webcam that I could afford at the time

webcam that I could afford at the time and clearly all the money I had went

and clearly all the money I had went

and clearly all the money I had went into that very high tech mobile user

into that very high tech mobile user

into that very high tech mobile user multi-purpose webcam stand you can see

multi-purpose webcam stand you can see

multi-purpose webcam stand you can see in the photo as well what happened next

in the photo as well what happened next

in the photo as well what happened next though was amazing so there was a young

though was amazing so there was a young

though was amazing so there was a young girl in this particular session and she

girl in this particular session and she

girl in this particular session and she couldn’t walk and she couldn’t talk but

couldn’t walk and she couldn’t talk but

couldn’t walk and she couldn’t talk but she knew the music that she was hearing

she knew the music that she was hearing

she knew the music that she was hearing was being played by someone Hills in

was being played by someone Hills in

was being played by someone Hills in front of that webcam so she shuffled

front of that webcam so she shuffled

front of that webcam so she shuffled herself all the way over to the middle

herself all the way over to the middle

herself all the way over to the middle of the room right in front of the webcam

of the room right in front of the webcam

of the room right in front of the webcam petitioned herself in front of the wall

petitioned herself in front of the wall

petitioned herself in front of the wall she could see herself on the screen and

she could see herself on the screen and

she could see herself on the screen and then it happened first one hand then the

then it happened first one hand then the

then it happened first one hand then the other then her head then our whole body

other then her head then our whole body

other then her head then our whole body she was bobbing up and down making more

she was bobbing up and down making more

she was bobbing up and down making more music that I’d heard for the whole week

music that I’d heard for the whole week

music that I’d heard for the whole week her face beamed she was all light as it

her face beamed she was all light as it

her face beamed she was all light as it turned out I could actually see her

turned out I could actually see her

turned out I could actually see her mother was on the side of the room and

mother was on the side of the room and

mother was on the side of the room and so I went over to her and said look what

so I went over to her and said look what

so I went over to her and said look what you tell me when you see your daughter

you tell me when you see your daughter

you tell me when you see your daughter doing this we’ve never used this program

doing this we’ve never used this program

doing this we’ve never used this program here before and she said David I’ve

here before and she said David I’ve

here before and she said David I’ve never seen my daughter move before so

never seen my daughter move before so

never seen my daughter move before so much ever technology as an enabler

much ever technology as an enabler

much ever technology as an enabler technology as a tool for motivation so I

technology as a tool for motivation so I

technology as a tool for motivation so I spent most of my life working with a

spent most of my life working with a

spent most of my life working with a condition called cerebral palsy or CP

condition called cerebral palsy or CP

condition called cerebral palsy or CP now this is a permanent condition which

now this is a permanent condition which

now this is a permanent condition which has no cure and here in Australia on

has no cure and here in Australia on

has no cure and here in Australia on average roughly every 15 hours a child

average roughly every 15 hours a child

average roughly every 15 hours a child is born with cerebral palsy

is born with cerebral palsy

is born with cerebral palsy Sarah palsy is when there’s an injury to

Sarah palsy is when there’s an injury to

Sarah palsy is when there’s an injury to the developing brain and what this means

the developing brain and what this means

the developing brain and what this means is there’s issues with coordination

is there’s issues with coordination

is there’s issues with coordination control movement and posture sometimes

control movement and posture sometimes

control movement and posture sometimes the census of vision hearing and touch

the census of vision hearing and touch

the census of vision hearing and touch and also sometimes cognition or thinking

and also sometimes cognition or thinking

and also sometimes cognition or thinking they have someone has cerebral palsy it

they have someone has cerebral palsy it

they have someone has cerebral palsy it means that they need on they have to

means that they need on they have to

means that they need on they have to participate in ongoing therapy but

participate in ongoing therapy but

participate in ongoing therapy but therapy can be boring and therapy is

therapy can be boring and therapy is

therapy can be boring and therapy is seen as work and nobody likes work so

seen as work and nobody likes work so

seen as work and nobody likes work so the interests that I have and my PhD

the interests that I have and my PhD

the interests that I have and my PhD focus at the moment is looking at how

focus at the moment is looking at how

focus at the moment is looking at how children with cerebral palsy use their

children with cerebral palsy use their

children with cerebral palsy use their heads now we know that children with

heads now we know that children with

heads now we know that children with cerebral palsy use their heads

cerebral palsy use their heads

cerebral palsy use their heads differently so children who do not have

differently so children who do not have

differently so children who do not have cerebral palsy and we also know that

cerebral palsy and we also know that

cerebral palsy and we also know that children with cerebral palsy have what

children with cerebral palsy have what

children with cerebral palsy have what we call a dominant head and this is the

we call a dominant head and this is the

we call a dominant head and this is the Hema used all the time for all

Hema used all the time for all

Hema used all the time for all activities and a non-dominant or not so

activities and a non-dominant or not so

activities and a non-dominant or not so well performing here this hand doesn’t

well performing here this hand doesn’t

well performing here this hand doesn’t perform very well in fact it’s often

perform very well in fact it’s often

perform very well in fact it’s often neglected so the key for most therapies

neglected so the key for most therapies

neglected so the key for most therapies is actually to engage this hand here

is actually to engage this hand here

is actually to engage this hand here because if I can engage this hand I can

because if I can engage this hand I can

because if I can engage this hand I can improve how children use their hand and

improve how children use their hand and

improve how children use their hand and improve their independence hands up here

improve their independence hands up here

improve their independence hands up here who likes playing computer games I mean

who likes playing computer games I mean

who likes playing computer games I mean I played them a lot when I was a child

I played them a lot when I was a child

I played them a lot when I was a child and many many people play computer games

unfortunately computer games

unfortunately computer games particularly computer games are come off

particularly computer games are come off

particularly computer games are come off the shelf and what we call inaccessible

the shelf and what we call inaccessible

the shelf and what we call inaccessible to someone with cerebral palsy or

to someone with cerebral palsy or

to someone with cerebral palsy or someone with a hand impairment the

someone with a hand impairment the

someone with a hand impairment the buttons can be too close together and

buttons can be too close together and

buttons can be too close together and this means it’s hard to press and the

this means it’s hard to press and the

this means it’s hard to press and the software can be too fast the games can

software can be too fast the games can

software can be too fast the games can be too complex what I wondered for my

be too complex what I wondered for my

be too complex what I wondered for my PhD was could we use design and

PhD was could we use design and

PhD was could we use design and technology and could we use computer

technology and could we use computer

technology and could we use computer games to actually help children to

games to actually help children to

games to actually help children to voluntarily want to use both of their

voluntarily want to use both of their

voluntarily want to use both of their hands did you know that when computer

hands did you know that when computer

hands did you know that when computer games use in a health context in a

games use in a health context in a

games use in a health context in a health setting they called serious games

health setting they called serious games

health setting they called serious games serious games a game somewhere there

serious games a game somewhere there

serious games a game somewhere there there is not the pure entertainment

there is not the pure entertainment

there is not the pure entertainment process so in a health context we use

process so in a health context we use

process so in a health context we use them to help someone with a health issue

them to help someone with a health issue

them to help someone with a health issue now in disability we talk a lot about

now in disability we talk a lot about

now in disability we talk a lot about inaccessibility we say that something is

inaccessibility we say that something is

inaccessibility we say that something is inaccessible if you can’t use it or

inaccessible if you can’t use it or

inaccessible if you can’t use it or interact with it and unfortunately

interact with it and unfortunately

interact with it and unfortunately systems are not accessible so what we

systems are not accessible so what we

systems are not accessible so what we need to do was we need to design our own

need to do was we need to design our own

need to do was we need to design our own computer gaming system to do this though

computer gaming system to do this though

computer gaming system to do this though required assembling an expert team and

required assembling an expert team and

required assembling an expert team and here are some of the key people involved

here are some of the key people involved

here are some of the key people involved here on this slide but when you looked

here on this slide but when you looked

here on this slide but when you looked at the whole team we number more than a

at the whole team we number more than a

at the whole team we number more than a dozen different professional disciplines

dozen different professional disciplines

dozen different professional disciplines working from three different

working from three different

working from three different institutions and what did we do we

institutions and what did we do we

institutions and what did we do we designed something called the orbit

designed something called the orbit

designed something called the orbit gaming system now the orbit gaming

gaming system now the orbit gaming

gaming system now the orbit gaming system starting with the controller is

system starting with the controller is

system starting with the controller is actually a controller which doesn’t

actually a controller which doesn’t

actually a controller which doesn’t require a fine finger movement or

require a fine finger movement or

require a fine finger movement or control to use you just put your hands

control to use you just put your hands

control to use you just put your hands on it and rotate the controller around

on it and rotate the controller around

on it and rotate the controller around like that so I’m taking away issues of

like that so I’m taking away issues of

like that so I’m taking away issues of grip and fine finger movement the

grip and fine finger movement the

grip and fine finger movement the controller vibrates or provides haptic

controller vibrates or provides haptic

controller vibrates or provides haptic feedback when the user plays the

feedback when the user plays the

feedback when the user plays the computer games and we know this is

computer games and we know this is

computer games and we know this is important because we know ads to buy in

important because we know ads to buy in

important because we know ads to buy in because it had to realism to play in the

because it had to realism to play in the

because it had to realism to play in the games smart sensors built into the

games smart sensors built into the

games smart sensors built into the controller always make sure that two

controller always make sure that two

controller always make sure that two hands adding user control on the

hands adding user control on the

hands adding user control on the controller the whole time and this is

controller the whole time and this is

controller the whole time and this is really important if I try and play the

really important if I try and play the

really important if I try and play the controller and play some of the games

controller and play some of the games

controller and play some of the games that if one of my hands comes off the

that if one of my hands comes off the

that if one of my hands comes off the system pauses and stops which is very

system pauses and stops which is very

system pauses and stops which is very frustrating the only way to make a play

frustrating the only way to make a play

frustrating the only way to make a play again is putting both my hands back on

again is putting both my hands back on

again is putting both my hands back on the controller so I have to have both my

the controller so I have to have both my

the controller so I have to have both my hands on there the software we coded the

hands on there the software we coded the

hands on there the software we coded the software so that it uses a very special

software so that it uses a very special

software so that it uses a very special technique so no two games are the same

technique so no two games are the same

technique so no two games are the same they’re always randomized and unique and

they’re always randomized and unique and

they’re always randomized and unique and this is important because we didn’t want

this is important because we didn’t want

this is important because we didn’t want people to memorize games we wanted them

people to memorize games we wanted them

people to memorize games we wanted them to adapt and change continually so the

to adapt and change continually so the

to adapt and change continually so the visual focus from the gang came towards

visual focus from the gang came towards

visual focus from the gang came towards them and they use by manual control with

them and they use by manual control with

them and they use by manual control with the controller to actually adapt their

the controller to actually adapt their

the controller to actually adapt their game gaming character with respect to

game gaming character with respect to

game gaming character with respect to what they’re seeing on the screen this

what they’re seeing on the screen this

what they’re seeing on the screen this is a young teenage boy with cerebral

is a young teenage boy with cerebral

is a young teenage boy with cerebral palsy on Weld cerebral palsy day using

palsy on Weld cerebral palsy day using

palsy on Weld cerebral palsy day using the orbit gaming system he’s playing one

the orbit gaming system he’s playing one

the orbit gaming system he’s playing one of our favorite games the one the

of our favorite games the one the

of our favorite games the one the children love the most called squirrel

children love the most called squirrel

children love the most called squirrel but as you can see even when the game

but as you can see even when the game

but as you can see even when the game gets quite fast and complex it’s just

gets quite fast and complex it’s just

gets quite fast and complex it’s just simple and intuitive movements that he

simple and intuitive movements that he

simple and intuitive movements that he uses with the joist

uses with the joist

uses with the joist to control his gaming character so we’ve

to control his gaming character so we’ve

to control his gaming character so we’ve had children as young as four use the

had children as young as four use the

had children as young as four use the system it’s very intuitive and very easy

system it’s very intuitive and very easy

system it’s very intuitive and very easy to use now at the end of the trial when

to use now at the end of the trial when

to use now at the end of the trial when we looked at the data that we had we

we looked at the data that we had we

we looked at the data that we had we discovered that we actually had a

discovered that we actually had a

discovered that we actually had a statistically significant result so an

statistically significant result so an

statistically significant result so an improvement for have that non-performing

improvement for have that non-performing

improvement for have that non-performing here and the Hang which children tend to

here and the Hang which children tend to

here and the Hang which children tend to neglect so we’re able to show that with

neglect so we’re able to show that with

neglect so we’re able to show that with tasks on manual function and dexterity

tasks on manual function and dexterity

tasks on manual function and dexterity we improved the ability for that hand

we improved the ability for that hand

we improved the ability for that hand and we believe it’s because when you

and we believe it’s because when you

and we believe it’s because when you have to have both hands on the

have to have both hands on the

have to have both hands on the controller it means that hang which is

controller it means that hang which is

controller it means that hang which is normally neglected is no longer neglect

normally neglected is no longer neglect

normally neglected is no longer neglect it’s part of the process so at the end

it’s part of the process so at the end

it’s part of the process so at the end of the day we developed a system which

of the day we developed a system which

of the day we developed a system which has to has two hands on the control at

has to has two hands on the control at

has to has two hands on the control at all times when you’re visually

all times when you’re visually

all times when you’re visually interacting with the computer games we

interacting with the computer games we

interacting with the computer games we piloted in two different populations

piloted in two different populations

piloted in two different populations children with cerebral palsy and also

children with cerebral palsy and also

children with cerebral palsy and also adults post-stroke as well with positive

adults post-stroke as well with positive

adults post-stroke as well with positive results coming back from both trials

results coming back from both trials

results coming back from both trials children loved using the system in fact

children loved using the system in fact

children loved using the system in fact it was very hard to extract it from most

it was very hard to extract it from most

it was very hard to extract it from most houses trust me very hard and I don’t

houses trust me very hard and I don’t

houses trust me very hard and I don’t see the benefit of using it and engaging

see the benefit of using it and engaging

see the benefit of using it and engaging with it now rather than just talk about

with it now rather than just talk about

with it now rather than just talk about what we saw from a trial we actually had

what we saw from a trial we actually had

what we saw from a trial we actually had some very interesting ripple effects as

some very interesting ripple effects as

some very interesting ripple effects as well so parents commented that when the

well so parents commented that when the

well so parents commented that when the gaming system was in the home it

gaming system was in the home it

gaming system was in the home it actually created a socially binding

actually created a socially binding

actually created a socially binding situation between siblings so the child

situation between siblings so the child

situation between siblings so the child with cerebral palsy and the able-bodied

with cerebral palsy and the able-bodied

with cerebral palsy and the able-bodied child were actually playing for the

child were actually playing for the

child were actually playing for the first time potentially on a level

first time potentially on a level

first time potentially on a level playing field so the child was safe he

playing field so the child was safe he

playing field so the child was safe he didn’t have to worry about poor hem

didn’t have to worry about poor hem

didn’t have to worry about poor hem function because I could compete and of

function because I could compete and of

function because I could compete and of course kids are very competitive

course kids are very competitive

course kids are very competitive so I love that one father told me when I

so I love that one father told me when I

so I love that one father told me when I picked up the system that when new

picked up the system that when new

picked up the system that when new visitors would come to the home his son

visitors would come to the home his son

visitors would come to the home his son for the first time would actually start

for the first time would actually start

for the first time would actually start talking about disability and his

talking about disability and his

talking about disability and his cerebral palsy and say look here’s the

cerebral palsy and say look here’s the

cerebral palsy and say look here’s the gaming system this is how I use it

gaming system this is how I use it

gaming system this is how I use it another mother said to me that her son

another mother said to me that her son

another mother said to me that her son showed considerable hearing control

showed considerable hearing control

showed considerable hearing control after using the controller because he

after using the controller because he

after using the controller because he was using it so much but my favorite

was using it so much but my favorite

was using it so much but my favorite comment and the comment that I’m going

comment and the comment that I’m going

comment and the comment that I’m going to remember for many many years I had

to remember for many many years I had

to remember for many many years I had one mother greet me at the door when I

one mother greet me at the door when I

one mother greet me at the door when I picked up the game in the system and she

picked up the game in the system and she

picked up the game in the system and she told me that her son who was nonverbal

told me that her son who was nonverbal

told me that her son who was nonverbal talked more during the trial then he

talked more during the trial then he

talked more during the trial then he talked more during the trial because he

talked more during the trial because he

talked more during the trial because he was helping his older sister get past

was helping his older sister get past

was helping his older sister get past certain levels of the game but she

certain levels of the game but she

certain levels of the game but she couldn’t get

couldn’t get

couldn’t get past but that he could so he was telling

past but that he could so he was telling

past but that he could so he was telling her game strategy his tips and tricks

her game strategy his tips and tricks

her game strategy his tips and tricks and what he was doing he talked more so

and what he was doing he talked more so

and what he was doing he talked more so I’m extremely positive about the future

I’m extremely positive about the future

I’m extremely positive about the future the future where technology and design

the future where technology and design

the future where technology and design the desire that is user centered

the desire that is user centered

the desire that is user centered consultative and accessible where

consultative and accessible where

consultative and accessible where actually help people and improve their

actually help people and improve their

actually help people and improve their quality of life moving into the future

quality of life moving into the future

quality of life moving into the future and if we leave thinking about game

and if we leave thinking about game

and if we leave thinking about game changes well seriously I think we should

changes well seriously I think we should

changes well seriously I think we should consider serious games we might think

consider serious games we might think

consider serious games we might think that sometimes the activities we do on

that sometimes the activities we do on

that sometimes the activities we do on one side potentially boring and they

one side potentially boring and they

one side potentially boring and they have repetitious actions but if we can

have repetitious actions but if we can

have repetitious actions but if we can underpin them with clinical and

underpin them with clinical and

underpin them with clinical and therapeutic knowledge we suddenly get

therapeutic knowledge we suddenly get

therapeutic knowledge we suddenly get buy-in we get engagement we get fun and

buy-in we get engagement we get fun and

buy-in we get engagement we get fun and we get activity and we know these are

we get activity and we know these are

we get activity and we know these are key ingredients for meaningful and

key ingredients for meaningful and

key ingredients for meaningful and successful rehabilitation thank you

successful rehabilitation thank you

successful rehabilitation thank you [Music]

[Music]

[Music] [Applause]