Press "Enter" to skip to content

Improving Life for People with Disability | David Hobbs | TEDxFulbrightMelbourne


[Music]
[Music]
so this is probably my favorite photo
from one is to work a leading children’s
disability sensor in Adelaide but let me
give you the background to the photo so
you know why this image means so much to
me
so more than 15 years ago a colleague of
mine in Toronto Canada professor Tom
Chow letter team that developed an
amazing piece of software called the
virtual music instrument or VMI what the
VMI did was it was a software program
and when you plugged it into a webcam it
translated movements or gestures into
music so we had to do was move your arm
or pop your head and you can play music
you interacted with the colored shapes
that you can see on the screen but the
application was the inspiration so Tom’s
team developed this program to help
children with a disability who couldn’t
hold or play music to be musical they
became the instrument so this photo was
taken from the very first trial on the
software here in Australia when I
trialed it in Adelaide and to be honest
I didn’t really know what was going to
happen so I borrowed a laptop from a
colleague a data projector from another
colleague I got the cheapest possible
webcam that I could afford at the time
and clearly all the money I had went
into that very high tech mobile user
multi-purpose webcam stand you can see
in the photo as well what happened next
though was amazing so there was a young
girl in this particular session and she
couldn’t walk and she couldn’t talk but
she knew the music that she was hearing
was being played by someone Hills in
front of that webcam so she shuffled
herself all the way over to the middle
of the room right in front of the webcam
petitioned herself in front of the wall
she could see herself on the screen and
then it happened first one hand then the
other then her head then our whole body
she was bobbing up and down making more
music that I’d heard for the whole week
her face beamed she was all light as it
turned out I could actually see her
mother was on the side of the room and
so I went over to her and said look what
you tell me when you see your daughter
doing this we’ve never used this program
here before and she said David I’ve
never seen my daughter move before so
much ever technology as an enabler
technology as a tool for motivation so I
spent most of my life working with a
condition called cerebral palsy or CP
now this is a permanent condition which
has no cure and here in Australia on
average roughly every 15 hours a child
is born with cerebral palsy
Sarah palsy is when there’s an injury to
the developing brain and what this means
is there’s issues with coordination
control movement and posture sometimes
the census of vision hearing and touch
and also sometimes cognition or thinking
they have someone has cerebral palsy it
means that they need on they have to
participate in ongoing therapy but
therapy can be boring and therapy is
seen as work and nobody likes work so
the interests that I have and my PhD
focus at the moment is looking at how
children with cerebral palsy use their
heads now we know that children with
cerebral palsy use their heads
differently so children who do not have
cerebral palsy and we also know that
children with cerebral palsy have what
we call a dominant head and this is the
Hema used all the time for all
activities and a non-dominant or not so
well performing here this hand doesn’t
perform very well in fact it’s often
neglected so the key for most therapies
is actually to engage this hand here
because if I can engage this hand I can
improve how children use their hand and
improve their independence hands up here
who likes playing computer games I mean
I played them a lot when I was a child
and many many people play computer games
unfortunately computer games
particularly computer games are come off
the shelf and what we call inaccessible
to someone with cerebral palsy or
someone with a hand impairment the
buttons can be too close together and
this means it’s hard to press and the
software can be too fast the games can
be too complex what I wondered for my
PhD was could we use design and
technology and could we use computer
games to actually help children to
voluntarily want to use both of their
hands did you know that when computer
games use in a health context in a
health setting they called serious games
serious games a game somewhere there
there is not the pure entertainment
process so in a health context we use
them to help someone with a health issue
now in disability we talk a lot about
inaccessibility we say that something is
inaccessible if you can’t use it or
interact with it and unfortunately
systems are not accessible so what we
need to do was we need to design our own
computer gaming system to do this though
required assembling an expert team and
here are some of the key people involved
here on this slide but when you looked
at the whole team we number more than a
dozen different professional disciplines
working from three different
institutions and what did we do we
designed something called the orbit
gaming system now the orbit gaming
system starting with the controller is
actually a controller which doesn’t
require a fine finger movement or
control to use you just put your hands
on it and rotate the controller around
like that so I’m taking away issues of
grip and fine finger movement the
controller vibrates or provides haptic
feedback when the user plays the
computer games and we know this is
important because we know ads to buy in
because it had to realism to play in the
games smart sensors built into the
controller always make sure that two
hands adding user control on the
controller the whole time and this is
really important if I try and play the
controller and play some of the games
that if one of my hands comes off the
system pauses and stops which is very
frustrating the only way to make a play
again is putting both my hands back on
the controller so I have to have both my
hands on there the software we coded the
software so that it uses a very special
technique so no two games are the same
they’re always randomized and unique and
this is important because we didn’t want
people to memorize games we wanted them
to adapt and change continually so the
visual focus from the gang came towards
them and they use by manual control with
the controller to actually adapt their
game gaming character with respect to
what they’re seeing on the screen this
is a young teenage boy with cerebral
palsy on Weld cerebral palsy day using
the orbit gaming system he’s playing one
of our favorite games the one the
children love the most called squirrel
but as you can see even when the game
gets quite fast and complex it’s just
simple and intuitive movements that he
uses with the joist
to control his gaming character so we’ve
had children as young as four use the
system it’s very intuitive and very easy
to use now at the end of the trial when
we looked at the data that we had we
discovered that we actually had a
statistically significant result so an
improvement for have that non-performing
here and the Hang which children tend to
neglect so we’re able to show that with
tasks on manual function and dexterity
we improved the ability for that hand
and we believe it’s because when you
have to have both hands on the
controller it means that hang which is
normally neglected is no longer neglect
it’s part of the process so at the end
of the day we developed a system which
has to has two hands on the control at
all times when you’re visually
interacting with the computer games we
piloted in two different populations
children with cerebral palsy and also
adults post-stroke as well with positive
results coming back from both trials
children loved using the system in fact
it was very hard to extract it from most
houses trust me very hard and I don’t
see the benefit of using it and engaging
with it now rather than just talk about
what we saw from a trial we actually had
some very interesting ripple effects as
well so parents commented that when the
gaming system was in the home it
actually created a socially binding
situation between siblings so the child
with cerebral palsy and the able-bodied
child were actually playing for the
first time potentially on a level
playing field so the child was safe he
didn’t have to worry about poor hem
function because I could compete and of
course kids are very competitive
so I love that one father told me when I
picked up the system that when new
visitors would come to the home his son
for the first time would actually start
talking about disability and his
cerebral palsy and say look here’s the
gaming system this is how I use it
another mother said to me that her son
showed considerable hearing control
after using the controller because he
was using it so much but my favorite
comment and the comment that I’m going
to remember for many many years I had
one mother greet me at the door when I
picked up the game in the system and she
told me that her son who was nonverbal
talked more during the trial then he
talked more during the trial because he
was helping his older sister get past
certain levels of the game but she
couldn’t get
past but that he could so he was telling
her game strategy his tips and tricks
and what he was doing he talked more so
I’m extremely positive about the future
the future where technology and design
the desire that is user centered
consultative and accessible where
actually help people and improve their
quality of life moving into the future
and if we leave thinking about game
changes well seriously I think we should
consider serious games we might think
that sometimes the activities we do on
one side potentially boring and they
have repetitious actions but if we can
underpin them with clinical and
therapeutic knowledge we suddenly get
buy-in we get engagement we get fun and
we get activity and we know these are
key ingredients for meaningful and
successful rehabilitation thank you
[Music]
[Applause]
Please follow and like us: