yo it’s my pleasure today to talk to you
about is interaction so just imagine you
could take them all by phone and control
it just by looking at it that’s what I
guess interaction means and what I’d
like to start with is why we want the
transects so there are more than 11
million people with disabilities in the
UK and many of them have agility
impairments so just imagine if you
wanted to try to touch a touch screen
you couldn’t really move your hand or
your head while shaking all the time
that’s how life is for these people and
you can imagine that it makes that makes
it really hard to control computers or
mobile phones or anything like that and
on top of that there are long more
repetitive strain injuries in the UK and
worldwide so basically people use
computers and mobile devices more and
more and just imagine you overdo it and
as soon as you try to use your computer
your hand really sucks too hard you
couldn’t really do it and let’s have a
look at the culprits for this growing
disease of repetitive strain injuries so
in the first place we’ve got keyboards
and mouse and most of us are probably
using that possibly even on a daily
basis but also our mobile phones there’s
something called mobile phone claw or
the mobile phone thumb release or some
really unpleasant and so if you text too
much that’s what can happen to all of us
unfortunately and even with touchscreen
displays when you think about tablets
even then you’re not safe from RSI
so then people get very often postural
because when we sit down with our tablet
very often crouched over and our neck
muscles are not quite relaxed and
there’s actually a wave of repetitive
strain injuries for touchscreen displays
also coming up so the message of the
slide basically is the way we interact
with our electronic devices is actually
not that natural if we overdo it it
hurts us so now there is I guess
striking what is I gained striking so
this is an eye gaze tracker it’s the
small note like white box underneath the
screen that you see there that’s a
typical I guess tracker and what basic
it is is an infrared webcam together
with some infrared illuminator so
basically just imagine there’s this
little webcam in this box looking at
your eyes and it’s your pupils are being
lightened up by these illuminators which
you don’t see and by looking at your
eyes and taking a really close look it
can calculate where on the screen you’re
looking at for examples with this little
red circle and unfortunately zach
technology is not perfect there are a
few problems a few challenges that are
really really hard to deal with so first
of all there is a limit in accuracy that
we can achieve with is tracking so let’s
say you’re looking at the Wikipedia page
and let’s say you want to use
I guess dragging just as you would like
to use the mouse or pointing our eyes
are great for pointing we’re doing that
all the time looking at faces and
objects but the problem is let’s say
you’re looking at one of those things
within that red circle so you know
Columbia r58 or legs in America you
couldn’t really tell with I guess
striking where exactly in this red
circle you’re actually looking at it’s
simply not possible
due to the way our eyes are structured
and also too due to limitations in the
technology so this is already good if
you can tell the person look in
somewhere into this saga and in addition
to that another limitation is how do we
click with your eyes pointing is some
are natural but how do we click and
taking that in mind so how would the 80
your user fun ideas try to look like
like this so cats they are really good
at staring as you can probably know if
you’ve got a cat that’s because they’re
hunters and they use to look at their
prey for a long time to watch their prey
so they could point really accurately
with their eyes and also they use
blinking and winking for communication
so if you’ve ever seen your cat blinking
or waiting at you
that is because you can’t likes you a
sign of happiness and perfection and
people have also tried to use blinking
and winking as a trigger for using ideas
striking to click but for humans
unfortunately that doesn’t work very
well because we don’t use blinking and
waiting so much as a natural way for
communication so it’s really tiring it
doesn’t work at all so what people have
come up with instead is magnification so
just imagine you’re looking at this
webpage and you want to click the link
or you have to do you have to look at
the link for a while and then it comes
up at your zooms in so that it curacy is
not a problem anymore it’s nice and
largely you can for example look at this
price oh look at Lana and then it
triggers a click for you just by staring
at it and another way is to use
so-called well-balanced so in this web
browser here you have a web page and
each link has a number and in order to
click that link you have to dial it
number with your eyes using that number
better so just imagine if you’re doing
10 you look at the one you look at this
Europe look at okay and then it clicks
link and you can imagine the zooming can
be very confusing and also this dial it
is quite a tedious process so that’s a
real challenge I guess to make it work
as an input device is not easy but there
are also great opportunities so try so
far again striking is becoming more and
more popular more ice I have more more
mainstream ins come down and price a lot
over the last yes and me and my
colleagues
leave that in about five years all your
mobile devices will be able to track
your eyes so your mobile phone your
computer any way with your webcam but
also on your SmartWatch when you
smartwatches is or D quite a lot of
research on how to control smartwatches
with I guess and currently the hot tech
topic is virtual reality and when you
look at this picture when you’re wearing
a watch reality headset you actually
don’t see anything around you and mod
mark is virtual reality headsets have I
guess tracking built-in so you can use
that to control your computer by you’re
wearing that headset and the next big
tech tech trend is predicted to the
augmented reality so you might be
familiar with this this is Google glass
so think of it as a pair of glasses
which has a screen that this they built
in and how do you interact with such a
computer built into your glasses
well many people think that is striking
is the way that will happen so there are
opportunities and the problem was how
did we make it fast and accurate and
over the past five years I’ve been
researching looking for a way how can we
make IDs ready as fast and accurate
Lester marks look about three years ago
we had this big breakthrough if we found
a way to make exactly that’s happened
and okay what we call activate and from
a user’s perspective
ekta gaze is really really simple so
just imagine you’re browsing Wikipedia
on your web browser and if you see a
Wikipedia page and you want to click a
link with right so this is how you do it
so some of the things we are magnified
this is just for illustration purposes
to make it clearer for you when you
actually use it you will just see the
normal web page no difference so let’s
see we want to click the link HD what
activates does when you look at Italy it
highlights Italy the length and all the
links around it with different colors so
here you see Italy is highlighted and
paid and all you need to do
– click it Aviv is move your days – one
of the buttons colorful buttons on the
right side namely the one with the same
color as the link so Italy is P so if I
want to click it I quickly move over my
days and I look at the pink button in
the side and that’s all I need to do and
that’s enough to bring my days tracking
close to the mouse with some more egg
rhythms working in the background now
why would we want to do that well first
of all just imagine you’re one of those
unfortunate people who can’t actually
really use any of these other input
device you know your pain or your hands
are shaking well that such a technology
could be life-changing for you because
it when it comes to clicking it would
bring you on par with a person who does
not suffer from such a disability so
that could be very very empowering but
there are many many other ways you could
use it as well so for example medical
applications when you think about an
operating room let’s say you’re a
sergeant and your hands get dirty during
the operation there’s so many high-tech
machines nowadays in operating room and
you couldn’t really press and run just
with your dirty hands why so you could
use them with IDs interaction and
similarly in research labs so when
you’re thinking for example about
chemical labs in the chemistry lab very
often people are working with corrosive
substances so you have to wear gloves
and again you’re working with these
extremely expensive machines and you
can’t really just touch the machines
after you handled your chemicals so what
we have to do in the chemistry that you
have to take off your gloves you have to
wash your hands then you can press that
button on that machine and then again
you put your glass plate on again if you
then remember oh I actually have to
press the other button and slap you have
to repeat the whole process all over
again so it can be extremely frustrating
and I get interaction
change that and then when you think in
general about the natural environments
environments that are dirty you know
where people wear gloves you know with
diving hands you don’t really want to
touch touch screens for example and when
people are wearing gloves they could
really use touch screen anyway right
it’s just not accurate enough you know
they don’t work very well and there are
also some education in public spaces so
this image is an image of our screens
public displays and you probably have
noticed that there are more and more
public displays around us and very often
these public displays are interactive so
they have touch screens for example in
train stations then these touch means it
allows to look up the Train time to time
table and also you know airports you can
check in with touch screens but when you
think about the touch screen in a public
space how many people have touched that
screen before you that’s actually not
very nice not very hygienic when you
think about it if you probably don’t
want to have a touch screen in a
hospital I just think about all the
germs and we have a few months ago we
have installed a gaze kiosk that is
based in information fields that you can
control with active gaze in the Museum
of transport and technology and opened
in over several months people have used
that us just using their gaze you can
actually use gaze interaction to control
expand the distance then we were also
approached by the car manufacturer who’s
interested in putting I guess striking
into cars so why would you want that
well just thing you’re driving on the
road you’ve got your eyes on the road
and you want to change channel and the
radio or maybe you want to turn on the
air-conditioning so usually if you do
that have to briefly look away from the
road you have to look at your dashboard
and see where’s the button that I need
to press press it and then quickly look
back but just
your head a display built into your
windscreen
so that’s possible these windscreen
displays and just imagine you could
control your car these miscellaneous
functions on your windscreen just using
your eye day so that you don’t have to
take your gaze far away from the road so
that’s exactly what we’re looking at and
finally there are also a lot of consumer
applications for gaze so for example
think about the kitchen let’s say you’re
working in the kitchen you’re trying to
bake a cake and you forgot the next step
in the recipe now your hands are dirty
you probably don’t want to touch your
new tablet with your dirty hands so what
do you do just imagine you could look up
that recipe browse the web using just
your eyes so that’s exactly what you
could do with ACTA gates unless you can
see the hardware is getting there all
your devices will be able to track your
eyes in a few years and there are many
applications you know it’s also quite a
unique feeling to control the computer
just guys it really feels different to a
mouse and that’s why we did if you know
similar to the last decade when Touch
came up with our iPhone you know Trust
was a novelty but now everybody it’s
just everybody all the devices and
similarly what happened to touch with
gay-straight and that’s what’s happening
now so when all your devices will be
able to track your gaze we believe and
then you know we’ve got all these
applications we believe people will
start more more using game striking so
or just touch today will be days
tomorrow and so now what now what are we
doing now so we would like to bring that
technology out to end-users
and in order to do that we created the
spin-out company acta gaze and we
started engaging with end users through
the Museum of transport and technology
in Auckland’s through organizations like
this and now we are also engaging with
designer
which is a charity at the wild United
Hospital and they are developing devices
for people with disabilities to happens
we’re trying to bring this out to people
with disabilities but we would like to
bring it to more people who would like
to bring it to you
so what we’re currently doing is
arranging public demonstrations of the
technology so if you are interested in
that you are invited to go to our
website and register for a demonstration
of the technology and now it’s quite an
interesting experience as I said it
really feels different to the mouse and
many of our test users they said that
after using I guess dragging the mouse
felt really heavy so with I guess
tracking they said you know it’s almost
effortless and with the mouse you’re
moving this bit of hardware around some
people say I gain strength it’s almost
like magic
you just don’t it just happens and on
that note thank you very much if you’re
interested please try out yourself thank you