Press "Enter" to skip to content

Technology for the Blind | Suman Kanuganti | TEDxUCSD


you
almost three years ago I met this
amazing individual his name is Matt
Brock he lives in Denver Colorado he is
a father of two daughters and a wife to
a husband a beautiful wife now he
literally changed my life at the age of
35 he became legally blind due to a
condition called retinitis pigmentosa
and which forced him to lose his career
as a weatherman a career that he really
loud now myself and Matt we are good
friends we talk a lot about technology
we always think about there has to be a
way to use technology for people to help
people with vision loss right there has
to be a way one thing we figured was if
we had to use technology to help people
he doesn’t need help from the technology
odd people to think for him what we need
to do is think like a set of eyes but
not like a brain he did not lose his
brain all he needs is visual access to
the information the things that he is
missing because his missing visual
perception No as long as he has that
information he makes those informed
decisions day in and day out so fast
forward fast forward one year I’m
standing with Matt although I am
thousand miles away sitting in San Diego
in front of computer he is in his
backyard
now I’m explaining him the green
landscape as seen from his patio I’m
seeing his pet I am seeing his green
landscape through a camera that is
mounted on his glasses now we started
walking outside I tell him about his
lining up on the sidewalk and I also
tell him about a Lexus car that is
parked in his driver which is
obstructing his path so we walk around
him and he walked two blocks while he
was walking two blocks pretty much I am
describing everything that is going on
in his surroundings
and in his environment think about it we
are thousand miles away we are talking
to each other and acting as an
individual and experiencing the world so
we figured the one challenge with the
blindness it is not about the vision
loss
the challenge is immediate access to the
information whenever and wherever they
needed just think about it right you
mean everybody everybody is consuming
data and information through visual
screens and with your computer every day
with your eyes and with other senses so
according to Adam Ghazali humans exhibit
this innate drive to forage for
information and there is you know as as
much as animals seek to forage for food
right so we need to somehow fulfill or
satisfy this hunger or feed this hunger
using modern technological advancement
to make this information accessible this
is simple but yet powerful fundamental
theory on the basis of founding IRA
it’s a startup company here in San Diego
actually literally two blocks away from
here and I’m excited to be here because
I’m from UCSD as well and I’m going to
talk about two things today which are
really really important for me and for
our company one visual perception and
then two auditory perception so let’s
start with a simple example I’m sure a
lot of people may have heard this right
do not talk and drive okay now here is a
question how many people still do that
anyway come on it’s ok right ok how
would this do not drive in text it’s
dangerous right driving and talking on
phone and driving texting on the phone
is dangerous how many people still do
they said you were come on he is
laughing that means you gotta raise your
hand so what if I say they both are not
as dangerous as we think according to a
study from Journal of Neuroscience in
2004
it does reinforce the fact that driving
and talking on the phone is extremely
dangerous now however a recent study
from University of Utah says that there
is little to no danger driving and
talking on the phone as much as texting
and driving so what’s happening in here
right most of us may have known what a
visual cortexes right so visual cortex
is part that part of your brain that
processes your visual information right
so in case of driving I talking on the
phone you are using two sensory inputs
one again visual perception to audio
perception right auditory perception
consider these two sensory inputs as a
individual channel which has a finite
amounts of bandwidth when you are
balancing this load across these two
channels you have less internal
distraction or you have less time to
task screeching you know but whereas if
you think about driving and texting on
the phone which is entirely different
story you are using one sensory input in
this case visual input right so you are
overloading that visual input and
basically you have this internal
distraction you know that causes most of
the issues so the interesting part is
about our brain has this built-in
ability to process two different streams
of external information with two
different sensory inputs and
historically our brain has this ability
to rewire information are it’s also
called the master of adaptation I’ll
give you an example you know if I hold
up if I if I stand here and I will tell
you that I’m holding up a remote in my
left hand you will have a mental picture
but however I lift this thing and place
in front of you
you will have the same mental picture so
you get the idea
and the idea of adapting is not near I
will give you an example for this one –
in 1930s the general perception was as a
human you won’t be able to keep up with
reaction the attention and focus that is
required to drive a car at a speeds
greater than 35 miles an hour now it’s
obviously not true right because we
super humans today we drive our cars not
only at the superior speeds but we are
having a conversation with our
girlfriend at the phone are we are we
are fighting with some somebody else
sitting next to us are even listening to
that continuous stream of voice that is
coming from your GPS iPhone so you know
the sound perception is really important
and that’s what we are going to double
click on little with how many people
think that they know all the features on
your iPhone I know everything I’m sure a
lot of people think about it as well how
many do you guys know a feature called
voiceover
on your iPhone anybody okay that’s good
there are few hands let’s write so
voiceover is particularly designed for
humans to be interacting with your phone
without having to use the visual screens
now you can immediately think oh yeah
that’s obvious that is designed for
blind and visually impaired people to be
interacting with the phone that’s
exactly true however think about Siri
and think about Alexa we are already
introducing voice commands we are asking
questions and you are getting feedback
through auditory perception right you
are not looking at the information in
this case now let us go a step further
what if I tell you if you can use your
auditory perception to interact with the
physical world right so we are
interacting with the physical world most
of the time we are using our visuals but
if we if every
single piece of visual information is
given to you in the auditory fashion do
you think we can actually create an
alternate medium for interacting with
the physical and digital world digital
body is already happening we already
have Siri and Alexa well if you had to
ask me I’m obviously going to say yes
there is so much of visual screen
information that gets thrown at us today
so much that you know we are losing our
capability to you know interact with the
physical space this is one of my
favorite videos and this will get the
point across because if you lost me till
now it is this video will get the point
across in today’s modern world you can
watch what you’re doing or you can watch
where you’re going but you can’t do both
and now you don’t have to thanks to
guiding hands at guiding hands we
understand how important it is to stay
connected when you’re on the go simply
request a guiding hand and within two
seconds we’ll be at your side ready to
guide you to your destination let us
navigate your world so you can navigate
the web your guiding hand will compare
all the pesky distractions that once
forced you to look up I crack up every
time I see this video I’m doing all
these practices for the past like they
are too it is funny this is from Conan
O’Brien by the way you can YouTube it
and you can look at it now what is the
point in here the point in here is you
know it is a matter of time for us human
beings especially people who are young
where our visual information will be
overloaded and we need something else we
need to have a second-rate sense for us
to seek this information which is
already happening today and that’s
exactly the concept that we double down
on it I run the whole premises is we are
creating a platform to convert any
visual cues that exist today in the
physical world or digital world into
auditory cues
we are creating an alternate rich
interaction platform for people to be
interacting with their world now think
about where this will be useful right
for blind and visually impaired people
that’s what IRA is all about we are
augmenting their physical world we are
augment if you think about augmented
reality immediately a lot of folks in
here who are out there thinking about
heads-up displays and smart glasses may
think that it’s about augmenting your
real world with information projector in
front of you but in front of your eyes
not necessarily because if you look at
it if you have a closer look at the
definition of augmented reality it’s
anything live direct or indirect
physical interaction with multiple
sensory inputs so it could be audio
video or GPS or even other senses so in
a way it is a computer mediated reality
you are augmenting or fulfilling some
other sensory information to interact
with your physical world and with
something that is computer-generated now
at IRA we do or leverage this concept by
connecting people who are blind and
visually impaired people to our agents
and the agents can be humans or missions
and these agents are humans or mesh
these machines located anywhere you know
in the world are providing that auditory
feedback for blind person to do
literally anything it’s not just about
reading or walking outside literally
anything so I will play one video that
will also give you a glimpse of how Ida
works and how it is actually impacting
people’s life as well as people I don’t
know for all blind people but for me
it’s scary you know if you don’t know
what you’re doing
good morning Angela Emily hello
well we’re currently headed towards the
koi ponds the path turned slightly to
your left here okay and there are two
girls sitting on the side of the koi
pond ahead of you on the right hand side
as you continue walking straight down
this hallway and there’s a man with his
guide dog walking towards you right now
oh yes Ian she explained to me you know
where I could understand you know things
like what she was doing and telling me
things and i’ma go and what was there
you know in front of me and who was
there though she was very helpful that’s
unique it was amazing got tears in my
yeah it was amazing
[Music]
sorry if you got a little bit emotional
but that’s one person and you can see
how the impact of her having that remote
guidance or that exact extra–
information was now let’s think big
picture in the world there are 1.2
billion
disabled people do you guys know that
the size of China right that’s huge
now we are focusing on 300 million
people who are blind and visually
impaired around the world and because of
baby boomers this number is going to be
increasing a lot now in addition to just
the numbers there is around more than 50
billion dollars of economic loss due to
vision loss just within the United
States and in one year so we got to
solve that besides that there seems to
be a lot of assistive technology that
exists in the industry today
there are a lot of apps that recognizes
text and a lot of apps that recognizes
color and so forth but there isn’t a
comprehensive platform that provides
average interaction for the blind person
or information for the blind person to
get up and go now one of the challenges
that I always ask people is if the
assistive technology that exists today
is so good why in the world there is 60%
of blind and visually impaired people
who are unemployed or underemployed and
that’s where IRA comes into the picture
because we already are solving it by you
know with one of our users grabbing on
to jobs so with IRA we will eliminate or
crash is the favorite word now to remove
any barriers or barriers that exist
between a blind person to live the life
they want on their terms
grab onto the jobs that they seek and
experience or enjoy the parks and
entertainment like all of us do and also
increase the efficiency in the process
of doing that our ultimate goal is to
prove that vision loss is not a
disability
one of our users Bob he says with IRA
our time becomes our own its
independence at the new level no I do
have myself a lot of my favorite stories
what our customers do and our users do I
will tell you or share with you a few of
them this is melody melody is a blind
mom and she calls in and connects to our
agent every night and reads bedtime
stories to her child our day our agent
is relating the comics or any other
books the melody and melody is relating
that information back to the child which
is awesome this particular user is very
interesting he is passionate about
learning guitar now the interesting
thing it turns out that we actually have
a guitarist Patrick he’s our agent now
he calls into our system over agent and
agent is teaching how to play guitar for
this person remotely and he is located
in Florida this one Greg Greg is a
recent death right and he would I mean
of course all these people are you know
legally blind at some point you know
Greg is a recent dad and he called into
an agent to install baby proofing logs
for his entire kitchen you know of
course he feels proud about that Stan
and the next one is also real near to my
near and dear to my heart which is
Sergio Sergio has a recent loss in his
family and he doesn’t want to rely or
bother anybody in his family to to
attend his father’s funeral so he calls
him and experiences his head tired
father’s funeral with our agent and
again he did not bother his family over
at all and he did not miss anything this
is good now you’re not switching back to
the employment topic Sheila she was at a
job fair somebody challenged him how
would you access some visual information
of handwriting she called in an agent
and she got a job literally on the spot
now finally
edek Mantha I have a degenerative eye
disease called retinitis pigmentosa I
was diagnosed at age five and have been
losing my vision steadily over many
years what I have remaining now I
described as if you were looking through
a drinking straw that was covered with
wax paper I’m excited to be running in
my eighth boston marathon however this
year will be a little bit different I’m
actually going to be testing out a new
technology that’s very exciting called
IRA you’re approaching a larger pack in
the middle here it is a glasses mounted
camera paired with a smartphone app by
activating the app it connects me with a
sighted human assistant that is located
somewhere else in the world got a runner
straight ahead and so there can be times
where people are either inching their
way in or aggressively cutting into my
path and with how much I see today I
don’t know it until they’re basically
right in front runners on your right
clear so one thing we’re looking forward
to trying out with Jessica is to have
her pick up on when that’s happening and
say okay you’ve got someone and so then
I can be like blind athlete here or
something to signal you’re coming up on
a water stop to push the limits of the
technology is in my mind running a
course like Boston where it’s such a
crowded race it’s such a vibrant race I
need so much energy I know it’s a term
that’s kind of heavily used these days
but it’s a game-changer I think
we are partners with AT&T so who thought
that that simple discussion our
technology fun when when I was having
discussion with Matt on his patio would
actually enable us to use augmented
reality or artificial intelligence and
bring the solution together and
ultimately get somebody like Eric
Mansell to the end of Boston Marathon so
that’s what we do that’s what we do we
use technology to enhance human
potential thank you
[Applause]
Please follow and like us: