so I have some questions for you guys
today the last time you saw a doctor how
personal was that experience for me it
was a mammogram it’s about three weeks
ago for the gentleman the audience
there’s a lot of squishing and some cold
metal plates nothing remotely personal
about it it’s hard to imagine a less
personal experience honestly but the
images themselves are beautiful and part
of why it’s an impersonal experience is
the workflow so your primary doctor
orders an exam you go to a separate
Center or a technician who is lovely but
knows nothing about you or your history
or while you’re getting the exam
performs the exam a separate expert
looks at those beautiful images sends a
letter to your primary doctor so now
those beautiful images have been reduced
to a black and white letter and you get
maybe a one-word summary from your
doctor of your beautiful images so it’s
completely impersonal and maybe it
doesn’t necessarily need to be that way
the flipside of the same question for
the doctors in the audience is the last
time you took care of a patient how much
time did you spend touching computer
versus touching the actual patient I was
in the ICU last week and the way I see
rounds are depicted here we stand in
these little groups teams of
practitioners who are outside of the
room and a large part of why we’re
outside of the room is because the
electronic medical record so if we want
to do something as simple as look up a
chest x-ray there’s ten keystrokes –
pulling up a chest x-ray on any patient
if we have to enter in data we have to
do that in real time so it forces us out
of the room and away from the patient
now the EMR is definitely saving lives
it’s making medicine safer and it is
here to stay but it is almost making
medicine and practice’ both from the
physician point of view it is making us
farther and farther away from the
patient’s bedside and it brings us in
how about this when was your last truly
immersive learning environment maybe
it’s right now maybe it’s today for me
it was probably gross anatomy it’s
pretty interesting how education now
medical education is essentially
unchanged from what it was twenty-five
years ago and in many ways especially
when we’re talking about sort of basic
science 3d things like physics and
biochemistry so we have a large lecture
hall we have a PowerPoint presentation
we have big hour-long chunks of time
even online education which is a true
innovation has that same format of long
periods of passive learning
and perhaps most importantly is there a
better way to treat pain in a similar
way we’ve trained a generation of
patients that they should be pain-free
and the best way to be pain-free is to
take a pill as opposed to a more active
involvement in an alternative concept
about what pain is and other ways to
distract yourself from pain these are
the questions that drive us at the
Maryland blend of reality Center the
Maryland reality Center is collaboration
funded by the strategic Maryland
partnership between University of
Maryland’s School of Medicine in
Baltimore at Shock Trauma and between
the department of computer science in
College Park
dr. Varshney is the beauty in my brains
the two of us collaborate together to
create innovations in medicine to make
life better for our patients so you’re
probably asking right now what is
augmented reality what is virtual
reality if you ask computer scientists
they’ll tell you that augmented reality
is the positioning of digital data into
the real world
so most of you are probably familiar
pokemons go I hold up my camera I see
little pokemons right there next dr.
Darrell and then I get it I get a point
if I hit the Pokemon but of course the
pokemons not really there or if you’ve
been to any major tourist site they
often will have an iPad at the tourist
at the site I was just in New York City
you hold it up and it will say Eiffel
Tower well once a hotel in New York City
but anyway will tell you what you’re
looking at that’s augmented reality
virtual reality is a completely created
virtual world so everything you’re
looking at is digitally constructed
that’s how computer scientists think of
it I think that’s a very difficult way
to think of it it’s easier for me if I
think about what we’re wearing or how
we’re using it so augmented reality I
think of as a wearable computer with a
heads-up display so take a minute to
think about how much of your day your
day you spend sitting at a desk looking
at a computer or looking at your phone
and operating with your fingers if you
could actually wear your computer and
you had only the one screen all of those
screens that now ruin your life
or run your life they all go away no
more television screens no computer
monitors it has a potential to
fundamentally change everything about
how we interact with computers virtual
reality in this context this is the
oculus system is this truly immersive
experience of both sound and vision
where you turn around or in a completely
alternative universe
it’s very immersive if you sit here and
ponder these two images while you sort
of think about how it could change your
daily daily life
you probably are already thinking of the
the major problem with it whenever
somebody’s in it they’re pretty isolated
right and they look a little crazy so
this technology is really maybe in the
first or second generation of cell
phones if we remember way back to those
big heavy cell phones and nobody thought
about having one in your pocket all the
time
maybe maybe sort of some combination of
cell phone and Palm Pilot like nothing
it hasn’t merged yet and we’re still
maybe a generation or two of Hardware
away from this becoming part of our
daily practice but that doesn’t mean
that it can’t fundamentally change
medicine and this is how we’re back to
my ICU and this is a regular patient’s
room if you go into any patients room in
any ICU in the country there are many of
them over at the Medical Center there
are between 4 to 15 screens in that room
this patient has six screens and this is
a standard room not only are there six
different data display screens none of
them are talking to each other so if we
think back to Zack he’s our fellow who’s
in the middle there he’s doing some
ultrasound imaging that’s the kind of
imaging I love that screen number five
if he wants to compare that image this
same patient’s chest x-ray what he has
to do is put down his ultrasound probe
turn his back to the patient go to that
EMR which is screen number six he has to
do all those keystroke that we talked
about then he can pull up the chest
x-ray but he can’t pull the check sorry
chest x-ray and see the ultrasound image
at the same time there’s no way for him
to do that right now so physicians
physicians are constantly remembering
different imaging that they saw at
different places as opposed to being
able to put all those images together so
in addition to that problem think about
the cost of all those extra screens so
if you had one display screen that could
display any of any information you could
greatly reduce healthcare costs as well
so how do we go from dream to reality
this is our this is our first or second
set of experiments so we’ve developed a
way of projecting video images onto the
AR hololens glasses so this is dr.
Christian cane he’s one of our fellows
who is intubated simulated patient
that’s not an actual patient but the
dummy I’m in the way that fiber-optic
intubation works is that he has a metal
blade and at the bottom of that metal
blade is a little camera and that little
camera is displaying on that screen that
little thumbnail of a screen that was
there to his right is displaying what he
can see inside the patient’s throat and
so if he were going to intubate this
and away he would have to look away from
his hands look away from the patient and
look at that tiny postage stamp scream
and see the to pass into the patient’s
airway but now he can see all those
images right in his eye line right as
he’s intubating the patient so we’re in
our simulated patient in this case so
we’re in our first and second phase of
beta testing and once we think we’ve got
it optimized for procedure performance
we’ll bring in a bunch of physicians
just like dr. Kane and myself and see if
they’re actually better at doing
intubation with augmented reality this
is another example this is me doing my
favorite thing in the world which is
echo telling you looking at these images
is really beautiful I mean you can see
in the screen behind me that’s what I’m
seeing in my eye line so instead of
having to turn away and look at that
image that’s behind me I can look at the
patient I can see Eric I can see his
heart and I can see all of it together
at once one of the things we’ve
discovered is that people like seeing
their own images so that hololens
headset will die if you’re not wearing
it so when we started doing these demos
we were putting the hololens headset on
our honor of volunteers and they loved
seeing their images so it’s possible
that patients would really like to wear
the Augmented headset so they can see
all their images as our providers do so
here’s a question that perplexes me and
I spend a lot of time thinking about are
we talking about the next generation of
iPhone are we talking about the next
major innovation that now all of you in
five years have these glasses on now we
don’t have a PowerPoint screen behind me
at all is that what this is or is this
the next 8-track tape this is something
that’s gonna flash and burn I don’t
think anybody really knows for sure but
I have a couple of bold predictions now
I’ve been working on this for some time
now this is what I think I think that
augmented reality will definitely have a
role in procedures and really any field
that involves doing something so for
example firemen are starting to have
automated reality on their headsets so
they can see where the other firemen are
they can see what the oxygen levels are
on the other firemen fighter pilots are
starting to have their displays on their
screen so augmented reality will be part
of procedures I think for sure I do
think that virtual reality would part
multi-modality pain treatment and we’re
gonna start using it at Shock Trauma
within the next couple months I hope
that virtuality we the next big
evolution in education I think this sort
of 3d immersive education has the
potential to really change
and improve and make more fun and some
some hard science and beyond that I
think the technology needs to to evolve
to enhance human connection not pull us
farther apart thank you very much [Applause]
today the last time you saw a doctor how
personal was that experience for me it
was a mammogram it’s about three weeks
ago for the gentleman the audience
there’s a lot of squishing and some cold
metal plates nothing remotely personal
about it it’s hard to imagine a less
personal experience honestly but the
images themselves are beautiful and part
of why it’s an impersonal experience is
the workflow so your primary doctor
orders an exam you go to a separate
Center or a technician who is lovely but
knows nothing about you or your history
or while you’re getting the exam
performs the exam a separate expert
looks at those beautiful images sends a
letter to your primary doctor so now
those beautiful images have been reduced
to a black and white letter and you get
maybe a one-word summary from your
doctor of your beautiful images so it’s
completely impersonal and maybe it
doesn’t necessarily need to be that way
the flipside of the same question for
the doctors in the audience is the last
time you took care of a patient how much
time did you spend touching computer
versus touching the actual patient I was
in the ICU last week and the way I see
rounds are depicted here we stand in
these little groups teams of
practitioners who are outside of the
room and a large part of why we’re
outside of the room is because the
electronic medical record so if we want
to do something as simple as look up a
chest x-ray there’s ten keystrokes –
pulling up a chest x-ray on any patient
if we have to enter in data we have to
do that in real time so it forces us out
of the room and away from the patient
now the EMR is definitely saving lives
it’s making medicine safer and it is
here to stay but it is almost making
medicine and practice’ both from the
physician point of view it is making us
farther and farther away from the
patient’s bedside and it brings us in
how about this when was your last truly
immersive learning environment maybe
it’s right now maybe it’s today for me
it was probably gross anatomy it’s
pretty interesting how education now
medical education is essentially
unchanged from what it was twenty-five
years ago and in many ways especially
when we’re talking about sort of basic
science 3d things like physics and
biochemistry so we have a large lecture
hall we have a PowerPoint presentation
we have big hour-long chunks of time
even online education which is a true
innovation has that same format of long
periods of passive learning
and perhaps most importantly is there a
better way to treat pain in a similar
way we’ve trained a generation of
patients that they should be pain-free
and the best way to be pain-free is to
take a pill as opposed to a more active
involvement in an alternative concept
about what pain is and other ways to
distract yourself from pain these are
the questions that drive us at the
Maryland blend of reality Center the
Maryland reality Center is collaboration
funded by the strategic Maryland
partnership between University of
Maryland’s School of Medicine in
Baltimore at Shock Trauma and between
the department of computer science in
College Park
dr. Varshney is the beauty in my brains
the two of us collaborate together to
create innovations in medicine to make
life better for our patients so you’re
probably asking right now what is
augmented reality what is virtual
reality if you ask computer scientists
they’ll tell you that augmented reality
is the positioning of digital data into
the real world
so most of you are probably familiar
pokemons go I hold up my camera I see
little pokemons right there next dr.
Darrell and then I get it I get a point
if I hit the Pokemon but of course the
pokemons not really there or if you’ve
been to any major tourist site they
often will have an iPad at the tourist
at the site I was just in New York City
you hold it up and it will say Eiffel
Tower well once a hotel in New York City
but anyway will tell you what you’re
looking at that’s augmented reality
virtual reality is a completely created
virtual world so everything you’re
looking at is digitally constructed
that’s how computer scientists think of
it I think that’s a very difficult way
to think of it it’s easier for me if I
think about what we’re wearing or how
we’re using it so augmented reality I
think of as a wearable computer with a
heads-up display so take a minute to
think about how much of your day your
day you spend sitting at a desk looking
at a computer or looking at your phone
and operating with your fingers if you
could actually wear your computer and
you had only the one screen all of those
screens that now ruin your life
or run your life they all go away no
more television screens no computer
monitors it has a potential to
fundamentally change everything about
how we interact with computers virtual
reality in this context this is the
oculus system is this truly immersive
experience of both sound and vision
where you turn around or in a completely
alternative universe
it’s very immersive if you sit here and
ponder these two images while you sort
of think about how it could change your
daily daily life
you probably are already thinking of the
the major problem with it whenever
somebody’s in it they’re pretty isolated
right and they look a little crazy so
this technology is really maybe in the
first or second generation of cell
phones if we remember way back to those
big heavy cell phones and nobody thought
about having one in your pocket all the
time
maybe maybe sort of some combination of
cell phone and Palm Pilot like nothing
it hasn’t merged yet and we’re still
maybe a generation or two of Hardware
away from this becoming part of our
daily practice but that doesn’t mean
that it can’t fundamentally change
medicine and this is how we’re back to
my ICU and this is a regular patient’s
room if you go into any patients room in
any ICU in the country there are many of
them over at the Medical Center there
are between 4 to 15 screens in that room
this patient has six screens and this is
a standard room not only are there six
different data display screens none of
them are talking to each other so if we
think back to Zack he’s our fellow who’s
in the middle there he’s doing some
ultrasound imaging that’s the kind of
imaging I love that screen number five
if he wants to compare that image this
same patient’s chest x-ray what he has
to do is put down his ultrasound probe
turn his back to the patient go to that
EMR which is screen number six he has to
do all those keystroke that we talked
about then he can pull up the chest
x-ray but he can’t pull the check sorry
chest x-ray and see the ultrasound image
at the same time there’s no way for him
to do that right now so physicians
physicians are constantly remembering
different imaging that they saw at
different places as opposed to being
able to put all those images together so
in addition to that problem think about
the cost of all those extra screens so
if you had one display screen that could
display any of any information you could
greatly reduce healthcare costs as well
so how do we go from dream to reality
this is our this is our first or second
set of experiments so we’ve developed a
way of projecting video images onto the
AR hololens glasses so this is dr.
Christian cane he’s one of our fellows
who is intubated simulated patient
that’s not an actual patient but the
dummy I’m in the way that fiber-optic
intubation works is that he has a metal
blade and at the bottom of that metal
blade is a little camera and that little
camera is displaying on that screen that
little thumbnail of a screen that was
there to his right is displaying what he
can see inside the patient’s throat and
so if he were going to intubate this
and away he would have to look away from
his hands look away from the patient and
look at that tiny postage stamp scream
and see the to pass into the patient’s
airway but now he can see all those
images right in his eye line right as
he’s intubating the patient so we’re in
our simulated patient in this case so
we’re in our first and second phase of
beta testing and once we think we’ve got
it optimized for procedure performance
we’ll bring in a bunch of physicians
just like dr. Kane and myself and see if
they’re actually better at doing
intubation with augmented reality this
is another example this is me doing my
favorite thing in the world which is
echo telling you looking at these images
is really beautiful I mean you can see
in the screen behind me that’s what I’m
seeing in my eye line so instead of
having to turn away and look at that
image that’s behind me I can look at the
patient I can see Eric I can see his
heart and I can see all of it together
at once one of the things we’ve
discovered is that people like seeing
their own images so that hololens
headset will die if you’re not wearing
it so when we started doing these demos
we were putting the hololens headset on
our honor of volunteers and they loved
seeing their images so it’s possible
that patients would really like to wear
the Augmented headset so they can see
all their images as our providers do so
here’s a question that perplexes me and
I spend a lot of time thinking about are
we talking about the next generation of
iPhone are we talking about the next
major innovation that now all of you in
five years have these glasses on now we
don’t have a PowerPoint screen behind me
at all is that what this is or is this
the next 8-track tape this is something
that’s gonna flash and burn I don’t
think anybody really knows for sure but
I have a couple of bold predictions now
I’ve been working on this for some time
now this is what I think I think that
augmented reality will definitely have a
role in procedures and really any field
that involves doing something so for
example firemen are starting to have
automated reality on their headsets so
they can see where the other firemen are
they can see what the oxygen levels are
on the other firemen fighter pilots are
starting to have their displays on their
screen so augmented reality will be part
of procedures I think for sure I do
think that virtual reality would part
multi-modality pain treatment and we’re
gonna start using it at Shock Trauma
within the next couple months I hope
that virtuality we the next big
evolution in education I think this sort
of 3d immersive education has the
potential to really change
and improve and make more fun and some
some hard science and beyond that I
think the technology needs to to evolve
to enhance human connection not pull us
farther apart thank you very much [Applause]
Please follow and like us: