so I want to start my talk with question
so we especially you guys who are
attending or many of you attending
medical universities know that we humans
are equipped with five different senses
we have sense of smell taste touch
hearing and vision so if I will ask you
a hypothetical question somebody comes
to you and ask you give away four out of
your senses leaving you with just one
which one will it be which one is the
one which you consider the most
important let’s have a quick show of
hands let’s say who will decide to stay
with their sense of smell okay not okay
what about taste okay what about hearing
I think we have many professional
musicians or those who inspire to be
musicians okay touch okay some of you
what about vision all right
all right that’s what I wanted to hear
so most of us actually perceive sense of
vision as the most important sense with
which we interact with the world and we
are probably right because over
two-thirds of our sensory cells are
actually located in our eyes and ability
to see color is one of the most
important part of that vision we
obviously use it to see shapes and
distances but our ability to sense color
is very important so as shown on the
slides many of you know that those cones
is not something from the ice-cream
store we’re going to talk about cones
and rods which are located on the back
of your retina so how we see light so
when light is reflected from an object
like this carpet for example the red
part of the light gets back to your eye
get focus on your head
and on the very back of your retina you
have a layer of different cells which
are actually sensing this light so the
road cells are sensitive to low level of
lights but they cannot distinguish color
and you have three type of cells which
have photoreceptors which are more
sensitive to either red green or blue
color so these cone cells are connected
through the bipolar cells or like a
messenger cells to the ganglion cells
which then lead directly to your brain
so in fact your eye is actually
extension of your brain and I’m pretty
happy with my color vision and probably
most of you but I think what we don’t
realize is there several limitation to
our color vision so let’s just go
through those so there are four main
limitation a as I mentioned we have only
three types of cones and many animals
have more than three the champion among
them is this creature called mantis
shrimp it has not three not five not
eight by twelve different photoreceptor
cells and so for a long time you know
physiologist or people who love science
they were salivating over this thinking
oh my gosh if we can see so many colors
how many colors this mentorship can see
but what you know there’s this kind of
depiction of what you’re out see
compared to the different receptors
which this mantis shrimp have inside
their eyes but what was discovered
several years ago by Australian team is
actually when they did experiments and
they put to test those extraordinary
eyes of the main strip which till now
was considered to be the most advanced
eye
Evolutionary developed and compare it to
the human ability to distinguish color
they discovered that actually humans can
see
or distinguished about ten times more
shades of color than the shrimp so
actually I think it’s not the shrimp
which is extraordinary searches were
able to train shrimp to recognize
certain colors because it’s been thirty
years and I cannot even teach my husband
to recognize certain shades but what is
the reason behind this interesting
phenomena is because in shrimp we have
this multiple photoreceptors but they
are connected to a very small brain in
our case we have only three but they’re
connected for very large processing
machine essentially and it’s been known
that about fifty percent of our brain is
actually involved in analyzing visual
information so having this ability to
distinguish color and it’s been actually
reported that humans can distinguish up
to ten million different set of colors
three times population of Armenia pretty
amazing right so this allows us to enjoy
beautiful scenes of nature beautiful
flowers and our beloved mountain Ararat
which I think most of you agree every
hour at the day you look at it and it
seemed to be different color like on
this picture for example you can have a
different color at night or during the
sunset do you guys agree that this
mountain has a different shade of color
in this picture inclusion how many of
you agree that has a different same
color or a different color different
color same color okay why I’m going to
remove background and you will see that
it actually exactly the same color this
is what is called optical illusion and
this is actually a result of the fact
that whatever you perceive is a color
it’s not just what coming from your
pigments is actually how your brain
analyzes this information so brain put
is all this additional information about
the background contest and other
information it gets from different
sources to interpret that color and so
each of us seek
very differently because we have a
different composition of our rodent
coats because we have a different
genetic bit makeup of those
photoreceptor because we have different
brains so next time you’re going to
argue with your friend about color of
their favorite sweater being at brownish
you know greenish he’s not doing it
because you know he is insisting on his
obviously wrong choice right
he is just seeing it that way because
his brain is different so this brings us
to the second limitation our vision is
very subjective so we cannot really have
a universal even opinion about certain
color so you know but it is important to
actually put something some name or some
number on the color for example in
cosmetic industry right let’s say you
know you go to the store in our there’s
all this different shade of pink and you
know cosmetic industry can come up with
all this sexy interesting name hot pants
revenge but can you imagine that you
have a patient coming to your office and
they showing this skin rash on their
color and you’re saying to them well I
think it went from hot pants to revenge
color I mean the reaction will be very
interesting to say the least so that’s
the ability to subjectively evaluate
color it’s definitely something we can
improve on the third limitation at the
actual limited spectral range so we
human obviously called a trench visible
because what is what our eyes can see is
the light between 400 and 700 nanometers
so the light which will have a longer
wavelength is called infrared and the
light which will have shorter wavelength
is called ultraviolet so different
animals birds insects reptile they
actually can see in those other ranges
something which we cannot see so when an
insect look at the flower to which which
to your eye look being yellow it’s
actually scissors all this different
color allowing them to determine where
they can find the most nectar so lastly
the last limitation is there our color
vision requires a lot of light so I can
really see the color of your jackets
people on the back of this audience
because in a low light condition it’s
only our rod cells which are react to
the light your cones need to have a
higher amount of light in order to
recognize the color in addition to not
being able to seek power when it’s kind
of dark it also limits our ability to
see what is called out of fluorescence
and out of fluorescence is very
important property of difference
substances especially biological ones so
what is fluorescence well when I look at
this carpet basically I have this white
light shining on and then whatever is
reflected which is mostly red light gets
to my eye that is reflected light if I’m
going to eliminate an object with a blue
light and I will not have anything else
and that object will emit something of a
different wavelength that’s called
fluorescence the problem with the
fluorescent and has much much lower
intensity so our eyes really cannot see
the fluorescence and it’s not something
we even aware in our everyday life
so I’m here to tell you that there is a
technology coming soon to your life
which will be basically helping us to
avoid all these limitations of human
vision and this technology is called
hyper spectral imaging and what it does
it combines the benefits of the mantis
shrimp eye where you have multiple
photoreceptor detecting light at
different wavelengths and this huge
processing power of human brain which
then analyzes the spectrum so it is
basically composed of those special
timers Co hyperspectral cameras and then
signal from those cameras go to the
computer to be analyzed so it looks like
this you have an object and the camera
will collect the images from this object
but by putting different
filters in front of it very very quickly
by different ways so as a result you
have this type of images and each pixel
in this image you’re going to have an
entire spectrum meaning for example like
in this case the pixel which you see as
red will have mostly intensity a high
intensity in the red range and then
pixel which is blue is going to be
having higher in text in the blue range
but you don’t have just a single dots
you have entire spectra so this picture
then go to the computer which source
this vector and decide this look similar
or this look difference in this factor I
have a 30% of that sub substance and 40%
of this substance and then remaining
percentage of the third sub so you have
a capacity for basically unraveling or
detecting different substances within
the visual object by using this
technology so hyperspectral imaging as I
said addresses all this limitation and
it’s actually was originally designed
for astronomy then it become very
popular in different military
application it was put on surveillance
plane to a detect where the movement of
troops occur because you can distinguish
different soldiers from different armies
based on their uniforms now it’s slowly
making its move into different field of
science there is something which called
precision agriculture where you can put
hyperspectral camera on the plane fly
over the field and it will tell you
where exactly you need to add a little
bit more water or where you need to add
fertilizer because the shape of that
crop is now different from the rest of
the field but in my lab at George
Washington University we interested in
application of hyperspectral technology
to cardiovascular targets specifically I
want to show you how the endocardial
surface of the atria which is this upper
chamber of your heart looks so it looks
very wide because it has the six layer
of collagen and there
for when you’re trying to put the
lesions to eliminate sources of a
rhythmic activity you really cannot see
it when you apply HSI and tell it okay
find the spectra typical for the lesions
that’s what you were able to see or if
you have a surface of the heart on which
you have a scar tissue and you have a
tissue which was just recently damaged
both of this type of tissue will look
whitish to your eye here but if you
apply HSI you clearly can distinguish
scar from acutely damaged tissue
another application many of us know that
people are suffered from the atrocity
roses or the position of the plaque in
the coronary arteries this is how
coronary plaque when you open the artery
and look at it under the regular light
will look to your eye and this is how it
will look under hyperspectral so you can
immediately tell the composition of the
plaque what’s likelihood of its rupture
how big it is and it gives you a lot of
very useful diagnostic information the
last three slides were all example of in
vivo samples me there were no additional
diagnostic just shining blue light and
analyzing out of your essence using HSI
approach this is example of the
histology which is also extremely
promising field for hyperspectral
imaging to be applied you can see here
this is a section of the animal heart
and part of it is damaged because of the
high energy and by I you really don’t
see any difference in power we apply HSI
you can clearly see that this area was
much damage than the other side so we
now moving from this field which is
having big camera
and you know desktop computers to
something which is going to be future of
Medicine now they are Ham held
hyperspectral images where you can just
put it against your skin and then you
collect the spectra and you send it to
the cloud where that spectra are then
compared with something which was
collected for many many patients and if
spectra in that skin sample matches with
but who had melanoma in the past you can
get immediate diagnosis or you can have
a advise to go to the dermatologist and
see because it’s something suspicious
so with this cameras getting smaller and
smaller and less and less expensive
obviously one can envision you know
something like this you’re going to have
a phone you can check whether you know
the currency is fake or real one you can
try to use it in the kitchen to create
perfect dolma you can remove all the
insecurities from your rice mixture you
can use it in construction it can help
you to detect what part of the wood is
actually damaged by the moisture or if
you make it a barbecue let’s say you
decided to say well is it well done or
have them then you can apply
hyperspectral imaging and actually see
what is there
this technology is coming to your door
or more exactly to your mobile devices
faster than you think
so ask yourself what would you like to
see beyond your biological vision thank
you
[Applause]
so we especially you guys who are
attending or many of you attending
medical universities know that we humans
are equipped with five different senses
we have sense of smell taste touch
hearing and vision so if I will ask you
a hypothetical question somebody comes
to you and ask you give away four out of
your senses leaving you with just one
which one will it be which one is the
one which you consider the most
important let’s have a quick show of
hands let’s say who will decide to stay
with their sense of smell okay not okay
what about taste okay what about hearing
I think we have many professional
musicians or those who inspire to be
musicians okay touch okay some of you
what about vision all right
all right that’s what I wanted to hear
so most of us actually perceive sense of
vision as the most important sense with
which we interact with the world and we
are probably right because over
two-thirds of our sensory cells are
actually located in our eyes and ability
to see color is one of the most
important part of that vision we
obviously use it to see shapes and
distances but our ability to sense color
is very important so as shown on the
slides many of you know that those cones
is not something from the ice-cream
store we’re going to talk about cones
and rods which are located on the back
of your retina so how we see light so
when light is reflected from an object
like this carpet for example the red
part of the light gets back to your eye
get focus on your head
and on the very back of your retina you
have a layer of different cells which
are actually sensing this light so the
road cells are sensitive to low level of
lights but they cannot distinguish color
and you have three type of cells which
have photoreceptors which are more
sensitive to either red green or blue
color so these cone cells are connected
through the bipolar cells or like a
messenger cells to the ganglion cells
which then lead directly to your brain
so in fact your eye is actually
extension of your brain and I’m pretty
happy with my color vision and probably
most of you but I think what we don’t
realize is there several limitation to
our color vision so let’s just go
through those so there are four main
limitation a as I mentioned we have only
three types of cones and many animals
have more than three the champion among
them is this creature called mantis
shrimp it has not three not five not
eight by twelve different photoreceptor
cells and so for a long time you know
physiologist or people who love science
they were salivating over this thinking
oh my gosh if we can see so many colors
how many colors this mentorship can see
but what you know there’s this kind of
depiction of what you’re out see
compared to the different receptors
which this mantis shrimp have inside
their eyes but what was discovered
several years ago by Australian team is
actually when they did experiments and
they put to test those extraordinary
eyes of the main strip which till now
was considered to be the most advanced
eye
Evolutionary developed and compare it to
the human ability to distinguish color
they discovered that actually humans can
see
or distinguished about ten times more
shades of color than the shrimp so
actually I think it’s not the shrimp
which is extraordinary searches were
able to train shrimp to recognize
certain colors because it’s been thirty
years and I cannot even teach my husband
to recognize certain shades but what is
the reason behind this interesting
phenomena is because in shrimp we have
this multiple photoreceptors but they
are connected to a very small brain in
our case we have only three but they’re
connected for very large processing
machine essentially and it’s been known
that about fifty percent of our brain is
actually involved in analyzing visual
information so having this ability to
distinguish color and it’s been actually
reported that humans can distinguish up
to ten million different set of colors
three times population of Armenia pretty
amazing right so this allows us to enjoy
beautiful scenes of nature beautiful
flowers and our beloved mountain Ararat
which I think most of you agree every
hour at the day you look at it and it
seemed to be different color like on
this picture for example you can have a
different color at night or during the
sunset do you guys agree that this
mountain has a different shade of color
in this picture inclusion how many of
you agree that has a different same
color or a different color different
color same color okay why I’m going to
remove background and you will see that
it actually exactly the same color this
is what is called optical illusion and
this is actually a result of the fact
that whatever you perceive is a color
it’s not just what coming from your
pigments is actually how your brain
analyzes this information so brain put
is all this additional information about
the background contest and other
information it gets from different
sources to interpret that color and so
each of us seek
very differently because we have a
different composition of our rodent
coats because we have a different
genetic bit makeup of those
photoreceptor because we have different
brains so next time you’re going to
argue with your friend about color of
their favorite sweater being at brownish
you know greenish he’s not doing it
because you know he is insisting on his
obviously wrong choice right
he is just seeing it that way because
his brain is different so this brings us
to the second limitation our vision is
very subjective so we cannot really have
a universal even opinion about certain
color so you know but it is important to
actually put something some name or some
number on the color for example in
cosmetic industry right let’s say you
know you go to the store in our there’s
all this different shade of pink and you
know cosmetic industry can come up with
all this sexy interesting name hot pants
revenge but can you imagine that you
have a patient coming to your office and
they showing this skin rash on their
color and you’re saying to them well I
think it went from hot pants to revenge
color I mean the reaction will be very
interesting to say the least so that’s
the ability to subjectively evaluate
color it’s definitely something we can
improve on the third limitation at the
actual limited spectral range so we
human obviously called a trench visible
because what is what our eyes can see is
the light between 400 and 700 nanometers
so the light which will have a longer
wavelength is called infrared and the
light which will have shorter wavelength
is called ultraviolet so different
animals birds insects reptile they
actually can see in those other ranges
something which we cannot see so when an
insect look at the flower to which which
to your eye look being yellow it’s
actually scissors all this different
color allowing them to determine where
they can find the most nectar so lastly
the last limitation is there our color
vision requires a lot of light so I can
really see the color of your jackets
people on the back of this audience
because in a low light condition it’s
only our rod cells which are react to
the light your cones need to have a
higher amount of light in order to
recognize the color in addition to not
being able to seek power when it’s kind
of dark it also limits our ability to
see what is called out of fluorescence
and out of fluorescence is very
important property of difference
substances especially biological ones so
what is fluorescence well when I look at
this carpet basically I have this white
light shining on and then whatever is
reflected which is mostly red light gets
to my eye that is reflected light if I’m
going to eliminate an object with a blue
light and I will not have anything else
and that object will emit something of a
different wavelength that’s called
fluorescence the problem with the
fluorescent and has much much lower
intensity so our eyes really cannot see
the fluorescence and it’s not something
we even aware in our everyday life
so I’m here to tell you that there is a
technology coming soon to your life
which will be basically helping us to
avoid all these limitations of human
vision and this technology is called
hyper spectral imaging and what it does
it combines the benefits of the mantis
shrimp eye where you have multiple
photoreceptor detecting light at
different wavelengths and this huge
processing power of human brain which
then analyzes the spectrum so it is
basically composed of those special
timers Co hyperspectral cameras and then
signal from those cameras go to the
computer to be analyzed so it looks like
this you have an object and the camera
will collect the images from this object
but by putting different
filters in front of it very very quickly
by different ways so as a result you
have this type of images and each pixel
in this image you’re going to have an
entire spectrum meaning for example like
in this case the pixel which you see as
red will have mostly intensity a high
intensity in the red range and then
pixel which is blue is going to be
having higher in text in the blue range
but you don’t have just a single dots
you have entire spectra so this picture
then go to the computer which source
this vector and decide this look similar
or this look difference in this factor I
have a 30% of that sub substance and 40%
of this substance and then remaining
percentage of the third sub so you have
a capacity for basically unraveling or
detecting different substances within
the visual object by using this
technology so hyperspectral imaging as I
said addresses all this limitation and
it’s actually was originally designed
for astronomy then it become very
popular in different military
application it was put on surveillance
plane to a detect where the movement of
troops occur because you can distinguish
different soldiers from different armies
based on their uniforms now it’s slowly
making its move into different field of
science there is something which called
precision agriculture where you can put
hyperspectral camera on the plane fly
over the field and it will tell you
where exactly you need to add a little
bit more water or where you need to add
fertilizer because the shape of that
crop is now different from the rest of
the field but in my lab at George
Washington University we interested in
application of hyperspectral technology
to cardiovascular targets specifically I
want to show you how the endocardial
surface of the atria which is this upper
chamber of your heart looks so it looks
very wide because it has the six layer
of collagen and there
for when you’re trying to put the
lesions to eliminate sources of a
rhythmic activity you really cannot see
it when you apply HSI and tell it okay
find the spectra typical for the lesions
that’s what you were able to see or if
you have a surface of the heart on which
you have a scar tissue and you have a
tissue which was just recently damaged
both of this type of tissue will look
whitish to your eye here but if you
apply HSI you clearly can distinguish
scar from acutely damaged tissue
another application many of us know that
people are suffered from the atrocity
roses or the position of the plaque in
the coronary arteries this is how
coronary plaque when you open the artery
and look at it under the regular light
will look to your eye and this is how it
will look under hyperspectral so you can
immediately tell the composition of the
plaque what’s likelihood of its rupture
how big it is and it gives you a lot of
very useful diagnostic information the
last three slides were all example of in
vivo samples me there were no additional
diagnostic just shining blue light and
analyzing out of your essence using HSI
approach this is example of the
histology which is also extremely
promising field for hyperspectral
imaging to be applied you can see here
this is a section of the animal heart
and part of it is damaged because of the
high energy and by I you really don’t
see any difference in power we apply HSI
you can clearly see that this area was
much damage than the other side so we
now moving from this field which is
having big camera
and you know desktop computers to
something which is going to be future of
Medicine now they are Ham held
hyperspectral images where you can just
put it against your skin and then you
collect the spectra and you send it to
the cloud where that spectra are then
compared with something which was
collected for many many patients and if
spectra in that skin sample matches with
but who had melanoma in the past you can
get immediate diagnosis or you can have
a advise to go to the dermatologist and
see because it’s something suspicious
so with this cameras getting smaller and
smaller and less and less expensive
obviously one can envision you know
something like this you’re going to have
a phone you can check whether you know
the currency is fake or real one you can
try to use it in the kitchen to create
perfect dolma you can remove all the
insecurities from your rice mixture you
can use it in construction it can help
you to detect what part of the wood is
actually damaged by the moisture or if
you make it a barbecue let’s say you
decided to say well is it well done or
have them then you can apply
hyperspectral imaging and actually see
what is there
this technology is coming to your door
or more exactly to your mobile devices
faster than you think
so ask yourself what would you like to
see beyond your biological vision thank
you
[Applause]
Please follow and like us: