
one of the things which is going to have
a huge impact on our future is
artificial intelligence AI bringing
another Industrial Revolution previous
industrial revolutions expended humans
mechanical power this new revolution
this second Machine Age is going to
expand our cognitive abilities our
mental power computers are not just
going to replace manual labor but also
mental labor so where do we stand today
you may have heard about what happened
last March when a machine learning
system called alphago used deep learning
to beat the world champion at the game
of Go Go is an ancient Chinese game
which had been much more difficult for
computers to master than the game of
chess how did we succeed now after
decades of AI research alphago was
trained to play go first by watching
over and over tens of millions of moves
made by very strong human players then
by playing against itself millions of
games machine learning allows computers
to learn from examples to learn from
data machine learning has turned out to
be a key to cram knowledge into
computers and this is important
because knowledge is what enables
intelligence putting knowledge into
computers had been a challenge for
previous approaches to AI why there are
many things which we know intuitively so
we cannot communicate them verbally we
do not have conscious access to that
intuitive knowledge how can we program
computers with that knowledge what’s the
solution the solution is for machines to
learn that knowledge by themselves just
as we do this is important because
knowledge is what enables intelligence
my mission has been to contribute to
discover and understand principles of
intelligence through learning whether
animal or human or machine learning I
and others believe that there are a few
key principles just like the laws of
physics simple principles which could
explain our own intelligence and help us
build intelligent machines for example
think about the laws of aerodynamics
which are general enough to explain the
flight of both birds and planes wouldn’t
it be amazing to discover such simple
but powerful principles that would
explain intelligence itself well we’ve
made some progress my collaborators and
I have contributed in recent years in a
revolution in AI with our research on
neural networks and deep learning an
approach to machine learning which is
inspired by the brain
it started with speech recognition
on your phones with neural networks
since 2012 shortly after came a
breakthrough in computer vision
computers can now do a pretty good job
of recognizing the content of images in
fact approaching human performance on
some benchmarks over the last five years
a computer can now get an intuitive
understanding of the visual appearance
of a go board that is comparable to that
of the best human players more recently
following some discoveries made in my
lab deep learning has been used to
translate from one language to another
and you know start seeing this in Google
Translate this is expanding the
computer’s ability to understand and
generate natural language but don’t be
fooled we are still very very far from a
machine that would be as able as humans
to learn to master many aspects of our
world so let’s take an example even a
two-year-old child is able to learn
things in a way that computers are not
able to do right now a two-year-old
child actually masters intuitive physics
she knows when she drops a ball that it
is going to fall down when she spilled
some liquids she expects the resulting
mess her parents do not need to teach
her about Newton’s laws or differential
equations she discovers all these things
by herself in an unsupervised way own
supervised learning actually remains one
of the key challenges for AI and it may
take several more decades of fundamental
research to crack that not unsupervised
learning is actually trying
to discover representations of the data
let me show you an example consider a
page on the screen that you’re seeing
with your eyes or that the computer is
seeing as an image a bunch of pixels in
order to answer a question about the
content of the image you need to
understand its high-level meaning and
this high level meaning corresponds to
the highest level of representation in
your brain lower down you have the
individual meaning of words and even
lower down you have characters which
make up the words and those characters
could be rendered in different ways with
different strokes that make up the
characters and those strokes are made up
of edges and those edges are made up of
pixels so these are different levels of
representation but the pixels are not
sufficient by themselves to make sense
of the image to answer a high-level
question about the content of the page
your brain actually has these different
levels of representation starting with
neurons in the first visual area of
cortex v1 which recognize edges and then
neurons in the second visual area of
cortex v2 which recognize strokes and
small shapes higher up you have neurons
which detect parts of objects and then
objects and full scenes mule networks
when they are trained with images can
actually discover these types of levels
of representation that match pretty well
what we observe in the brain both
biological neural networks which are
what you have in your brain and the deep
neural networks that we train on our
machines can learn to transform from one
level of representation to the next with
the higher levels corresponding to
more abstract notions for example the
abstract notion of the character a can
be rendered in many different ways at
the lowest levels as many different
configurations of pixels depending on
your the position rotation font and so
on so how do we learn these high levels
of representations one thing that has
been very successful up to now in the
applications of deep learning is what we
call supervised learning with supervised
learning the computer needs to be taken
by the hand and humans have to tell the
computer the answer to many questions
for example on millions and millions of
images humans have to tell the Machine
well for this image it is a cat for this
image it is a dog for this image it is a
laptop for this image is the keyboard
and so on and so on millions of times
this is very painful and we use
crowdsourcing to manage to do that
although this is very powerful and we
are already able to solve very
interesting problems humans are much
stronger and they can learn over many
more different aspects of the world in a
much more autonomous way just as we’ve
seen with the two-year-old child
learning about intuitive physics
unsupervised learning could also help us
deal with self-driving cars let me
explain what I mean
unsupervised learning allows computers
to project themselves into the future to
generate plausible futures conditioned
on the current situation and that allows
computers to reason and to plan ahead
even for circumstances that they have
not been trained on this is important
because if we use supervised learning we
would have to tell the computers about
all the circumstances where the car
could be and that you know how human
would react in that situation how did I
learn to avoid dangerous
fighting behavior did I have to die a
thousand times in an accident well
that’s the way we’re trying machines
right now so it’s not going to fly or at
least not to drive so what we need is to
train our models to be able to generate
plausible images plausible futures be
creative and we’re making progress with
that so we are training these deep
neural networks to go from high-level
meaning to pixels rather than from
pixels to high-level of meaning so going
in the other direction through the
levels of representation in this way the
computer can generate images there are
new images different from what the
computer has seen while it was trained
but are plausible that looked like
natural images we can also use these
models to dream up strange sometimes
scary images just like our dreams and
nightmares here are some images that
were synthesized by the computer using
these deep genitive models they look
like natural images but if you look
closely you’ll see there are different
and they’re still missing some of the
important details that we would
recognize as natural about ten years ago
unsupervised learning has been a key to
the breakthrough that we obtained
discovering deep learning this was
happening in just a few labs including
mine at a time when neural networks were
not popular
they were almost abandoned by the
scientific community now things have
changed a lot it has become a very hot
field there are now hundreds of students
every year applying for graduate studies
at my lab with my collaborators Montreal
has become the largest academic
concentration of deep learning
researchers in the world
we just received a huge research grant
of 94 million dollars to push the
boundaries of AI and data science and
also to transfer technology of deep
learning and data science to industry
businesspeople stimulated by all this
are creating startups industrial labs
many of which near the universities for
example just a few weeks ago we
announced the launch of a startup
factory called element AI which is going
there is just not enough deep learning
experts so they’re getting paid crazy
salaries and many of my former academic
colleagues have accepted generous deals
from companies to work in industrial
labs I for myself have chosen to stay in
university to work for the public good
to work with students to remain
independent to guide the next generation
of deep learning experts one thing that
we’re doing beyond commercial value is
thinking about the social implications
of AI many of us are now starting to
turn our eyes towards social value added
applications like health we think that
we can use deep learning to improve
treatment with personalized medicine I
believe that in the future as we collect
more data from millions and billions of
people around the earth we’ll be able to
provide medical advice to billions of
people who don’t have access to it right
now and we can imagine many other
applications for social value of AI for
example something that will come out of
our research on natural language
understanding is providing all kinds of
services like legal services to
who can’t afford them we are now turning
our eyes also towards the social
implications of AI in my community but
it’s not just for experts to think about
this
I believe that beyond the math and the
jargon ordinary people can get a sense
of what goes on under the hood enough to
participate in the important decisions
that will take place in the next few
years and decades about AI so please set
aside your fees and give yourself some
space to learn about it my collaborators
and I have written several introductory
papers and a book entitled deep learning
to help students and engineers jump into
this exciting field there are also many
online resources software tutorials
videos and many undergraduate students
are learning a lot of this about
research and deep learning by themselves
to later join the ranks of labs like
mine ai is going to have a profound
impact on our society so it’s important
immense positives may come along with
negatives such as military use or rapid
disruptive changes in the job market to
make sure the collective choices that
will be made about AI the next few years
will be for the benefit of all every
citizen should take an active role in
defining how a I will shape our future thank