Press "Enter" to skip to content

Interactive Gaming in an Augmented Reality | Mark Ladd | TEDxUofIChicago


so as we explore this notion of our
origins today and who we are as
individuals we know that much of what we
are and who we are was formed at a young
age and so one of the questions that I
wanted to explore was an easy one to ask
but not so easy to answer which is do
you recall the very first thing that you
imagined not not many people can and it
took took me a while to think about it
but it’s our imagination that allowed us
to ask what if what if I knew what my
parents knew what if I had superpowers
and it’s our imagination that got us
through difficult times and made us
realize a more sophisticated reality as
we grew and we used that imagination
when we were younger we’re role-playing
playing house playing tag and I realized
as I was digging into my own memories
and trying to remember what that first
memory was for me it was that of the
Dragon and the dragon represented this
majestic mythic creature right that it
was it was this intelligent cunning and
yet he was elegant and could take flight
and it became this reoccurring motif
that I realized later on that would
follow me you see I grew up on a farm in
the northwest suburbs and you don’t see
it here but it’s in pasture that used to
be there and and we had cows and and we
had woods in the back and I would be
sitting in front of the TV and my mom
would come in and she would end up
saying one of two things she’d either
say you need to move back or you’re
gonna go blind or she’d say you need to
get outside and get some fresh air and
what she didn’t realize was that she was
inspiring me to go find my imagination
because with my buddies we found some
plywood and we created this tree fort
outside and in that tree fort it became
our castle our lair it it was these
endless opportunities for us to explore
our imagination which at the same time
and here’s
a dragon reoccurring but I was how many
people know judges of dragons yeah so I
was one of those those kings and and it
was one of those things that in doing
that was a very social activity but it
engages everyone in their imagination
you see the dungeon master has to give
you a story in that story you pick up on
as a player and it’s the shared world
that you imagined together and so as as
we do that yeah it gives you the ability
to create until your own story and so I
think it’s probably one of those things
that led me to go become an English Lit
major at a medieval history minor and
Latin has four semesters because my
parents were big believers in liberal
arts as they said you can always go back
and get an MBA or dental degree but
you’ll never go back and study the
classics and so when I was younger one
of the things they did was give me his
girder and panel set simple harmless toy
but it turned me into like Richard
Dreyfuss in the Close Encounters of the
Third Kind where you have the mashed
potatoes and he was just making the
devil’s tower I was making replicas the
Sears Tower over and over about four
feet high because that was all I could
reach but it was it was this incredible
journey on exploring my imagination and
what I realized was that later on it
propelled me become an architect and it
it drove me to think about kind of what
what could be built and then when I got
into my tween years I get doubt again I
would sit there at the end of this news
program and I had a digital fly-through
of the city of Chicago and back in the
80s that was a coolest thing to me
because it was the digital world coming
to life and I thought about how what
that meant and ultimately when I went on
to become I would take CAD courses at a
community college while I was in high
school and then ultimately the firm that
I ended up working at not only design
is fly through but also designed the
Sears Tower so it’s weird how things
come around but at the same time in
exploring that digital and and the
physical intertwining I absorb movies
like Tron and wargames and couldn’t get
enough of of how that exploration
happened and I wanted to be a hacker so
much that for those of you are familiar
with the movie there’s a game in there
and call a global thermonuclear war and
I and I simulated that there we go and I
simulated it in my computer and I thank
goodness I didn’t have a modem because I
probably would have caused mischief but
it was this craving for this digital
connection to to the outside and about
that time where that digital and that
social engagement what was happening was
in the arcades and it was an interesting
period in time because people went there
to hang out with each other and enjoy
the entertainment but it was a plate it
was a nexus for entertainment and so one
of the things that happened was the
console got invented and it brought
gaming into our homes and it was a
blessing and a curse because now you
could play with your friends but it
changed the social structure of how we
engaged with each other right now you
have multiplayer online but yet you’re
not really directly engaging with those
people and so as I came home one day and
I was hearing my mom in the back of my
head because I saw my two tween kids I
have a son and a daughter
both amesh on their mobile devices and
it was a bright sunny day and I was
sitting there saying you need to get
outside and get some fresh air then I
realized there had to be a way to bring
the digital in and enhance what could
happen in the physical and so kind of
thinking back and forth how that
engagement happens you look at how we
all engage our smartphones right and
it’s no small feat to get somebody off
their phone and when we’re out and one
of the things that has become apparent a
recent study showed
that even though we have more
opportunities for social engagement
people actually feel more socially
isolated because of the constructs of
having to follow people their shared
information and so on but that direct
communication isn’t happening in the
first person which might be the reason
why it’s giving rise to live-action
role-playing now some of you may have
heard of LARPing
well it’s actually become very very
popular on college campuses it’s been
around for about 20 years or so games
like assassin humans vs. zombies you’re
using nerf guns and water pistols and so
on but you can get up to 400 people
playing in one of these games and it can
last for days on end and so kind of
thinking about the constructs of that
physical gaming and how that might
intertwine with the digital was what we
sought to explore in developing the
white shot platform and so we live in a
great error right now particularly as
entrepreneurs that you have access to
accessible coding you you can leverage
the cloud and we have a proliferation of
inexpensive sensors that are easy to
create and which is good for me because
I was able to go down and start
tinkering and so utilizing those sensors
and utilizing geolocation able to come
up with the ability to know what spell
you’re casting using accelerometers in
being able to tell where your teammates
are using GPS and sharing that
information via the cloud and so we
thought about the fact that we didn’t
want people stuck on there staring at
their phones because that would cramp
the the gaming experience and so we
began to think about that next wave of
Technology would as known as augmented
reality that they’d been projected that
that will be equivalent to the same as
the mobile revolution so a bit of a
primer on augmented reality in virtual
reality virtual reality is very merciful
it’s a
the model world with a headset that
allows you see 360 the augmented reality
glasses allow you to see through and
it’s a digital overlay of your current
physical environment and so we we are at
the beginning of augmented reality some
of you may recognize some of these
images of pokemon go and ingress which
is a google game both have AR components
to it and both geolocation games but
what we began to really think about was
how does that build on itself and how do
we bring in true augmented reality to
actual gaming and so as we did that we
thought about how do the storylines
evolve if you if you’re able to think
about consuming that information right
there in front of your eyes we’re where
most of our information wants to be
consumed from the ocular in the audio
level so you take as an architect this
is a I think we’d all very pretty bland
space but now you take the digital and
you do an overlay and now you can start
to envision a world that begins to
change and now you start to write the
story lines that can change how we tell
our own stories or how we gauge with
each other so that bland hallway in your
house become something of a cargo bay in
a spaceship or it becomes a pathway in a
jungle that you’re trying to find
treasure and at old temples and so we
began to think about that information
and and what we found what we were doing
our early iterations was contrary to
Iron Man where he has all of these
different levels of information in his
heads-up display or HUD we found that
people got overwhelmed when we put too
much information and so we had to go
through various iterations to to find
that right mix and so this is a video of
one of our games called assassin and
what you’re going to see in the HUD is
it identifies whether you’re the target
or the assassin and there’s
timer up in the right hand corner and
all of this information is being
generated through the sensors and the
hardware and being leveraged the
computing power of your smartphone but
it becomes seamless the magnetometer at
the bottom is the compass showing you
where your opponent is the shield’s get
acting get activated but now all this
information is right there at the ocular
level so as you’re playing you you can
it can be a shooting game it can be a
game where you’re playing a medieval
warrior wizard Ranger the the
opportunities are quite endless and so
all of this information is going through
the cloud and so we take that and we
build upon that level of information
that that’s happening and you begin to
think about the storylines that can
really take place Janet Marie who wrote
a book back in the 90s called Hamlet on
the holodeck foretold of the digital and
the physical gaming coming together and
when she had a great quote that said
perhaps the next great Shakespeare of
this world will be a live-action GM who
is actually a computer scientist and so
take that and layer in haptic feedback
so now we you may be aware that suits
exist that you have speakers and it
provides a sonic charge if you’re in a
game and you’re simulating a concussion
charge or maybe that suit gets cold
because you’ve been blasted by a freeze
ray now think of digital X games where
the arena is changed and the people are
playing with each other and now the
spectator can be a part of the game
through the digital process as well
and so that type of gaming and the
physical begin to intertwine and I’ll
take it one step further introduce
machine learning so now you’re
interfacing with AI characters
artificial intelligence that
are learning what your response is so
unlike the choose your own adventure
books where you had to turn to another
page here the game is learning about you
so the ending is never the same and now
you have the opportunity to create an
infinite amount of storylines as you’re
engaging these characters and so I come
back to the motif of the dragon because
for me it represents the harnessing that
creativity as an architect here in the
US we would have many foreign firms come
and approach us to design buildings
around the world and what we found was
that was happening because people we
have an outlet for creativity that
doesn’t exist in many places around the
world and we need to learn to nurture
that creativity because that will be one
of our greatest exports in the 21st
century the ability to create and to
imagine and that ability for us to think
outside of the box is going to be the
difference as as we move into this next
generation of design and technology and
so I’ll leave you with everyone needs to
find their story they need to live it
they need to write it and then don’t let
anyone persuade you from finding your
inner kid because you may just found the
next great idea
[Applause]
Please follow and like us: