[Music] buona sera
I’m I don’t usually use paper or print
I’m I don’t usually use paper or print out my talks but I’m being translated
out my talks but I’m being translated
out my talks but I’m being translated and the last time that I spoke with a
and the last time that I spoke with a
and the last time that I spoke with a translator you could see steam and smoke
translator you could see steam and smoke
translator you could see steam and smoke coming out of the translator box so I
coming out of the translator box so I
coming out of the translator box so I want to try and be very kind to the Chia
want to try and be very kind to the Chia
want to try and be very kind to the Chia instead I would like to talk about but
instead I would like to talk about but
instead I would like to talk about but first like to say thank you for inviting
first like to say thank you for inviting
first like to say thank you for inviting me to your beautiful Theatre in this
me to your beautiful Theatre in this
me to your beautiful Theatre in this beautiful town and I want to think with
beautiful town and I want to think with
beautiful town and I want to think with you about the new bundle of digital
you about the new bundle of digital
you about the new bundle of digital technologies that are reshaping our
technologies that are reshaping our
technologies that are reshaping our lives and how we make all kinds of
lives and how we make all kinds of
lives and how we make all kinds of transactions its reshaping the built
transactions its reshaping the built
transactions its reshaping the built environments and this access to digital
environments and this access to digital
environments and this access to digital technology remakes our assumptions about
technology remakes our assumptions about
technology remakes our assumptions about planning and transit and communications
planning and transit and communications
planning and transit and communications and it’s happening of many different
and it’s happening of many different
and it’s happening of many different ways and it’s being increasingly done by
ways and it’s being increasingly done by
ways and it’s being increasingly done by intelligent robots with artificial
intelligent robots with artificial
intelligent robots with artificial intelligence which I’m calling robots
intelligence which I’m calling robots
intelligence which I’m calling robots during this talk and robots see
during this talk and robots see
during this talk and robots see differently than we do they see order
differently than we do they see order
differently than we do they see order and disorder much differently than we do
and disorder much differently than we do
and disorder much differently than we do and some of this is worrying some of
and some of this is worrying some of
and some of this is worrying some of this is fascinating but we should talk
this is fascinating but we should talk
this is fascinating but we should talk about this because it’s important it’s
about this because it’s important it’s
about this because it’s important it’s one thing to see these things in words
one thing to see these things in words
one thing to see these things in words it’s another thing to see them in
it’s another thing to see them in
it’s another thing to see them in pictures and so what I’m going to show
pictures and so what I’m going to show
pictures and so what I’m going to show you are some pictures about robots and
you are some pictures about robots and
you are some pictures about robots and how they think I want to show you two
how they think I want to show you two
how they think I want to show you two projects that my studio stateman has
projects that my studio stateman has
projects that my studio stateman has worked on the first I’m very familiar
worked on the first I’m very familiar
worked on the first I’m very familiar with it is about robots in the stock
with it is about robots in the stock
with it is about robots in the stock market and the second one is very new
market and the second one is very new
market and the second one is very new we’ve only just started looking at this
we’ve only just started looking at this
we’ve only just started looking at this in the last week or two very new this is
in the last week or two very new this is
in the last week or two very new this is work in progress with Aman Tiwari at the
work in progress with Aman Tiwari at the
work in progress with Aman Tiwari at the Carnegie Mellon University sponsored by
Carnegie Mellon University sponsored by
Carnegie Mellon University sponsored by digital globe and it’s about robots
digital globe and it’s about robots
digital globe and it’s about robots reading satellite information and doing
reading satellite information and doing
reading satellite information and doing things with it so this one I’m just
things with it so this one I’m just
things with it so this one I’m just learning to figure out how to talk about
learning to figure out how to talk about
learning to figure out how to talk about but both projects are about the way that
but both projects are about the way that
but both projects are about the way that we think about disorder and order and
we think about disorder and order and
we think about disorder and order and it’s changing rapidly and dramatically
it’s changing rapidly and dramatically
it’s changing rapidly and dramatically and again because of this arrival of
and again because of this arrival of
and again because of this arrival of artificial intelligence and machine
artificial intelligence and machine
artificial intelligence and machine learning and in the last years they’re
learning and in the last years they’re
learning and in the last years they’re starting to be this mainstream
starting to be this mainstream
starting to be this mainstream conversation about AI and ml and robots
conversation about AI and ml and robots
conversation about AI and ml and robots people are waking up to the fact that
people are waking up to the fact that
people are waking up to the fact that when they’re interacting with things
when they’re interacting with things
when they’re interacting with things like Facebook and Instagram what they’re
like Facebook and Instagram what they’re
like Facebook and Instagram what they’re really doing is interacting with an
really doing is interacting with an
really doing is interacting with an artificial intelligence basically a very
artificial intelligence basically a very
artificial intelligence basically a very smart robot is talking to you and the
smart robot is talking to you and the
smart robot is talking to you and the job of this robot what it does better
job of this robot what it does better
job of this robot what it does better than anything else is to keep you on the
than anything else is to keep you on the
than anything else is to keep you on the platform and it gets better and better
platform and it gets better and better
platform and it gets better and better at that all the time and so we’re
at that all the time and so we’re
at that all the time and so we’re starting to talk about how these robots
starting to talk about how these robots
starting to talk about how these robots contribute to things in the news that
contribute to things in the news that
contribute to things in the news that are important to us like the last US
are important to us like the last US
are important to us like the last US presidential election that seems pretty
presidential election that seems pretty
presidential election that seems pretty clear that there were influences in that
clear that there were influences in that
clear that there were influences in that election by some robots that didn’t
election by some robots that didn’t
election by some robots that didn’t necessarily have our best interests in
necessarily have our best interests in
necessarily have our best interests in mind and so we’re seeing this all play
mind and so we’re seeing this all play
mind and so we’re seeing this all play out in very public ways so I think we
out in very public ways so I think we
out in very public ways so I think we should pay attention to this stuff and
should pay attention to this stuff and
should pay attention to this stuff and so here we go this is a map of robots in
so here we go this is a map of robots in
so here we go this is a map of robots in the stock market and I call it a map
the stock market and I call it a map
the stock market and I call it a map very loosely it’s a visual
very loosely it’s a visual
very loosely it’s a visual representation it is a representation
representation it is a representation
representation it is a representation right now of a minute of time left-hand
right now of a minute of time left-hand
right now of a minute of time left-hand side left hand side is the is the past
side left hand side is the is the past
side left hand side is the is the past and the right hand side is the future
and the right hand side is the future
and the right hand side is the future and every one of those dots is a trade
and every one of those dots is a trade
and every one of those dots is a trade on the Nasdaq stock market so the size
on the Nasdaq stock market so the size
on the Nasdaq stock market so the size of the dot is the number of trades the
of the dot is the number of trades the
of the dot is the number of trades the vertical position is the value of the
vertical position is the value of the
vertical position is the value of the trade so the top is a very low penny
trade so the top is a very low penny
trade so the top is a very low penny stocks and the bottom are very expensive
stocks and the bottom are very expensive
stocks and the bottom are very expensive stocks and the color in this case is the
stocks and the color in this case is the
stocks and the color in this case is the stock that’s being traded that makes
stock that’s being traded that makes
stock that’s being traded that makes sense so in this instance you can see
sense so in this instance you can see
sense so in this instance you can see there’s a few they’re kind of big purple
there’s a few they’re kind of big purple
there’s a few they’re kind of big purple ones those are kind of regularly traded
ones those are kind of regularly traded
ones those are kind of regularly traded there’s a yellow line that’s going
there’s a yellow line that’s going
there’s a yellow line that’s going through there are very many stocks that
through there are very many stocks that
through there are very many stocks that are being traded on the market and
are being traded on the market and
are being traded on the market and they’re all different from one another
am I going too fast okay a little bit
am I going too fast okay a little bit all right so if we change this color to
all right so if we change this color to
all right so if we change this color to not represent the stock but to represent
not represent the stock but to represent
not represent the stock but to represent the trader the company that is making
the trader the company that is making
the trader the company that is making the trade on the stock market we get a
the trade on the stock market we get a
the trade on the stock market we get a very different picture it’s almost
very different picture it’s almost
very different picture it’s almost exclusively in this picture Goldman
exclusively in this picture Goldman
exclusively in this picture Goldman Sachs is doing almost all that trading
Sachs is doing almost all that trading
Sachs is doing almost all that trading and we analyzed the day of trading in
and we analyzed the day of trading in
and we analyzed the day of trading in this way and we made one of these for
this way and we made one of these for
this way and we made one of these for every 10 seconds of the day and look
every 10 seconds of the day and look
every 10 seconds of the day and look through them and paid attention to them
through them and paid attention to them
through them and paid attention to them and we see things like this where again
and we see things like this where again
and we see things like this where again we have Goldman Sachs but if you look
we have Goldman Sachs but if you look
we have Goldman Sachs but if you look through enough of these you start to see
through enough of these you start to see
through enough of these you start to see patterns that are unusual and worth
patterns that are unusual and worth
patterns that are unusual and worth paying attention to
paying attention to
paying attention to so here’s the first example you see in
so here’s the first example you see in
so here’s the first example you see in the middle there that kind of bunched up
the middle there that kind of bunched up
the middle there that kind of bunched up kind of band of very very small trades
kind of band of very very small trades
kind of band of very very small trades and they don’t really follow any kind of
and they don’t really follow any kind of
and they don’t really follow any kind of pattern other than they have a very low
pattern other than they have a very low
pattern other than they have a very low cap and a very high margin so they kind
cap and a very high margin so they kind
cap and a very high margin so they kind of they fit within this square and they
of they fit within this square and they
of they fit within this square and they start all at once and then they stop all
start all at once and then they stop all
start all at once and then they stop all at once and they’re there and then they
at once and they’re there and then they
at once and they’re there and then they they’re all very very small trades if we
they’re all very very small trades if we
they’re all very very small trades if we look at them colored by trader we start
look at them colored by trader we start
look at them colored by trader we start to see that all of those trades are
to see that all of those trades are
to see that all of those trades are being made by a single actor so this is
being made by a single actor so this is
being made by a single actor so this is a robot in the stock market this is a
a robot in the stock market this is a
a robot in the stock market this is a robot saying I want to trade
robot saying I want to trade
robot saying I want to trade starting at 7:05 and five seconds I want
starting at 7:05 and five seconds I want
starting at 7:05 and five seconds I want to stop at 7:05 and ten seconds and I
to stop at 7:05 and ten seconds and I
to stop at 7:05 and ten seconds and I want only to buy between one URL and
want only to buy between one URL and
want only to buy between one URL and five euros and only in very very small
five euros and only in very very small
five euros and only in very very small amounts that is not something that your
amounts that is not something that your
amounts that is not something that your stockbroker does when they’re trying to
stockbroker does when they’re trying to
stockbroker does when they’re trying to make your pension a little bit better
make your pension a little bit better
make your pension a little bit better this is something that a robot does and
this is something that a robot does and
this is something that a robot does and this happens all the time you can see
this happens all the time you can see
this happens all the time you can see here we’ve got the color is the stock
here we’ve got the color is the stock
here we’ve got the color is the stock and lots of different kinds of trades
and lots of different kinds of trades
and lots of different kinds of trades and then there’s this kind of funny blue
and then there’s this kind of funny blue
and then there’s this kind of funny blue kind of streak it’s almost as though
kind of streak it’s almost as though
kind of streak it’s almost as though there’s the robot is kind of painting in
there’s the robot is kind of painting in
there’s the robot is kind of painting in the stock market and it has its own
the stock market and it has its own
the stock market and it has its own flavor so let’s look at the first maybe
flavor so let’s look at the first maybe
flavor so let’s look at the first maybe ten minutes of what a typical day on the
ten minutes of what a typical day on the
ten minutes of what a typical day on the stock market looks like this is pre
stock market looks like this is pre
stock market looks like this is pre ringing bell or the opening of the
ringing bell or the opening of the
ringing bell or the opening of the market and so we’ve got a few robots
market and so we’ve got a few robots
market and so we’ve got a few robots kind of hanging out in the corner
kind of hanging out in the corner
kind of hanging out in the corner relaxing the purple lines across the top
relaxing the purple lines across the top
relaxing the purple lines across the top are the market just pinging the very
are the market just pinging the very
are the market just pinging the very bottom of the market and saying is it
bottom of the market and saying is it
bottom of the market and saying is it working is it working is it working
working is it working is it working
working is it working is it working and as we move forward every time I’m
and as we move forward every time I’m
and as we move forward every time I’m moving forward it’s about 10 seconds so
moving forward it’s about 10 seconds so
moving forward it’s about 10 seconds so kind of calm and then a few minutes
kind of calm and then a few minutes
kind of calm and then a few minutes before the market starts we see some
before the market starts we see some
before the market starts we see some robots doing a little dance having some
robots doing a little dance having some
robots doing a little dance having some fun about a minute before the market
fun about a minute before the market
fun about a minute before the market opens we see this just complete barrage
opens we see this just complete barrage
opens we see this just complete barrage of robots making a little gestures and
of robots making a little gestures and
of robots making a little gestures and making a little and they’re all within
making a little and they’re all within
making a little and they’re all within these kind of narrow bands and you can
these kind of narrow bands and you can
these kind of narrow bands and you can see there’s a band at the top and a band
see there’s a band at the top and a band
see there’s a band at the top and a band at the bottom that’s one robot kind of
at the bottom that’s one robot kind of
at the bottom that’s one robot kind of tickling them top in the bottom of the
tickling them top in the bottom of the
tickling them top in the bottom of the market and thing is it working is it
market and thing is it working is it
market and thing is it working is it working
working
working so that goes on for a while and then it
so that goes on for a while and then it
so that goes on for a while and then it calms down and then the 9:00 a.m. bell
calms down and then the 9:00 a.m. bell
calms down and then the 9:00 a.m. bell rings and suddenly all the robots make
rings and suddenly all the robots make
rings and suddenly all the robots make their puts all of this information is
their puts all of this information is
their puts all of this information is happening in about the space of 30
happening in about the space of 30
happening in about the space of 30 seconds so every one of those is a
seconds so every one of those is a
seconds so every one of those is a monster trade that’s been they’ve been
monster trade that’s been they’ve been
monster trade that’s been they’ve been waiting all night to do this you see
waiting all night to do this you see
waiting all night to do this you see some funny patterns in there and this is
some funny patterns in there and this is
some funny patterns in there and this is about 30 seconds and and what I’ve been
about 30 seconds and and what I’ve been
about 30 seconds and and what I’ve been told is that the distance of the
told is that the distance of the
told is that the distance of the computer that does the trade from New
computer that does the trade from New
computer that does the trade from New York City is responsible for the
York City is responsible for the
York City is responsible for the distance of the trades everything is
distance of the trades everything is
distance of the trades everything is measured in milliseconds and so if
measured in milliseconds and so if
measured in milliseconds and so if you’re making an order from Europe your
you’re making an order from Europe your
you’re making an order from Europe your trade takes longer it registers later so
trade takes longer it registers later so
trade takes longer it registers later so the robots are kind of competing with
the robots are kind of competing with
the robots are kind of competing with each other so then the day kind of
each other so then the day kind of
each other so then the day kind of slowly starts to move forward and
slowly starts to move forward and
slowly starts to move forward and eventually we start to see our friends
eventually we start to see our friends
eventually we start to see our friends the green and blue and pink robots doing
the green and blue and pink robots doing
the green and blue and pink robots doing their thing so that’s kind of cool I
their thing so that’s kind of cool I
their thing so that’s kind of cool I think there’s this landscape of activity
think there’s this landscape of activity
think there’s this landscape of activity in the stock market and there’s robots
in the stock market and there’s robots
in the stock market and there’s robots moving through it in ways that humans
moving through it in ways that humans
moving through it in ways that humans don’t seems pretty clear that these are
don’t seems pretty clear that these are
don’t seems pretty clear that these are not humans and if you look closely and
not humans and if you look closely and
not humans and if you look closely and if you use your eyes you can start to
if you use your eyes you can start to
if you use your eyes you can start to understand about a bit more about how
understand about a bit more about how
understand about a bit more about how the up robots operate and what kind of
the up robots operate and what kind of
the up robots operate and what kind of structures they have what kind of forms
structures they have what kind of forms
structures they have what kind of forms they have I mean I think it’s worth
they have I mean I think it’s worth
they have I mean I think it’s worth thinking about this in the context of
thinking about this in the context of
thinking about this in the context of order and disorder because what these
order and disorder because what these
order and disorder because what these pictures show is that there’s very
pictures show is that there’s very
pictures show is that there’s very definitely an attempt on the part of the
definitely an attempt on the part of the
definitely an attempt on the part of the robots to exploit this kind of orderly
robots to exploit this kind of orderly
robots to exploit this kind of orderly nature of the market
nature of the market
nature of the market kind of go in and they try and find
kind of go in and they try and find
kind of go in and they try and find these cracks and surfaces that they can
these cracks and surfaces that they can
these cracks and surfaces that they can move on in order to make different moves
move on in order to make different moves
move on in order to make different moves than humans do so if we want to look for
than humans do so if we want to look for
than humans do so if we want to look for new kinds of order we have to start
new kinds of order we have to start
new kinds of order we have to start looking at what the machines are looking
looking at what the machines are looking
looking at what the machines are looking at so this is the second project I’d
at so this is the second project I’d
at so this is the second project I’d like to talk to you about it’s maps for
like to talk to you about it’s maps for
like to talk to you about it’s maps for robots made by robots
robots made by robots
robots made by robots we start with satellite imagery and
we start with satellite imagery and
we start with satellite imagery and digital globe has a platform that lets
digital globe has a platform that lets
digital globe has a platform that lets us query of scale different kinds of
us query of scale different kinds of
us query of scale different kinds of satellite images and do things with them
satellite images and do things with them
satellite images and do things with them but the problem is that once you get
but the problem is that once you get
but the problem is that once you get over the amazing fact that these are
over the amazing fact that these are
over the amazing fact that these are images taken from space in and of
images taken from space in and of
images taken from space in and of themselves they’re kind of boring and
themselves they’re kind of boring and
themselves they’re kind of boring and what’s interesting about them is their
what’s interesting about them is their
what’s interesting about them is their potential and what you can do with them
potential and what you can do with them
potential and what you can do with them and that’s what we wanted to investigate
and that’s what we wanted to investigate
and that’s what we wanted to investigate and so what can you do with these things
and so what can you do with these things
and so what can you do with these things so these are three pictures of New York
so these are three pictures of New York
so these are three pictures of New York City I think that’s Yankee Stadium and
City I think that’s Yankee Stadium and
City I think that’s Yankee Stadium and there’s lots of other information you
there’s lots of other information you
there’s lots of other information you can combine with satellite imagery we’ve
can combine with satellite imagery we’ve
can combine with satellite imagery we’ve been looking at things like building
been looking at things like building
been looking at things like building footprints which you can get from
footprints which you can get from
footprints which you can get from OpenStreetMap and just find the outlines
OpenStreetMap and just find the outlines
OpenStreetMap and just find the outlines of all the buildings and you can also
of all the buildings and you can also
of all the buildings and you can also get demographic information information
get demographic information information
get demographic information information about the people that live in different
about the people that live in different
about the people that live in different towns and census areas and so we’re
towns and census areas and so we’re
towns and census areas and so we’re looking here at the wealth of the people
looking here at the wealth of the people
looking here at the wealth of the people that live in those areas so the red is
that live in those areas so the red is
that live in those areas so the red is very wealthy and the darker is very
very wealthy and the darker is very
very wealthy and the darker is very low-income and so you can see in the
low-income and so you can see in the
low-income and so you can see in the right and the left hand image you see
right and the left hand image you see
right and the left hand image you see there’s a kind of poor neighborhood
there’s a kind of poor neighborhood
there’s a kind of poor neighborhood surrounded by a very wealthy
surrounded by a very wealthy
surrounded by a very wealthy neighborhood and that’s a social housing
neighborhood and that’s a social housing
neighborhood and that’s a social housing project which in the u.s. is only for
project which in the u.s. is only for
project which in the u.s. is only for poor people because we haven’t figured
poor people because we haven’t figured
poor people because we haven’t figured out how to have a decent society yet and
out how to have a decent society yet and
out how to have a decent society yet and the two other images show middle to low
the two other images show middle to low
the two other images show middle to low income places with lots of buildings on
income places with lots of buildings on
income places with lots of buildings on them so if you think about the world in
them so if you think about the world in
them so if you think about the world in this way and it’s this kind of layering
this way and it’s this kind of layering
this way and it’s this kind of layering of all these different kinds of facts
of all these different kinds of facts
of all these different kinds of facts that you can tell about the world and
that you can tell about the world and
that you can tell about the world and and it turns out that robots when they
and it turns out that robots when they
and it turns out that robots when they do look at the world this way they come
do look at the world this way they come
do look at the world this way they come up with some interesting conclusions so
up with some interesting conclusions so
up with some interesting conclusions so we trained two neural networks which is
we trained two neural networks which is
we trained two neural networks which is a fancy way of saying a set of
a fancy way of saying a set of
a fancy way of saying a set of algorithms and computers and and
algorithms and computers and and
algorithms and computers and and resources that that that can analyze the
resources that that that can analyze the
resources that that that can analyze the imagery and so the first one and so we
imagery and so the first one and so we
imagery and so the first one and so we basically made two robots and we made
basically made two robots and we made
basically made two robots and we made them fight and that
them fight and that
them fight and that I’m going to show you so the generator
I’m going to show you so the generator
I’m going to show you so the generator makes fake satellite imagery from census
makes fake satellite imagery from census
makes fake satellite imagery from census data it takes these kind of green and
data it takes these kind of green and
data it takes these kind of green and red and images and it tries to generate
red and images and it tries to generate
red and images and it tries to generate a satellite image from that and then
a satellite image from that and then
a satellite image from that and then there’s a second one called the
there’s a second one called the
there’s a second one called the discriminator and that one distinguishes
discriminator and that one distinguishes
discriminator and that one distinguishes real satellite images from fake
real satellite images from fake
real satellite images from fake satellite images it knows what real
satellite images it knows what real
satellite images it knows what real satellite images look like and it can
satellite images look like and it can
satellite images look like and it can tell the discriminator or the
tell the discriminator or the
tell the discriminator or the discriminator can say what they what
discriminator can say what they what
discriminator can say what they what they are so the the interplay is that
they are so the the interplay is that
they are so the the interplay is that the the generator tries to fool the
the the generator tries to fool the
the the generator tries to fool the discriminator the generator tries to
discriminator the generator tries to
discriminator the generator tries to make things that the discriminator will
make things that the discriminator will
make things that the discriminator will think are satellite imagery and then the
think are satellite imagery and then the
think are satellite imagery and then the discriminator tells the generator no it
discriminator tells the generator no it
discriminator tells the generator no it doesn’t look like a satellite image
doesn’t look like a satellite image
doesn’t look like a satellite image change it so now you have these two
change it so now you have these two
change it so now you have these two robots trying to trick each other and
robots trying to trick each other and
robots trying to trick each other and they you repeat this process it doesn’t
they you repeat this process it doesn’t
they you repeat this process it doesn’t really matter how many times a hundred
really matter how many times a hundred
really matter how many times a hundred times thousand times a million times
times thousand times a million times
times thousand times a million times because they’re robots and they don’t
because they’re robots and they don’t
because they’re robots and they don’t get tired so eventually sometimes
get tired so eventually sometimes
get tired so eventually sometimes quickly sometimes slowly the generator
quickly sometimes slowly the generator
quickly sometimes slowly the generator makes satellite imagery that is good
makes satellite imagery that is good
makes satellite imagery that is good enough to fool the discriminator and
enough to fool the discriminator and
enough to fool the discriminator and that’s the middle image that you see up
that’s the middle image that you see up
that’s the middle image that you see up there on the left hand side is what the
there on the left hand side is what the
there on the left hand side is what the discriminator uses the right-hand side
discriminator uses the right-hand side
discriminator uses the right-hand side is with the dasari excuse me the
is with the dasari excuse me the
is with the dasari excuse me the left-hand side is with the generator
left-hand side is with the generator
left-hand side is with the generator uses the right-hand side is what the
uses the right-hand side is what the
uses the right-hand side is what the discriminator says and in the middle
discriminator says and in the middle
discriminator says and in the middle they make this kind of image that is not
they make this kind of image that is not
they make this kind of image that is not real satellite imagery but it’s kind of
real satellite imagery but it’s kind of
real satellite imagery but it’s kind of like satellite imagery and that the
like satellite imagery and that the
like satellite imagery and that the point is that it’s good enough for the
point is that it’s good enough for the
point is that it’s good enough for the robots and all of these pictures of New
robots and all of these pictures of New
robots and all of these pictures of New York we can basically draw fake pictures
York we can basically draw fake pictures
York we can basically draw fake pictures of New York City but they’re fake in a
of New York City but they’re fake in a
of New York City but they’re fake in a very specific way that a robot thinks
very specific way that a robot thinks
very specific way that a robot thinks they’re real so we can draw our own
they’re real so we can draw our own
they’re real so we can draw our own satellite data now and a robot will be
satellite data now and a robot will be
satellite data now and a robot will be able to tell us about the economic
able to tell us about the economic
able to tell us about the economic status of the people that live there so
status of the people that live there so
status of the people that live there so what should we do well the first thing
what should we do well the first thing
what should we do well the first thing we thought we’d do was to make movies of
we thought we’d do was to make movies of
we thought we’d do was to make movies of this fake but real enough data so in the
this fake but real enough data so in the
this fake but real enough data so in the middle is the kind of machine vision
middle is the kind of machine vision
middle is the kind of machine vision version this kind of it’s fake but real
version this kind of it’s fake but real
version this kind of it’s fake but real enough for a robot satellite data and I
enough for a robot satellite data and I
enough for a robot satellite data and I wanted to to show you those in a couple
wanted to to show you those in a couple
wanted to to show you those in a couple experiments that we
experiments that we
experiments that we started doing here so this is a pan
started doing here so this is a pan
started doing here so this is a pan along the East River of Manhattan and
along the East River of Manhattan and
along the East River of Manhattan and it’s the first time I’m seeing it on a
it’s the first time I’m seeing it on a
it’s the first time I’m seeing it on a screen this big
screen this big
screen this big we have no roads yet so this is all kind
we have no roads yet so this is all kind
we have no roads yet so this is all kind of in progress the second one is a zoom
of in progress the second one is a zoom
of in progress the second one is a zoom in and out of Brooklyn so on the right
in and out of Brooklyn so on the right
in and out of Brooklyn so on the right you have the demographic data and the
you have the demographic data and the
you have the demographic data and the housing data and it’s all kind of lined
housing data and it’s all kind of lined
housing data and it’s all kind of lined up and you’re seeing a robot’s machine
up and you’re seeing a robot’s machine
up and you’re seeing a robot’s machine vision of what that place looks like so
vision of what that place looks like so
vision of what that place looks like so now things get weird and strange so in
now things get weird and strange so in
now things get weird and strange so in this one on the left hand side we have
this one on the left hand side we have
this one on the left hand side we have generated imagery and on the right hand
generated imagery and on the right hand
generated imagery and on the right hand side we have real housing data but the
side we have real housing data but the
side we have real housing data but the demographic data the data about rich and
demographic data the data about rich and
demographic data the data about rich and poor is fake it’s these bands of rich
poor is fake it’s these bands of rich
poor is fake it’s these bands of rich and poor just kind of laying there and
and poor just kind of laying there and
and poor just kind of laying there and as the bands of rich and poor start to
as the bands of rich and poor start to
as the bands of rich and poor start to move through a neighborhood they start
move through a neighborhood they start
move through a neighborhood they start to change the characteristics of the
to change the characteristics of the
to change the characteristics of the physical world so remember that red is
physical world so remember that red is
physical world so remember that red is high-income and and the the dark red is
high-income and and the the dark red is
high-income and and the the dark red is low-income so these are bands and of low
low-income so these are bands and of low
low-income so these are bands and of low and high income kind of rolling through
and high income kind of rolling through
and high income kind of rolling through a neighborhood it’s like these these
a neighborhood it’s like these these
a neighborhood it’s like these these waves of gentrification that just roll
waves of gentrification that just roll
waves of gentrification that just roll through a neighborhood and transform it
through a neighborhood and transform it
through a neighborhood and transform it and then leave destruction behind them
and then leave destruction behind them
and then leave destruction behind them to go in and they make fancy coffee
to go in and they make fancy coffee
to go in and they make fancy coffee shops and then behind them is just
shops and then behind them is just
shops and then behind them is just poverty so it’s like an animation of the
poverty so it’s like an animation of the
poverty so it’s like an animation of the built environment of capitalism
built environment of capitalism
built environment of capitalism happening in real time so this is very
happening in real time so this is very
happening in real time so this is very strange to me and weird to me and I a
strange to me and weird to me and I a
strange to me and weird to me and I a little frightening to me in in some ways
little frightening to me in in some ways
little frightening to me in in some ways that we can make things that the
that we can make things that the
that we can make things that the satellites and the and the robots think
satellites and the and the robots think
satellites and the and the robots think are kind of good enough but this is
are kind of good enough but this is
are kind of good enough but this is gonna start happening more and more and
gonna start happening more and more and
gonna start happening more and more and and we’re running out of time so we need
and we’re running out of time so we need
and we’re running out of time so we need to start taking these things seriously
to start taking these things seriously
to start taking these things seriously and whether or not this is how we see
and whether or not this is how we see
and whether or not this is how we see the world this is what the robots see
the world this is what the robots see
the world this is what the robots see when the robots are looking at satellite
when the robots are looking at satellite
when the robots are looking at satellite imagery when the robots are looking at
imagery when the robots are looking at
imagery when the robots are looking at your credit card they see the world in
your credit card they see the world in
your credit card they see the world in these different ways and so it’s
these different ways and so it’s
these different ways and so it’s important for us to get better at
important for us to get better at
important for us to get better at talking about this because not just so
talking about this because not just so
talking about this because not just so that we can critique it or not so that
that we can critique it or not so that
that we can critique it or not so that we can stop it but so that we can engage
we can stop it but so that we can engage
we can stop it but so that we can engage with it and figure out what parts of it
with it and figure out what parts of it
with it and figure out what parts of it we want to encourage and what parts of
we want to encourage and what parts of
we want to encourage and what parts of it we want to use robots see things
it we want to use robots see things
it we want to use robots see things differently than people they see order
differently than people they see order
differently than people they see order and disorder structure and flow much
and disorder structure and flow much
and disorder structure and flow much differently than we do some of its
differently than we do some of its
differently than we do some of its fascinating some of this is worrying but
fascinating some of this is worrying but
fascinating some of this is worrying but we should talk about it more we should
we should talk about it more we should
we should talk about it more we should use our eyes to have these conversations
use our eyes to have these conversations
use our eyes to have these conversations as well as our brains it’s too important
as well as our brains it’s too important
as well as our brains it’s too important to leave it to the programmers thank you
to leave it to the programmers thank you
to leave it to the programmers thank you for having
for having
for having [Applause]
[Applause]
[Applause] [Music]
”
Be First to Comment