
hello my name’s Duncan and I’m a psycho acoustician now when I tell people this
acoustician now when I tell people this
acoustician now when I tell people this often get some strange looks so I’d like
often get some strange looks so I’d like
often get some strange looks so I’d like to take a moment just to explain to you
to take a moment just to explain to you
to take a moment just to explain to you what my work involves and how I arrived
what my work involves and how I arrived
what my work involves and how I arrived at such a strange sounding career when I
at such a strange sounding career when I
at such a strange sounding career when I was a teenager I was introduced to the
was a teenager I was introduced to the
was a teenager I was introduced to the world of sound recording and this was in
world of sound recording and this was in
world of sound recording and this was in the days of recording up to two inch
the days of recording up to two inch
the days of recording up to two inch reel-to-reel machines that were about
reel-to-reel machines that were about
reel-to-reel machines that were about the size of a fridge and what amazed me
the size of a fridge and what amazed me
the size of a fridge and what amazed me was how different sounds sounded when
was how different sounds sounded when
was how different sounds sounded when they came back off tape as opposed to
they came back off tape as opposed to
they came back off tape as opposed to how they sounded in the room at the time
how they sounded in the room at the time
how they sounded in the room at the time and we’ve all experienced this
and we’ve all experienced this
and we’ve all experienced this phenomenon at some point when we’ve
phenomenon at some point when we’ve
phenomenon at some point when we’ve listened to our own answerphone message
listened to our own answerphone message
listened to our own answerphone message and thought who is that strange person
and thought who is that strange person
and thought who is that strange person so I became really fascinated with what
so I became really fascinated with what
so I became really fascinated with what happens in our brains when we hear
happens in our brains when we hear
happens in our brains when we hear sounds and how we attach meaning to
sounds and how we attach meaning to
sounds and how we attach meaning to those sounds that could be speech planes
those sounds that could be speech planes
those sounds that could be speech planes trains automobiles or as we seen in the
trains automobiles or as we seen in the
trains automobiles or as we seen in the case of this talk music so if I asked
case of this talk music so if I asked
case of this talk music so if I asked everybody in the room to put their hands
everybody in the room to put their hands
everybody in the room to put their hands up if they hate music I’d be surprised
up if they hate music I’d be surprised
up if they hate music I’d be surprised if I could see any hands go up no okay
if I could see any hands go up no okay
if I could see any hands go up no okay good
good
good problem solver to talks over go home
problem solver to talks over go home
problem solver to talks over go home well maybe not because I’m willing to
well maybe not because I’m willing to
well maybe not because I’m willing to bet that we all like slightly different
bet that we all like slightly different
bet that we all like slightly different kinds of music
kinds of music
kinds of music maybe you don’t like the same kind of
maybe you don’t like the same kind of
maybe you don’t like the same kind of music as the person sat next to you so
music as the person sat next to you so
music as the person sat next to you so instead of that what I’d like to ask you
instead of that what I’d like to ask you
instead of that what I’d like to ask you to do is to imagine your favorite piece
to do is to imagine your favorite piece
to do is to imagine your favorite piece of music just take a moment and get it
of music just take a moment and get it
of music just take a moment and get it in your mind’s ear most of us can do
in your mind’s ear most of us can do
in your mind’s ear most of us can do this pretty easily and those pieces of
this pretty easily and those pieces of
this pretty easily and those pieces of music usually have all kinds of
music usually have all kinds of
music usually have all kinds of connotations and memories and feelings
connotations and memories and feelings
connotations and memories and feelings and emotions wrapped up in them even if
and emotions wrapped up in them even if
and emotions wrapped up in them even if you’re not a musician you’ve probably
you’re not a musician you’ve probably
you’re not a musician you’ve probably also performed music with other people
also performed music with other people
also performed music with other people if you’ve ever sung happy birthday or a
if you’ve ever sung happy birthday or a
if you’ve ever sung happy birthday or a stadium chant or a Christmas carol
stadium chant or a Christmas carol
stadium chant or a Christmas carol you’ve performed people music with other
you’ve performed people music with other
you’ve performed people music with other people and got some joy out of doing
people and got some joy out of doing
people and got some joy out of doing that now imagine a world without music
that now imagine a world without music
that now imagine a world without music imagine that you can never perform that
imagine that you can never perform that
imagine that you can never perform that piece of music again or maybe never even
piece of music again or maybe never even
piece of music again or maybe never even hear your favorite piece of music again
hear your favorite piece of music again
hear your favorite piece of music again one of the things about my work that’s
one of the things about my work that’s
one of the things about my work that’s most exciting to me is being able to
most exciting to me is being able to
most exciting to me is being able to take what goes on in our minds when we
take what goes on in our minds when we
take what goes on in our minds when we listen to pieces of music that we love
listen to pieces of music that we love
listen to pieces of music that we love and reverse-engineer those processes to
and reverse-engineer those processes to
and reverse-engineer those processes to give us new ways of interacting with
give us new ways of interacting with
give us new ways of interacting with music new ways of making music and by
music new ways of making music and by
music new ways of making music and by extension new ways of interacting with
extension new ways of interacting with
extension new ways of interacting with each other these patients and others
each other these patients and others
each other these patients and others like them are among the first people in
like them are among the first people in
like them are among the first people in the world to make use of a new field
the world to make use of a new field
the world to make use of a new field called brain computer music interfacing
called brain computer music interfacing
called brain computer music interfacing you may have seen some photos like this
you may have seen some photos like this
you may have seen some photos like this in the news fairly recently my mentor in
in the news fairly recently my mentor in
in the news fairly recently my mentor in Plymouth a composer called Eduardo
Plymouth a composer called Eduardo
Plymouth a composer called Eduardo Miranda working here with locked-in
Miranda working here with locked-in
Miranda working here with locked-in patients and in particular a locked-in
patients and in particular a locked-in
patients and in particular a locked-in former concert violinist so it’s
former concert violinist so it’s
former concert violinist so it’s immediately obvious how in the case of
immediately obvious how in the case of
immediately obvious how in the case of severe physical impairment traditional
severe physical impairment traditional
severe physical impairment traditional music making activity would just be
music making activity would just be
music making activity would just be impossible so how does this technology
impossible so how does this technology
impossible so how does this technology work what you see me wearing here is an
work what you see me wearing here is an
work what you see me wearing here is an electroencephalograph a brain cap with
electroencephalograph a brain cap with
electroencephalograph a brain cap with lots of electrodes attached to it and we
lots of electrodes attached to it and we
lots of electrodes attached to it and we can use devices like this or functional
can use devices like this or functional
can use devices like this or functional magnetic resonance imaging to figure out
magnetic resonance imaging to figure out
magnetic resonance imaging to figure out what’s happening in our brains when
what’s happening in our brains when
what’s happening in our brains when we’re listening to music and responding
we’re listening to music and responding
we’re listening to music and responding to emotionally and to try to harness
to emotionally and to try to harness
to emotionally and to try to harness that those patterns of activity to give
that those patterns of activity to give
that those patterns of activity to give us a way of controlling music making now
us a way of controlling music making now
us a way of controlling music making now this isn’t just for people with severe
this isn’t just for people with severe
this isn’t just for people with severe physical impairment our pigs might fly
physical impairment our pigs might fly
physical impairment our pigs might fly scenario is that anyone in this room
scenario is that anyone in this room
scenario is that anyone in this room would put the brain cap on and we’d be
would put the brain cap on and we’d be
would put the brain cap on and we’d be able to turn your thoughts into music in
able to turn your thoughts into music in
able to turn your thoughts into music in real time
real time
real time of course this technology is very much
of course this technology is very much
of course this technology is very much in its infancy at the moment but
in its infancy at the moment but
in its infancy at the moment but hopefully by the end of this talk you’ll
hopefully by the end of this talk you’ll
hopefully by the end of this talk you’ll have seen a few ways that we’re making
have seen a few ways that we’re making
have seen a few ways that we’re making inroads into allowing this to become a
inroads into allowing this to become a
inroads into allowing this to become a reality first I’d like to show you a
reality first I’d like to show you a
reality first I’d like to show you a system in action in a short video I’m
system in action in a short video I’m
system in action in a short video I’m about to set up a demo or musical brain
about to set up a demo or musical brain
about to set up a demo or musical brain cap I’m just going to switch this on to
cap I’m just going to switch this on to
cap I’m just going to switch this on to a time that
a time that
a time that so while I go in fast forward I’ll just
so while I go in fast forward I’ll just
so while I go in fast forward I’ll just explain that it’s alright we can utilize
explain that it’s alright we can utilize
explain that it’s alright we can utilize time that’s what you’re gonna see is me
time that’s what you’re gonna see is me
time that’s what you’re gonna see is me putting the brain cap on and the system
putting the brain cap on and the system
putting the brain cap on and the system trying to estimate how I feel at the
trying to estimate how I feel at the
trying to estimate how I feel at the time and then create new music for the
time and then create new music for the
time and then create new music for the self playing piano which is what this
self playing piano which is what this
self playing piano which is what this clever little toy is in front of me and
clever little toy is in front of me and
clever little toy is in front of me and at first it’s going to be noisy and
at first it’s going to be noisy and
at first it’s going to be noisy and stressed out because I’ve been playing
stressed out because I’ve been playing
stressed out because I’ve been playing with wires and I’m standing up and
with wires and I’m standing up and
with wires and I’m standing up and gradually I’ll try to relax and the
gradually I’ll try to relax and the
gradually I’ll try to relax and the music that it creates will try to
music that it creates will try to
music that it creates will try to reflect that I’m feeling more relaxed
reflect that I’m feeling more relaxed
reflect that I’m feeling more relaxed and eventually I’ll play along with it
and eventually I’ll play along with it
and eventually I’ll play along with it in a kind of duet and this process uses
in a kind of duet and this process uses
in a kind of duet and this process uses some artificial intelligence 16-channel
some artificial intelligence 16-channel
some artificial intelligence 16-channel neural network if you’re interested in
neural network if you’re interested in
neural network if you’re interested in what’s going on under the bonnet of
what’s going on under the bonnet of
what’s going on under the bonnet of course I don’t get the feeling of
course I don’t get the feeling of
course I don’t get the feeling of playing with other musicians
playing with other musicians
playing with other musicians [Music]
is Fredd brainwaves
is Fredd brainwaves [Music]
so hopefully you could all hear that the
so hopefully you could all hear that the AI gradually learns what I’m playing
AI gradually learns what I’m playing
AI gradually learns what I’m playing with it and then it responds to me and
with it and then it responds to me and
with it and then it responds to me and we have a kind of a jam even if it’s not
we have a kind of a jam even if it’s not
we have a kind of a jam even if it’s not exactly like playing with another
exactly like playing with another
exactly like playing with another musician fine so how do we know that
musician fine so how do we know that
musician fine so how do we know that these systems are making music which
these systems are making music which
these systems are making music which conveys the right emotion well first of
conveys the right emotion well first of
conveys the right emotion well first of all we need to know a little bit more
all we need to know a little bit more
all we need to know a little bit more about what’s happening in our brains
about what’s happening in our brains
about what’s happening in our brains when we have these emotional reactions
when we have these emotional reactions
when we have these emotional reactions to music one way we could do this is
to music one way we could do this is
to music one way we could do this is just to ask you but describing how you
just to ask you but describing how you
just to ask you but describing how you feel and especially describing how you
feel and especially describing how you
feel and especially describing how you feel about music it’s pretty complicated
feel about music it’s pretty complicated
feel about music it’s pretty complicated so I’ll try ask you something a little
so I’ll try ask you something a little
so I’ll try ask you something a little bit simpler first is this text green or
bit simpler first is this text green or
bit simpler first is this text green or red grab a show of hands for green show
red grab a show of hands for green show
red grab a show of hands for green show of hands for red and all very clever
of hands for red and all very clever
of hands for red and all very clever show of hands for both so it depends how
show of hands for both so it depends how
show of hands for both so it depends how you interpret the question how I ask the
you interpret the question how I ask the
you interpret the question how I ask the question we have all these kinds of
question we have all these kinds of
question we have all these kinds of dilemmas when we’re trying to describe
dilemmas when we’re trying to describe
dilemmas when we’re trying to describe sounds as well I want to take 30 seconds
sounds as well I want to take 30 seconds
sounds as well I want to take 30 seconds to just play your sound illusion and
to just play your sound illusion and
to just play your sound illusion and we’ll see how much more complicated
[Music]
[Music] Oh
Oh
Oh Oh
Oh
Oh Oh
Oh
Oh [Music]
Oh
Oh Oh
Oh
Oh [Music]
[Music]
[Music] Oh
Oh
Oh Oh
Oh
Oh Oh
anybody freaked out yeah how would you
anybody freaked out yeah how would you describe what you heard maybe you had an
describe what you heard maybe you had an
describe what you heard maybe you had an image of a never-ending staircase and
image of a never-ending staircase and
image of a never-ending staircase and not to try and hypnotize you into
not to try and hypnotize you into
not to try and hypnotize you into thinking so describing sounds is pretty
thinking so describing sounds is pretty
thinking so describing sounds is pretty complicated the more complicated the
complicated the more complicated the
complicated the more complicated the sound becomes the more difficult is to
sound becomes the more difficult is to
sound becomes the more difficult is to describe our reactions to it maybe
describe our reactions to it maybe
describe our reactions to it maybe you’re someone that gets physical
you’re someone that gets physical
you’re someone that gets physical reactions to music maybe music makes you
reactions to music maybe music makes you
reactions to music maybe music makes you want to dance or maybe you get chills
want to dance or maybe you get chills
want to dance or maybe you get chills down your spine if you hear a piece of
down your spine if you hear a piece of
down your spine if you hear a piece of music that really touches you let’s try
music that really touches you let’s try
music that really touches you let’s try some real music
how did that make you feel fantastic
how did that make you feel fantastic that’s a good answer yeah so if you had
that’s a good answer yeah so if you had
that’s a good answer yeah so if you had said happy or joyful or fantastic or
said happy or joyful or fantastic or
said happy or joyful or fantastic or where’s that effect you’re probably
where’s that effect you’re probably
where’s that effect you’re probably pretty close to the composer’s original
pretty close to the composer’s original
pretty close to the composer’s original intention as I’m sure many of you in the
intention as I’m sure many of you in the
intention as I’m sure many of you in the room will know that course is ode to joy
room will know that course is ode to joy
room will know that course is ode to joy by Beethoven but if you ask people of a
by Beethoven but if you ask people of a
by Beethoven but if you ask people of a certain age and demographic you might
certain age and demographic you might
certain age and demographic you might get a very different answer because this
get a very different answer because this
get a very different answer because this is also the music used in the film die
is also the music used in the film die
is also the music used in the film die hard when Alan Rickman plays the villain
hard when Alan Rickman plays the villain
hard when Alan Rickman plays the villain and gets up to all kinds of naughty
and gets up to all kinds of naughty
and gets up to all kinds of naughty behavior so the point is if you combine
behavior so the point is if you combine
behavior so the point is if you combine music with storytelling and imagery you
music with storytelling and imagery you
music with storytelling and imagery you end up with it’s very powerful cocktail
end up with it’s very powerful cocktail
end up with it’s very powerful cocktail of emotions and memories and filmmakers
of emotions and memories and filmmakers
of emotions and memories and filmmakers have known about this and exploited it
have known about this and exploited it
have known about this and exploited it for a long time
[Music]
[Music] so one of the things that’s wonderful
so one of the things that’s wonderful
so one of the things that’s wonderful about the Jaws thinking is that often
about the Jaws thinking is that often
about the Jaws thinking is that often times it appears in the film without
times it appears in the film without
times it appears in the film without there ever being any sighting of the
there ever being any sighting of the
there ever being any sighting of the shark but it’s still scary so that tells
shark but it’s still scary so that tells
shark but it’s still scary so that tells us that certain kinds of sounds loud
us that certain kinds of sounds loud
us that certain kinds of sounds loud staccato sounds can still kind of
staccato sounds can still kind of
staccato sounds can still kind of trigger a fear response in our in our
trigger a fear response in our in our
trigger a fear response in our in our brains and it doesn’t matter whether
brains and it doesn’t matter whether
brains and it doesn’t matter whether there’s any imagery or perhaps even any
there’s any imagery or perhaps even any
there’s any imagery or perhaps even any lights on at all you’re supposed to be
lights on at all you’re supposed to be
lights on at all you’re supposed to be scared
these topography show us the electrical
these topography show us the electrical activity in our brain when listeners are
activity in our brain when listeners are
activity in our brain when listeners are hearing things that they would describe
hearing things that they would describe
hearing things that they would describe as either angry or frightening and
as either angry or frightening and
as either angry or frightening and hopefully what you can see is that
hopefully what you can see is that
hopefully what you can see is that they’re pretty much polar opposites of
they’re pretty much polar opposites of
they’re pretty much polar opposites of each other which makes sense if you
each other which makes sense if you
each other which makes sense if you think about a fight-or-flight response
think about a fight-or-flight response
think about a fight-or-flight response but these two topography are from
but these two topography are from
but these two topography are from listening to happy and sad sounding
listening to happy and sad sounding
listening to happy and sad sounding music and they’re almost exactly the
music and they’re almost exactly the
music and they’re almost exactly the same why should that be well let’s try
same why should that be well let’s try
same why should that be well let’s try listening to some happy and sad sounding
listening to some happy and sad sounding
listening to some happy and sad sounding music
music
music [Music]
[Music]
[Music] hopefully you could tell which was rich
hopefully you could tell which was rich
hopefully you could tell which was rich because this was played by my artificial
because this was played by my artificial
because this was played by my artificial intelligence algorithm that you saw me
intelligence algorithm that you saw me
intelligence algorithm that you saw me playing with earlier acting autonomously
playing with earlier acting autonomously
playing with earlier acting autonomously so it hasn’t learned all about music
so it hasn’t learned all about music
so it hasn’t learned all about music from me just yet so the brain activity
from me just yet so the brain activity
from me just yet so the brain activity might look the same but the sound was
might look the same but the sound was
might look the same but the sound was definitely different so what we might
definitely different so what we might
definitely different so what we might infer from this is that we get the same
infer from this is that we get the same
infer from this is that we get the same kind of activity the same kind of
kind of activity the same kind of
kind of activity the same kind of enjoyment from listening to both happy
enjoyment from listening to both happy
enjoyment from listening to both happy music and from listening to sad music
music and from listening to sad music
music and from listening to sad music and that’s important if we’re designing
and that’s important if we’re designing
and that’s important if we’re designing systems like this for therapeutic use if
systems like this for therapeutic use if
systems like this for therapeutic use if you imagine using this system when
you imagine using this system when
you imagine using this system when you’re feeling a bit down and maybe it
you’re feeling a bit down and maybe it
you’re feeling a bit down and maybe it tries to play you some upbeat party
tries to play you some upbeat party
tries to play you some upbeat party music that might be the last thing you
music that might be the last thing you
music that might be the last thing you want to hear but maybe if it played
want to hear but maybe if it played
want to hear but maybe if it played something sympathetic and emotionally
something sympathetic and emotionally
something sympathetic and emotionally congruent then it would really help you
congruent then it would really help you
congruent then it would really help you at that point in time and that’s exactly
at that point in time and that’s exactly
at that point in time and that’s exactly what we’ve been doing we built a system
what we’ve been doing we built a system
what we’ve been doing we built a system that uses this as brain clap to choose
that uses this as brain clap to choose
that uses this as brain clap to choose music from your own library to match
music from your own library to match
music from your own library to match your mood imagine coming home from work
your mood imagine coming home from work
your mood imagine coming home from work using a smaller version in our system
using a smaller version in our system
using a smaller version in our system maybe a sensor on the back of your
maybe a sensor on the back of your
maybe a sensor on the back of your glasses that builds a playlist for you
glasses that builds a playlist for you
glasses that builds a playlist for you the way you feel that day after however
the way you feel that day after however
the way you feel that day after however that day is gone however the traffic’s
that day is gone however the traffic’s
that day is gone however the traffic’s been that helps you at that time
been that helps you at that time
been that helps you at that time or maybe going for a run and having a
or maybe going for a run and having a
or maybe going for a run and having a system build motivational music based on
system build motivational music based on
system build motivational music based on your gait your cadence your heart rate
your gait your cadence your heart rate
your gait your cadence your heart rate sup IG’s aren’t flying just yet but what
sup IG’s aren’t flying just yet but what
sup IG’s aren’t flying just yet but what this technology is allowing us to do is
this technology is allowing us to do is
this technology is allowing us to do is to think about a world where there isn’t
to think about a world where there isn’t
to think about a world where there isn’t a middleman between the way we feel and
a middleman between the way we feel and
a middleman between the way we feel and the music that we love and the way that
the music that we love and the way that
the music that we love and the way that those two things can interact thank you
those two things can interact thank you
those two things can interact thank you very much for listening
very much for listening
very much for listening [Applause]
[Applause]
[Applause] you
”
Be First to Comment