Press "Enter" to skip to content

Music in mind | Duncan Williams | TEDxTruro


hello my name’s Duncan and I’m a psycho

hello my name’s Duncan and I’m a psycho acoustician now when I tell people this

acoustician now when I tell people this

acoustician now when I tell people this often get some strange looks so I’d like

often get some strange looks so I’d like

often get some strange looks so I’d like to take a moment just to explain to you

to take a moment just to explain to you

to take a moment just to explain to you what my work involves and how I arrived

what my work involves and how I arrived

what my work involves and how I arrived at such a strange sounding career when I

at such a strange sounding career when I

at such a strange sounding career when I was a teenager I was introduced to the

was a teenager I was introduced to the

was a teenager I was introduced to the world of sound recording and this was in

world of sound recording and this was in

world of sound recording and this was in the days of recording up to two inch

the days of recording up to two inch

the days of recording up to two inch reel-to-reel machines that were about

reel-to-reel machines that were about

reel-to-reel machines that were about the size of a fridge and what amazed me

the size of a fridge and what amazed me

the size of a fridge and what amazed me was how different sounds sounded when

was how different sounds sounded when

was how different sounds sounded when they came back off tape as opposed to

they came back off tape as opposed to

they came back off tape as opposed to how they sounded in the room at the time

how they sounded in the room at the time

how they sounded in the room at the time and we’ve all experienced this

and we’ve all experienced this

and we’ve all experienced this phenomenon at some point when we’ve

phenomenon at some point when we’ve

phenomenon at some point when we’ve listened to our own answerphone message

listened to our own answerphone message

listened to our own answerphone message and thought who is that strange person

and thought who is that strange person

and thought who is that strange person so I became really fascinated with what

so I became really fascinated with what

so I became really fascinated with what happens in our brains when we hear

happens in our brains when we hear

happens in our brains when we hear sounds and how we attach meaning to

sounds and how we attach meaning to

sounds and how we attach meaning to those sounds that could be speech planes

those sounds that could be speech planes

those sounds that could be speech planes trains automobiles or as we seen in the

trains automobiles or as we seen in the

trains automobiles or as we seen in the case of this talk music so if I asked

case of this talk music so if I asked

case of this talk music so if I asked everybody in the room to put their hands

everybody in the room to put their hands

everybody in the room to put their hands up if they hate music I’d be surprised

up if they hate music I’d be surprised

up if they hate music I’d be surprised if I could see any hands go up no okay

if I could see any hands go up no okay

if I could see any hands go up no okay good

good

good problem solver to talks over go home

problem solver to talks over go home

problem solver to talks over go home well maybe not because I’m willing to

well maybe not because I’m willing to

well maybe not because I’m willing to bet that we all like slightly different

bet that we all like slightly different

bet that we all like slightly different kinds of music

kinds of music

kinds of music maybe you don’t like the same kind of

maybe you don’t like the same kind of

maybe you don’t like the same kind of music as the person sat next to you so

music as the person sat next to you so

music as the person sat next to you so instead of that what I’d like to ask you

instead of that what I’d like to ask you

instead of that what I’d like to ask you to do is to imagine your favorite piece

to do is to imagine your favorite piece

to do is to imagine your favorite piece of music just take a moment and get it

of music just take a moment and get it

of music just take a moment and get it in your mind’s ear most of us can do

in your mind’s ear most of us can do

in your mind’s ear most of us can do this pretty easily and those pieces of

this pretty easily and those pieces of

this pretty easily and those pieces of music usually have all kinds of

music usually have all kinds of

music usually have all kinds of connotations and memories and feelings

connotations and memories and feelings

connotations and memories and feelings and emotions wrapped up in them even if

and emotions wrapped up in them even if

and emotions wrapped up in them even if you’re not a musician you’ve probably

you’re not a musician you’ve probably

you’re not a musician you’ve probably also performed music with other people

also performed music with other people

also performed music with other people if you’ve ever sung happy birthday or a

if you’ve ever sung happy birthday or a

if you’ve ever sung happy birthday or a stadium chant or a Christmas carol

stadium chant or a Christmas carol

stadium chant or a Christmas carol you’ve performed people music with other

you’ve performed people music with other

you’ve performed people music with other people and got some joy out of doing

people and got some joy out of doing

people and got some joy out of doing that now imagine a world without music

that now imagine a world without music

that now imagine a world without music imagine that you can never perform that

imagine that you can never perform that

imagine that you can never perform that piece of music again or maybe never even

piece of music again or maybe never even

piece of music again or maybe never even hear your favorite piece of music again

hear your favorite piece of music again

hear your favorite piece of music again one of the things about my work that’s

one of the things about my work that’s

one of the things about my work that’s most exciting to me is being able to

most exciting to me is being able to

most exciting to me is being able to take what goes on in our minds when we

take what goes on in our minds when we

take what goes on in our minds when we listen to pieces of music that we love

listen to pieces of music that we love

listen to pieces of music that we love and reverse-engineer those processes to

and reverse-engineer those processes to

and reverse-engineer those processes to give us new ways of interacting with

give us new ways of interacting with

give us new ways of interacting with music new ways of making music and by

music new ways of making music and by

music new ways of making music and by extension new ways of interacting with

extension new ways of interacting with

extension new ways of interacting with each other these patients and others

each other these patients and others

each other these patients and others like them are among the first people in

like them are among the first people in

like them are among the first people in the world to make use of a new field

the world to make use of a new field

the world to make use of a new field called brain computer music interfacing

called brain computer music interfacing

called brain computer music interfacing you may have seen some photos like this

you may have seen some photos like this

you may have seen some photos like this in the news fairly recently my mentor in

in the news fairly recently my mentor in

in the news fairly recently my mentor in Plymouth a composer called Eduardo

Plymouth a composer called Eduardo

Plymouth a composer called Eduardo Miranda working here with locked-in

Miranda working here with locked-in

Miranda working here with locked-in patients and in particular a locked-in

patients and in particular a locked-in

patients and in particular a locked-in former concert violinist so it’s

former concert violinist so it’s

former concert violinist so it’s immediately obvious how in the case of

immediately obvious how in the case of

immediately obvious how in the case of severe physical impairment traditional

severe physical impairment traditional

severe physical impairment traditional music making activity would just be

music making activity would just be

music making activity would just be impossible so how does this technology

impossible so how does this technology

impossible so how does this technology work what you see me wearing here is an

work what you see me wearing here is an

work what you see me wearing here is an electroencephalograph a brain cap with

electroencephalograph a brain cap with

electroencephalograph a brain cap with lots of electrodes attached to it and we

lots of electrodes attached to it and we

lots of electrodes attached to it and we can use devices like this or functional

can use devices like this or functional

can use devices like this or functional magnetic resonance imaging to figure out

magnetic resonance imaging to figure out

magnetic resonance imaging to figure out what’s happening in our brains when

what’s happening in our brains when

what’s happening in our brains when we’re listening to music and responding

we’re listening to music and responding

we’re listening to music and responding to emotionally and to try to harness

to emotionally and to try to harness

to emotionally and to try to harness that those patterns of activity to give

that those patterns of activity to give

that those patterns of activity to give us a way of controlling music making now

us a way of controlling music making now

us a way of controlling music making now this isn’t just for people with severe

this isn’t just for people with severe

this isn’t just for people with severe physical impairment our pigs might fly

physical impairment our pigs might fly

physical impairment our pigs might fly scenario is that anyone in this room

scenario is that anyone in this room

scenario is that anyone in this room would put the brain cap on and we’d be

would put the brain cap on and we’d be

would put the brain cap on and we’d be able to turn your thoughts into music in

able to turn your thoughts into music in

able to turn your thoughts into music in real time

real time

real time of course this technology is very much

of course this technology is very much

of course this technology is very much in its infancy at the moment but

in its infancy at the moment but

in its infancy at the moment but hopefully by the end of this talk you’ll

hopefully by the end of this talk you’ll

hopefully by the end of this talk you’ll have seen a few ways that we’re making

have seen a few ways that we’re making

have seen a few ways that we’re making inroads into allowing this to become a

inroads into allowing this to become a

inroads into allowing this to become a reality first I’d like to show you a

reality first I’d like to show you a

reality first I’d like to show you a system in action in a short video I’m

system in action in a short video I’m

system in action in a short video I’m about to set up a demo or musical brain

about to set up a demo or musical brain

about to set up a demo or musical brain cap I’m just going to switch this on to

cap I’m just going to switch this on to

cap I’m just going to switch this on to a time that

a time that

a time that so while I go in fast forward I’ll just

so while I go in fast forward I’ll just

so while I go in fast forward I’ll just explain that it’s alright we can utilize

explain that it’s alright we can utilize

explain that it’s alright we can utilize time that’s what you’re gonna see is me

time that’s what you’re gonna see is me

time that’s what you’re gonna see is me putting the brain cap on and the system

putting the brain cap on and the system

putting the brain cap on and the system trying to estimate how I feel at the

trying to estimate how I feel at the

trying to estimate how I feel at the time and then create new music for the

time and then create new music for the

time and then create new music for the self playing piano which is what this

self playing piano which is what this

self playing piano which is what this clever little toy is in front of me and

clever little toy is in front of me and

clever little toy is in front of me and at first it’s going to be noisy and

at first it’s going to be noisy and

at first it’s going to be noisy and stressed out because I’ve been playing

stressed out because I’ve been playing

stressed out because I’ve been playing with wires and I’m standing up and

with wires and I’m standing up and

with wires and I’m standing up and gradually I’ll try to relax and the

gradually I’ll try to relax and the

gradually I’ll try to relax and the music that it creates will try to

music that it creates will try to

music that it creates will try to reflect that I’m feeling more relaxed

reflect that I’m feeling more relaxed

reflect that I’m feeling more relaxed and eventually I’ll play along with it

and eventually I’ll play along with it

and eventually I’ll play along with it in a kind of duet and this process uses

in a kind of duet and this process uses

in a kind of duet and this process uses some artificial intelligence 16-channel

some artificial intelligence 16-channel

some artificial intelligence 16-channel neural network if you’re interested in

neural network if you’re interested in

neural network if you’re interested in what’s going on under the bonnet of

what’s going on under the bonnet of

what’s going on under the bonnet of course I don’t get the feeling of

course I don’t get the feeling of

course I don’t get the feeling of playing with other musicians

playing with other musicians

playing with other musicians [Music]

is Fredd brainwaves

is Fredd brainwaves [Music]

so hopefully you could all hear that the

so hopefully you could all hear that the AI gradually learns what I’m playing

AI gradually learns what I’m playing

AI gradually learns what I’m playing with it and then it responds to me and

with it and then it responds to me and

with it and then it responds to me and we have a kind of a jam even if it’s not

we have a kind of a jam even if it’s not

we have a kind of a jam even if it’s not exactly like playing with another

exactly like playing with another

exactly like playing with another musician fine so how do we know that

musician fine so how do we know that

musician fine so how do we know that these systems are making music which

these systems are making music which

these systems are making music which conveys the right emotion well first of

conveys the right emotion well first of

conveys the right emotion well first of all we need to know a little bit more

all we need to know a little bit more

all we need to know a little bit more about what’s happening in our brains

about what’s happening in our brains

about what’s happening in our brains when we have these emotional reactions

when we have these emotional reactions

when we have these emotional reactions to music one way we could do this is

to music one way we could do this is

to music one way we could do this is just to ask you but describing how you

just to ask you but describing how you

just to ask you but describing how you feel and especially describing how you

feel and especially describing how you

feel and especially describing how you feel about music it’s pretty complicated

feel about music it’s pretty complicated

feel about music it’s pretty complicated so I’ll try ask you something a little

so I’ll try ask you something a little

so I’ll try ask you something a little bit simpler first is this text green or

bit simpler first is this text green or

bit simpler first is this text green or red grab a show of hands for green show

red grab a show of hands for green show

red grab a show of hands for green show of hands for red and all very clever

of hands for red and all very clever

of hands for red and all very clever show of hands for both so it depends how

show of hands for both so it depends how

show of hands for both so it depends how you interpret the question how I ask the

you interpret the question how I ask the

you interpret the question how I ask the question we have all these kinds of

question we have all these kinds of

question we have all these kinds of dilemmas when we’re trying to describe

dilemmas when we’re trying to describe

dilemmas when we’re trying to describe sounds as well I want to take 30 seconds

sounds as well I want to take 30 seconds

sounds as well I want to take 30 seconds to just play your sound illusion and

to just play your sound illusion and

to just play your sound illusion and we’ll see how much more complicated

[Music]

[Music] Oh

Oh

Oh Oh

Oh

Oh Oh

Oh

Oh [Music]

Oh

Oh Oh

Oh

Oh [Music]

[Music]

[Music] Oh

Oh

Oh Oh

Oh

Oh Oh

anybody freaked out yeah how would you

anybody freaked out yeah how would you describe what you heard maybe you had an

describe what you heard maybe you had an

describe what you heard maybe you had an image of a never-ending staircase and

image of a never-ending staircase and

image of a never-ending staircase and not to try and hypnotize you into

not to try and hypnotize you into

not to try and hypnotize you into thinking so describing sounds is pretty

thinking so describing sounds is pretty

thinking so describing sounds is pretty complicated the more complicated the

complicated the more complicated the

complicated the more complicated the sound becomes the more difficult is to

sound becomes the more difficult is to

sound becomes the more difficult is to describe our reactions to it maybe

describe our reactions to it maybe

describe our reactions to it maybe you’re someone that gets physical

you’re someone that gets physical

you’re someone that gets physical reactions to music maybe music makes you

reactions to music maybe music makes you

reactions to music maybe music makes you want to dance or maybe you get chills

want to dance or maybe you get chills

want to dance or maybe you get chills down your spine if you hear a piece of

down your spine if you hear a piece of

down your spine if you hear a piece of music that really touches you let’s try

music that really touches you let’s try

music that really touches you let’s try some real music

how did that make you feel fantastic

how did that make you feel fantastic that’s a good answer yeah so if you had

that’s a good answer yeah so if you had

that’s a good answer yeah so if you had said happy or joyful or fantastic or

said happy or joyful or fantastic or

said happy or joyful or fantastic or where’s that effect you’re probably

where’s that effect you’re probably

where’s that effect you’re probably pretty close to the composer’s original

pretty close to the composer’s original

pretty close to the composer’s original intention as I’m sure many of you in the

intention as I’m sure many of you in the

intention as I’m sure many of you in the room will know that course is ode to joy

room will know that course is ode to joy

room will know that course is ode to joy by Beethoven but if you ask people of a

by Beethoven but if you ask people of a

by Beethoven but if you ask people of a certain age and demographic you might

certain age and demographic you might

certain age and demographic you might get a very different answer because this

get a very different answer because this

get a very different answer because this is also the music used in the film die

is also the music used in the film die

is also the music used in the film die hard when Alan Rickman plays the villain

hard when Alan Rickman plays the villain

hard when Alan Rickman plays the villain and gets up to all kinds of naughty

and gets up to all kinds of naughty

and gets up to all kinds of naughty behavior so the point is if you combine

behavior so the point is if you combine

behavior so the point is if you combine music with storytelling and imagery you

music with storytelling and imagery you

music with storytelling and imagery you end up with it’s very powerful cocktail

end up with it’s very powerful cocktail

end up with it’s very powerful cocktail of emotions and memories and filmmakers

of emotions and memories and filmmakers

of emotions and memories and filmmakers have known about this and exploited it

have known about this and exploited it

have known about this and exploited it for a long time

[Music]

[Music] so one of the things that’s wonderful

so one of the things that’s wonderful

so one of the things that’s wonderful about the Jaws thinking is that often

about the Jaws thinking is that often

about the Jaws thinking is that often times it appears in the film without

times it appears in the film without

times it appears in the film without there ever being any sighting of the

there ever being any sighting of the

there ever being any sighting of the shark but it’s still scary so that tells

shark but it’s still scary so that tells

shark but it’s still scary so that tells us that certain kinds of sounds loud

us that certain kinds of sounds loud

us that certain kinds of sounds loud staccato sounds can still kind of

staccato sounds can still kind of

staccato sounds can still kind of trigger a fear response in our in our

trigger a fear response in our in our

trigger a fear response in our in our brains and it doesn’t matter whether

brains and it doesn’t matter whether

brains and it doesn’t matter whether there’s any imagery or perhaps even any

there’s any imagery or perhaps even any

there’s any imagery or perhaps even any lights on at all you’re supposed to be

lights on at all you’re supposed to be

lights on at all you’re supposed to be scared

these topography show us the electrical

these topography show us the electrical activity in our brain when listeners are

activity in our brain when listeners are

activity in our brain when listeners are hearing things that they would describe

hearing things that they would describe

hearing things that they would describe as either angry or frightening and

as either angry or frightening and

as either angry or frightening and hopefully what you can see is that

hopefully what you can see is that

hopefully what you can see is that they’re pretty much polar opposites of

they’re pretty much polar opposites of

they’re pretty much polar opposites of each other which makes sense if you

each other which makes sense if you

each other which makes sense if you think about a fight-or-flight response

think about a fight-or-flight response

think about a fight-or-flight response but these two topography are from

but these two topography are from

but these two topography are from listening to happy and sad sounding

listening to happy and sad sounding

listening to happy and sad sounding music and they’re almost exactly the

music and they’re almost exactly the

music and they’re almost exactly the same why should that be well let’s try

same why should that be well let’s try

same why should that be well let’s try listening to some happy and sad sounding

listening to some happy and sad sounding

listening to some happy and sad sounding music

music

music [Music]

[Music]

[Music] hopefully you could tell which was rich

hopefully you could tell which was rich

hopefully you could tell which was rich because this was played by my artificial

because this was played by my artificial

because this was played by my artificial intelligence algorithm that you saw me

intelligence algorithm that you saw me

intelligence algorithm that you saw me playing with earlier acting autonomously

playing with earlier acting autonomously

playing with earlier acting autonomously so it hasn’t learned all about music

so it hasn’t learned all about music

so it hasn’t learned all about music from me just yet so the brain activity

from me just yet so the brain activity

from me just yet so the brain activity might look the same but the sound was

might look the same but the sound was

might look the same but the sound was definitely different so what we might

definitely different so what we might

definitely different so what we might infer from this is that we get the same

infer from this is that we get the same

infer from this is that we get the same kind of activity the same kind of

kind of activity the same kind of

kind of activity the same kind of enjoyment from listening to both happy

enjoyment from listening to both happy

enjoyment from listening to both happy music and from listening to sad music

music and from listening to sad music

music and from listening to sad music and that’s important if we’re designing

and that’s important if we’re designing

and that’s important if we’re designing systems like this for therapeutic use if

systems like this for therapeutic use if

systems like this for therapeutic use if you imagine using this system when

you imagine using this system when

you imagine using this system when you’re feeling a bit down and maybe it

you’re feeling a bit down and maybe it

you’re feeling a bit down and maybe it tries to play you some upbeat party

tries to play you some upbeat party

tries to play you some upbeat party music that might be the last thing you

music that might be the last thing you

music that might be the last thing you want to hear but maybe if it played

want to hear but maybe if it played

want to hear but maybe if it played something sympathetic and emotionally

something sympathetic and emotionally

something sympathetic and emotionally congruent then it would really help you

congruent then it would really help you

congruent then it would really help you at that point in time and that’s exactly

at that point in time and that’s exactly

at that point in time and that’s exactly what we’ve been doing we built a system

what we’ve been doing we built a system

what we’ve been doing we built a system that uses this as brain clap to choose

that uses this as brain clap to choose

that uses this as brain clap to choose music from your own library to match

music from your own library to match

music from your own library to match your mood imagine coming home from work

your mood imagine coming home from work

your mood imagine coming home from work using a smaller version in our system

using a smaller version in our system

using a smaller version in our system maybe a sensor on the back of your

maybe a sensor on the back of your

maybe a sensor on the back of your glasses that builds a playlist for you

glasses that builds a playlist for you

glasses that builds a playlist for you the way you feel that day after however

the way you feel that day after however

the way you feel that day after however that day is gone however the traffic’s

that day is gone however the traffic’s

that day is gone however the traffic’s been that helps you at that time

been that helps you at that time

been that helps you at that time or maybe going for a run and having a

or maybe going for a run and having a

or maybe going for a run and having a system build motivational music based on

system build motivational music based on

system build motivational music based on your gait your cadence your heart rate

your gait your cadence your heart rate

your gait your cadence your heart rate sup IG’s aren’t flying just yet but what

sup IG’s aren’t flying just yet but what

sup IG’s aren’t flying just yet but what this technology is allowing us to do is

this technology is allowing us to do is

this technology is allowing us to do is to think about a world where there isn’t

to think about a world where there isn’t

to think about a world where there isn’t a middleman between the way we feel and

a middleman between the way we feel and

a middleman between the way we feel and the music that we love and the way that

the music that we love and the way that

the music that we love and the way that those two things can interact thank you

those two things can interact thank you

those two things can interact thank you very much for listening

very much for listening

very much for listening [Applause]

[Applause]

[Applause] you

”

Be First to Comment

Leave a Reply

Your email address will not be published. Required fields are marked *