Music Perception: Sound, Science and Illusion | Mandar Phatak | TEDxKITCoEK

[Music]

[Music] [Applause]

[Music]

[Music] [Applause]

[Applause]

[Applause] good morning everyone I’m going to talk

good morning everyone I’m going to talk

good morning everyone I’m going to talk about a topic that is very close to our

about a topic that is very close to our

about a topic that is very close to our hearts and is music let me start off by

hearts and is music let me start off by

hearts and is music let me start off by saying that humans are basically musical

saying that humans are basically musical

saying that humans are basically musical animals we are social animals but apart

animals we are social animals but apart

animals we are social animals but apart from that we are also musical animals

from that we are also musical animals

from that we are also musical animals every human culture has some or the

every human culture has some or the

every human culture has some or the other music form associated with it and

other music form associated with it and

other music form associated with it and we incorporate music into our lives

we incorporate music into our lives

we incorporate music into our lives right from soothing babies to expressing

right from soothing babies to expressing

right from soothing babies to expressing our sadness through singing or playing

our sadness through singing or playing

our sadness through singing or playing some music various forms of music affect

some music various forms of music affect

some music various forms of music affect us all the time and we are exposed to

us all the time and we are exposed to

us all the time and we are exposed to music almost throughout the day maybe

music almost throughout the day maybe

music almost throughout the day maybe through advertisements maybe through

through advertisements maybe through

through advertisements maybe through radio internet etc so why do we like

radio internet etc so why do we like

radio internet etc so why do we like music so much what is there music that

music so much what is there music that

music so much what is there music that is so attractive to humans and why do we

is so attractive to humans and why do we

is so attractive to humans and why do we spend so much money on music wire music

spend so much money on music wire music

spend so much money on music wire music music artists are so highly paid etc

music artists are so highly paid etc

music artists are so highly paid etc etcetera these are the questions that

etcetera these are the questions that

etcetera these are the questions that bond us all the time and answer these

bond us all the time and answer these

bond us all the time and answer these questions first we should ask a question

questions first we should ask a question

questions first we should ask a question that what is music because music is a

that what is music because music is a

that what is music because music is a very general term and a lot of things

very general term and a lot of things

very general term and a lot of things can be called music so let’s let’s deal

can be called music so let’s let’s deal

can be called music so let’s let’s deal with this question first

with this question first

with this question first what is music music can be defined as

what is music music can be defined as

what is music music can be defined as structured sound it’s a very loose

structured sound it’s a very loose

structured sound it’s a very loose definition but we can start off with

definition but we can start off with

definition but we can start off with this definition now sound exists as a

this definition now sound exists as a

this definition now sound exists as a mechanical wave and I just propagated

mechanical wave and I just propagated

mechanical wave and I just propagated through any medium might be gas liquid

through any medium might be gas liquid

through any medium might be gas liquid or solid and it basically has two

or solid and it basically has two

or solid and it basically has two components that are very important so

components that are very important so

components that are very important so any sound can be broken down

any sound can be broken down

any sound can be broken down mathematically into a series of a

mathematically into a series of a

mathematically into a series of a summation of sine waves and the sine

summation of sine waves and the sine

summation of sine waves and the sine waves will have an amplitude and a pitch

waves will have an amplitude and a pitch

waves will have an amplitude and a pitch the pitch will pitch will give the sound

the pitch will pitch will give the sound

the pitch will pitch will give the sound high or low characteristics / shrill or

high or low characteristics / shrill or

high or low characteristics / shrill or mellow characteristic and the amplitude

mellow characteristic and the amplitude

mellow characteristic and the amplitude will will give it the loudness so

will will give it the loudness so

will will give it the loudness so these two characters along with the

these two characters along with the

these two characters along with the summation of sine waves that gives rise

summation of sine waves that gives rise

summation of sine waves that gives rise to the wave form which which is a

to the wave form which which is a

to the wave form which which is a signature of a particular sound say my

signature of a particular sound say my

signature of a particular sound say my voice is different from other people’s

voice is different from other people’s

voice is different from other people’s voice because of the waveform that that

voice because of the waveform that that

voice because of the waveform that that is there now when the sound hits our

is there now when the sound hits our

is there now when the sound hits our eardrum that those vibrations are

eardrum that those vibrations are

eardrum that those vibrations are conveyed to the cochlea which is a which

conveyed to the cochlea which is a which

conveyed to the cochlea which is a which is a snail like apparatus that you can

is a snail like apparatus that you can

is a snail like apparatus that you can see and in that apparatus there are

see and in that apparatus there are

see and in that apparatus there are these small hair cells that sense

these small hair cells that sense

these small hair cells that sense mechanical waves and they they have a

mechanical waves and they they have a

mechanical waves and they they have a mechanical coupling this video will see

mechanical coupling this video will see

mechanical coupling this video will see that a guinea-pig

that a guinea-pig

that a guinea-pig hair cell is being sucked into a pipette

hair cell is being sucked into a pipette

hair cell is being sucked into a pipette and some voltage will be applied to it

and some voltage will be applied to it

and some voltage will be applied to it and that voltage is basically a Chinese

and that voltage is basically a Chinese

and that voltage is basically a Chinese song and let’s see what happens when you

song and let’s see what happens when you

song and let’s see what happens when you apply voltage to the same

[Music]

[Music] as we can see there is a small hair like

as we can see there is a small hair like

as we can see there is a small hair like a parrot that is called stevia Celia and

a parrot that is called stevia Celia and

a parrot that is called stevia Celia and what it does is it converts the

what it does is it converts the

what it does is it converts the mechanical information that is there

mechanical information that is there

mechanical information that is there these signals are conveyed to our brain

these signals are conveyed to our brain

these signals are conveyed to our brain and then our brain interprets the

and then our brain interprets the

and then our brain interprets the signals and this is very important for

signals and this is very important for

signals and this is very important for our survival because we need to know

our survival because we need to know

our survival because we need to know where attacked Tiger is coming from so

where attacked Tiger is coming from so

where attacked Tiger is coming from so we need to have very keen sense of

we need to have very keen sense of

we need to have very keen sense of hearing to be able to move around in the

hearing to be able to move around in the

hearing to be able to move around in the world in absence of light cues

world in absence of light cues

world in absence of light cues now let’s talking about structural sound

now let’s talking about structural sound

now let’s talking about structural sound let’s go through some examples

let’s go through some examples

let’s go through some examples [Music]

[Music]

[Music] [Applause]

[Applause]

[Applause] [Music]

bye-bye-bye I’m doing this tonight you

bye-bye-bye I’m doing this tonight you were probably gonna start a fight I know

were probably gonna start a fight I know

were probably gonna start a fight I know this can’t be right hey baby come

[Applause]

[Applause] so what is there in music that is

so what is there in music that is

so what is there in music that is different from these structure sounds

different from these structure sounds

different from these structure sounds normally we like a pulse in the music or

normally we like a pulse in the music or

normally we like a pulse in the music or a sustained pitch or something that we

a sustained pitch or something that we

a sustained pitch or something that we call sewer or musical notes now is it

call sewer or musical notes now is it

call sewer or musical notes now is it only sound that makes music what it is

only sound that makes music what it is

only sound that makes music what it is or is it something else so I mean let me

or is it something else so I mean let me

or is it something else so I mean let me tell it may be honest we are we have

tell it may be honest we are we have

tell it may be honest we are we have been cheating a little music is not only

been cheating a little music is not only

been cheating a little music is not only sound but it’s what what it’s mostly the

sound but it’s what what it’s mostly the

sound but it’s what what it’s mostly the interaction between the sound and the

interaction between the sound and the

interaction between the sound and the brain now our brain is very good at a

brain now our brain is very good at a

brain now our brain is very good at a lot of things but it’s really bad a lot

lot of things but it’s really bad a lot

lot of things but it’s really bad a lot of things and it is very it’s brought

of things and it is very it’s brought

of things and it is very it’s brought about very clearly by illusions this is

about very clearly by illusions this is

about very clearly by illusions this is an optical illusions can somebody guess

an optical illusions can somebody guess

an optical illusions can somebody guess what what is there in this picture can

what what is there in this picture can

what what is there in this picture can somebody see your shape

now can see some grace either face

now can see some grace either face something

so some people might must have guessed

so some people might must have guessed now can somebody can everybody see it

now can somebody can everybody see it

now can somebody can everybody see it so there is a damnation that is sniffing

so there is a damnation that is sniffing

so there is a damnation that is sniffing around in a part but because there is I

around in a part but because there is I

around in a part but because there is I mean everything is in black and white

mean everything is in black and white

mean everything is in black and white it’s hard for us to discern what is

it’s hard for us to discern what is

it’s hard for us to discern what is there unless until we know what is what

there unless until we know what is what

there unless until we know what is what is in the picture if there was more

is in the picture if there was more

is in the picture if there was more information in this picture we would

information in this picture we would

information in this picture we would have been more clear about what it is

have been more clear about what it is

have been more clear about what it is and even if it was upside down we would

and even if it was upside down we would

and even if it was upside down we would have been able to guess that it’s a dog

have been able to guess that it’s a dog

have been able to guess that it’s a dog night and outside and strangely same

night and outside and strangely same

night and outside and strangely same thing happens to music

[Music]

[Music] how many people could guess the song can

how many people could guess the song can

how many people could guess the song can can people raise hands so you can really

can people raise hands so you can really

can people raise hands so you can really have drag number two please

[Music]

[Music] so what happened was when we were just

so what happened was when we were just

so what happened was when we were just exposed to the first part it was the

exposed to the first part it was the

exposed to the first part it was the same notes but they were not placed in

same notes but they were not placed in

same notes but they were not placed in the same octave they’re spread about by

the same octave they’re spread about by

the same octave they’re spread about by octaves and what it does it it just

octaves and what it does it it just

octaves and what it does it it just scrambles the information and that and

scrambles the information and that and

scrambles the information and that and because we don’t know what we are

because we don’t know what we are

because we don’t know what we are supposed to listen to we don’t know what

supposed to listen to we don’t know what

supposed to listen to we don’t know what is going on after we hear the tune it’s

is going on after we hear the tune it’s

is going on after we hear the tune it’s very easy for us to go back and listen

very easy for us to go back and listen

very easy for us to go back and listen to that tune it’s similar to how after

to that tune it’s similar to how after

to that tune it’s similar to how after telling you that it’s a dog it’s much

telling you that it’s a dog it’s much

telling you that it’s a dog it’s much easier to recognize the dog so music

easier to recognize the dog so music

easier to recognize the dog so music also shares this information content

also shares this information content

also shares this information content with a lot of different things like

with a lot of different things like

with a lot of different things like visual signals and language etcetera

visual signals and language etcetera

visual signals and language etcetera etcetera now there are ordinary

etcetera now there are ordinary

etcetera now there are ordinary illusions also this was one of the the

illusions also this was one of the the

illusions also this was one of the the previous one was one of the auditory

previous one was one of the auditory

previous one was one of the auditory illusions can we attract number one this

illusions can we attract number one this

illusions can we attract number one this is called Shepard tone what is happening

is called Shepard tone what is happening

is called Shepard tone what is happening here is basically an ascending

here is basically an ascending

here is basically an ascending go down we keep on acid

[Applause]

[Applause] [Music]

[Music]

[Music] [Laughter]

[Laughter]

[Laughter] [Music]

[Music]

[Music] [Applause]

so it’s actually not possible that a

so it’s actually not possible that a sound is ascending for so long because

sound is ascending for so long because

sound is ascending for so long because we have a limited hearing range so we

we have a limited hearing range so we

we have a limited hearing range so we only hear about from twenty or twenty

only hear about from twenty or twenty

only hear about from twenty or twenty thousand most people here but this is

thousand most people here but this is

thousand most people here but this is still going on it doesn’t seem like it’s

still going on it doesn’t seem like it’s

still going on it doesn’t seem like it’s coming down because it has to come down

coming down because it has to come down

coming down because it has to come down to again increase the same thing happens

to again increase the same thing happens

to again increase the same thing happens if you break it down

if you break it down

if you break it down [Music]

we are going up and up so this basically

we are going up and up so this basically is is like an optical illusion it is not

is is like an optical illusion it is not

is is like an optical illusion it is not possible for sound to always go up but

possible for sound to always go up but

possible for sound to always go up but what happens is that because of the

what happens is that because of the

what happens is that because of the complexity of the signal and ambiguity

complexity of the signal and ambiguity

complexity of the signal and ambiguity of the signal we just sense the

of the signal we just sense the

of the signal we just sense the direction in which the pitch is moving

direction in which the pitch is moving

direction in which the pitch is moving rather than actually hearing what is out

rather than actually hearing what is out

rather than actually hearing what is out there and why is this in the these kind

there and why is this in the these kind

there and why is this in the these kind of things important why is fooling our

of things important why is fooling our

of things important why is fooling our brain so important because if you have

brain so important because if you have

brain so important because if you have hundred information points and if you

hundred information points and if you

hundred information points and if you have to analyze all the hundred

have to analyze all the hundred

have to analyze all the hundred information points and confer something

information points and confer something

information points and confer something from that it’s very slow to be able to

from that it’s very slow to be able to

from that it’s very slow to be able to be fast what our brain does it it just

be fast what our brain does it it just

be fast what our brain does it it just takes twenty previously decided

takes twenty previously decided

takes twenty previously decided important information points and works

important information points and works

important information points and works with that so for example we cannot

with that so for example we cannot

with that so for example we cannot possibly represent a cube on a 2d

possibly represent a cube on a 2d

possibly represent a cube on a 2d surface but when we do this in this way

surface but when we do this in this way

surface but when we do this in this way we as if we imagine that one of the

we as if we imagine that one of the

we as if we imagine that one of the faces is towards us and one of the faces

faces is towards us and one of the faces

faces is towards us and one of the faces in in the background but if we shade the

in in the background but if we shade the

in in the background but if we shade the same cube then what you will see is an

same cube then what you will see is an

same cube then what you will see is an impossible kind of figure where it’s not

impossible kind of figure where it’s not

impossible kind of figure where it’s not possible to have such a figure in 3d

possible to have such a figure in 3d

possible to have such a figure in 3d right similar is the case with some now

right similar is the case with some now

right similar is the case with some now what about language and music because

what about language and music because

what about language and music because language has a lot of pitch content it’s

language has a lot of pitch content it’s

language has a lot of pitch content it’s also a structured sound language is

also a structured sound language is

also a structured sound language is associated with music because all songs

associated with music because all songs

associated with music because all songs have words and words have meanings and

have words and words have meanings and

have words and words have meanings and music also has some kind of meaning but

music also has some kind of meaning but

music also has some kind of meaning but not a direct meaning for example you can

not a direct meaning for example you can

not a direct meaning for example you can tell somebody that your shirt is really

tell somebody that your shirt is really

tell somebody that your shirt is really red and I don’t like it but through

red and I don’t like it but through

red and I don’t like it but through music you can’t express such precise

music you can’t express such precise

music you can’t express such precise thoughts but what you can express is

thoughts but what you can express is

thoughts but what you can express is some emotional thought that cannot be

some emotional thought that cannot be

some emotional thought that cannot be conveyed through language it cannot be

conveyed through language it cannot be

conveyed through language it cannot be put into words and you will get the

put into words and you will get the

put into words and you will get the feeling behind behind the music through

feeling behind behind the music through

feeling behind behind the music through the expression of the singer or the

the expression of the singer or the

the expression of the singer or the performer or the composition now this is

performer or the composition now this is

performer or the composition now this is another auditory illusion they appear to

another auditory illusion they appear to

another auditory illusion they appear to you are not only different from those

you are not only different from those

you are not only different from those that are really present but they

that are really present but they

that are really present but they sometimes behave so strangely as to seem

sometimes behave so strangely as to seem

sometimes behave so strangely as to seem quite impossible

quite impossible

quite impossible but they sometimes behave so strangely

but they sometimes behave so strangely

but they sometimes behave so strangely they sometimes behave so strangely

they sometimes behave so strangely

they sometimes behave so strangely sometimes behave so strangely sometimes

sometimes behave so strangely sometimes

sometimes behave so strangely sometimes behave so strangely sometimes behave so

behave so strangely sometimes behave so

behave so strangely sometimes behave so strangely sometimes behave so strangely

strangely sometimes behave so strangely

strangely sometimes behave so strangely sometimes behave so strangely sometimes

sometimes behave so strangely sometimes

sometimes behave so strangely sometimes behave so strangely sometimes behave so

behave so strangely sometimes behave so

behave so strangely sometimes behave so strangely sometimes behave so strangely

strangely sometimes behave so strangely

strangely sometimes behave so strangely so strangely so strangely so strangely

so strangely so strangely so strangely

so strangely so strangely so strangely so strangely could you hear that even in

so strangely could you hear that even in

so strangely could you hear that even in the speech when we’re listening to it as

the speech when we’re listening to it as

the speech when we’re listening to it as speech we never pay attention to the

speech we never pay attention to the

speech we never pay attention to the pitch content and we can’t hum the tune

pitch content and we can’t hum the tune

pitch content and we can’t hum the tune but after it is repeated we can see we

but after it is repeated we can see we

but after it is repeated we can see we can hear that you Tata

can hear that you Tata

can hear that you Tata rrrr something like that and it is

rrrr something like that and it is

rrrr something like that and it is universally perceived by people when it

universally perceived by people when it

universally perceived by people when it is when that last part is looped it

is when that last part is looped it

is when that last part is looped it sounds like our song and when we play

sounds like our song and when we play

sounds like our song and when we play this clip again even when the normal

this clip again even when the normal

this clip again even when the normal speech is there you will see that the

speech is there you will see that the

speech is there you will see that the last part still sounds musical

can we play that again it sounds as they

can we play that again it sounds as they appear – you are not only different from

appear – you are not only different from

appear – you are not only different from those that are really present but they

those that are really present but they

those that are really present but they sometimes behave so strangely as to seem

sometimes behave so strangely as to seem

sometimes behave so strangely as to seem quite impossible so what we has a very

quite impossible so what we has a very

quite impossible so what we has a very very complex thing called music and it

very complex thing called music and it

very complex thing called music and it has some structure to it it has some

has some structure to it it has some

has some structure to it it has some language like aspects to it but it’s

language like aspects to it but it’s

language like aspects to it but it’s still different from language because if

still different from language because if

still different from language because if the language normally doesn’t have the

the language normally doesn’t have the

the language normally doesn’t have the kind of repetition and stress on pitch

kind of repetition and stress on pitch

kind of repetition and stress on pitch that music has and also there is an

that music has and also there is an

that music has and also there is an ethnicity of language is completely

ethnicity of language is completely

ethnicity of language is completely different from rhythmicity of music so

different from rhythmicity of music so

different from rhythmicity of music so it’s like the story where a lot of blind

it’s like the story where a lot of blind

it’s like the story where a lot of blind people were trying to guess what they

people were trying to guess what they

people were trying to guess what they are touching and one person says that

one person says that it’s a snake one

one person says that it’s a snake one person says that it’s a tree one’s the

person says that it’s a tree one’s the

person says that it’s a tree one’s the person says that it’s just a rope

person says that it’s just a rope

person says that it’s just a rope something like that and what the

something like that and what the

something like that and what the scientific process does is study a

scientific process does is study a

scientific process does is study a subject from various different point of

subject from various different point of

subject from various different point of views and then see say that

views and then see say that

views and then see say that oh it’s also like a snake and it’s also

oh it’s also like a snake and it’s also

oh it’s also like a snake and it’s also like a tree so it can’t be a snake and a

like a tree so it can’t be a snake and a

like a tree so it can’t be a snake and a tree it has to be something that is like

tree it has to be something that is like

tree it has to be something that is like snake and a tree and combining all of

snake and a tree and combining all of

snake and a tree and combining all of these they can say that with some

these they can say that with some

these they can say that with some probability 99 percent probability we

probability 99 percent probability we

probability 99 percent probability we can say that it’s an elephant because

can say that it’s an elephant because

can say that it’s an elephant because elephants show these characteristics

elephants show these characteristics

elephants show these characteristics similarly for music studying these vast

similarly for music studying these vast

similarly for music studying these vast variety of forms that exist in music we

variety of forms that exist in music we

variety of forms that exist in music we can we can tackle the musicality that is

can we can tackle the musicality that is

can we can tackle the musicality that is universal in human beings and that is

universal in human beings and that is

universal in human beings and that is what a lot of scientists have been doing

what a lot of scientists have been doing

what a lot of scientists have been doing for last 2 2 to 3 decades and the most

for last 2 2 to 3 decades and the most

for last 2 2 to 3 decades and the most of the work that I showed was done by

of the work that I showed was done by

of the work that I showed was done by Professor dye not noise who initiated

Professor dye not noise who initiated

Professor dye not noise who initiated the study in auditory illusions and she

the study in auditory illusions and she

the study in auditory illusions and she has actually you can go online and check

has actually you can go online and check

has actually you can go online and check this out she has a whole list of

this out she has a whole list of

this out she has a whole list of auditory illusions that can be

auditory illusions that can be

auditory illusions that can be experienced and with this I end my talk

experienced and with this I end my talk

experienced and with this I end my talk and thank you for your patience

and thank you for your patience

and thank you for your patience [Applause]