started an attack
picture or we will make is a pick up and che is
a typical pizzi person eats and
feel this matter of communication
and that gatza feels when you do not
they understand what you are saying or
when you do not understand what another person
is telling you is a situation in
what possibly some people that
have traveled to other places
the northern region of the state of puebla the
southern region the Mixteca can be
found and then it comes up or this
feeling or this feeling of
anguish but some tenths good me
come back to my house and everyone
understand there is no problem that happens when
we are already in our house we are already in
our region and nobody understand us nor
a single word of what we say
this situation is a situation that
millions of people who use
a different language and that also a
little studied language when we started
to speak a language that nobody does not know
understands I think the solution always
he takes refuge in
gestural communication and then
seems that communicates
gestural communication which is made
from gestures but from sounds can
get to do the communication in
natural reality of the human being
there are some studies and even that
indicate that children babies
they begin to understand communication
gesture
before knowing or understanding or reproducing
including management and language
verbal what is spoken
so if you start asking about
what natural language then is so
little studied compared to
oral language is when one begins to
have that feeling that something does
missing something you have to do the
communication problem they do not
did not find it all and he
research that I did arises to
from this one of this feeling is
this feeling
it turns out that the work is developed
when I was in the United States there was
come to the united states to perform
PhD work
then imagine you had the
degree of water or the web
I had finished my master’s degree in melinao
I had obtained a conacyt scholarship and
media in accepting the fulbright program
then I paradones the brick I ‘m going
to go well varied
I’m going to the United States then with this
dizzy and I find myself on the first day
of classes that came in teacher greets us and
begins to class and do not understand a
single word of what he was saying and
as I spoke English as
not so, this feeling is not
removed for a good while a good time of
to be studying there and to be
rediscovering this
of communication and feel all the
foreign and strange time at the time
of wanting to do the communication and such
Once it was part of what took me
to study this particular language
it turns out that considering itself as
natural language
when I asked certain
linguists how to analyze the
sign language
I found that it turns out that there was
debate about whether the language of
signs is or is not a sign language or
a language to start like
describes the language the language is
describes as the composition of sounds
not all certain sounds that it has
meaning the minimum of the basic and
these certain sounds combined
generate a phoneme is a phoneme that of
basic minimum expression from
agreement
gathering phonemes usa we can generate
words and putting words together we can
communicate meaning and that makes the
language
then with this definition I was already
I went because because the language of
signs obviously has no sounds
then as an engineer he said how am I going to
can study analyze and capture
distribute classify recognize me
sign language is lacking and
even it is a language I would like
starting to start like that is that he touched
chop stone and meet several
people who are experts in language
of signs
they told me it was ridiculous impossible
one told me home luther
well that was after
but well my father said that his wit
then I did him and said good if not
the problem is defined then
it will have to be defined and there will be then
what good and countercurrent and propose
this basic structure of language and
I proposed the following good saying of
everybody
these combinations of human body
including facial expression and posture
body in time and space
this may not be part of ‘the
language maybe yes depending on the
context that forms the basic unit of
communication and that I will use
more kinect as well as phonemes are
sounds have more as they are movements
then the cinemas would be the
basic expression of a language
gestural or sign language and the
combination of the 15 more would result
to a signal and a signal as part of
a dictionary as part of a language
and the combination of signs and this
dictionary and these meanings
would finally make up the
language that I wanted
in this case study capture
classify and translate the first one that I
said you’re crazy was my director of
thesis you can not do anything else you have three
years of scholarship where will you get the
time so we had to reduce the
size of the universe and well we went
looking for some some options for
Quine else was able to capture
that at that time, there was no
enough technology and they believe
technology does not yet exist
enough
the idea of sharing with you this
madness is because we have advanced in
some things are proposed model
have proposed technologies have been made
instruments over the course of the 13
years that this research has
have developed new elements that
apart they lower in price
and then she is willing to this
research for anyone who
want to take the and continue
using it that was already done in
these previous years
for example in the matter of
technologies that best technology for
capture movements that a camera or
that we could think but it turns out that
in the case of sign languages
both the hand position as the
orientation as the movement as the
The shape of the hand is important and how
we use cameras you can see me
completely figure and we can grasp
the space movement but maybe it
lose and in fact you lose the ability
to distinguish between a s a n an atp or
one m
because there is worse so little so suddenly
the volpe by hand then in other cases
the camera no longer turns out to be a
enough technology would have inclusive
that propose new technologies and the
technology that I proposed at that time
it was precisely this device is not
something other than a glove that has
a ball defenders and advisors me
allow to recognize the position of the
hand
the location of the fingers including the
movement by then it cost 10 thousand
Dollars
the glove that could do one thing
similar and obviously there was no
It presupposed so that captured the
position of the fingers and they were made
other devices to capture
also the position with respect to
of the body a lot of work there
still perform with respect to the
algorithms to know if it ‘s a
curved movement or the correct one and that
josé enrique thing is curved that causes
circulate as I know this is a
circle and how do I know this is not a
circle and how the machine is taught
today I’m doing this is a line
straight without even knowing how
describe the how I ‘m going to tell
the machine and write it
it’s in that part there was too much homework
what to do and everything
the road continues many problems
open in this part of technologies and
of algorithms for the capture has been
advanced but there is still a lot to
that you can choose one of
these problems and continue it and good the
issue that linguists do not know
they agree if they were women a
language
there left me in tremendous trouble
I then proposed a model I said good to
see ok do not agree
I will propose a model is a model
based on wants more and then I say
that based on other linguists that
less rebellious media said the
sign language and it is a language and
these are your parts based on that
we proposed this type of models that is
an initial pose can not start
kaka with a position on the
body and I also move from a
movement and ended up on another side and that
combination means something had to
capture it classified after
recognize it function did not work
to such an extent that we could do so
including up to an annotation
because if you seek to condition the
sign language is there will be then
that generate videos as it shows a
sign on a paper
then you had to generate some form
to rewrite the thesis and put it
It will also be part of the thesis in
paper
and well this was generated and had some
impact and ideas began to emerge
since we advance to there
what can we do with this technology
and one of the ideas was good, let’s make a
translator that is portable
here there was an audio device ky
then with the devices to detect
the position of the hand and of the body
and the gloves and so on, let’s do something that
can be used in a best groin way and
that people can move and then
generate generate signs the impact not
It was so good
they find cultural matters
about whether it should or should not be
translate in
gd signs but we maintain the position of
that if any technology that you
help understand capture capture and disseminate
preserve a language must be
welcome to the purposes with which
they can be debatable but if
this technology helped to be able
do the capture the preservation and the
study of language from another point of
I think I had enough
enough merit although he receives
50 and 50 percent reviews
in this case the 50 percent bad says
If 50% good and move
let’s see is here we’ll see if
there is something that did not rain we advance
to a system that could recognize
a subset of sign language
let me see how I do it either
there you do not need the audio in this
study was conducted in the
george university labs
washington where I was doing the
PhD and a
sequence of signs that says highway to
George Washington University of Panama
it was electrical engineering in something like that
and I will have to think out voice
made another system as you can see
there are a lot of cables coming out of
here from there was the first the first
prototype for the next prototype and
it was possible to eliminate a lot of cables and
you had a mobile device
on that mobile device we could already
make our first pininos on
a system that was portable and the
portable system received
feedback from the user
so that you could decide some
parts of the classification algorithm
by then we had some
some financing
let me tell you that after
they told me no, you can not do it and
the rest
a teacher said is not such a bad idea
and then he gave me the first
financing to make my first
prototype that is the one that appears in the
previous video with lots of cables
and we spent on this research not
we are in that investigation in this
first prototype 27 dollars 10 dollars
of gloves plus taxes
and the other thing was what they said in
another video the 10,000 hours of giving
stop early put in front of the mirror to
my fast and then start to see how
It is that moves the arm as I
I move my shoulder where I can measure
where can I put the defender so that
Measure the rotation of the shoulder and tell me
where is my elbow and then as an egg
the elbow to tell me where the
doll and then with a new doll
so you can tell me where the fingers are
and all my wife said this one already
he returned too much or paid for himself
and you see yourself in the mirror for four hours
day but it was not these ten thousand hours of
which are spoken 10,000 hours of
seat to inquire of looking for you from
be all the time stinging stone and
battle against what machine you
they say I can not do another was
still doing colleague and the agency does not
I can already could then I can show you
after showing the video but you
missing audio
they are going to have to believe me that there are
hajj is invention translate americans
and language in this other version
we already have the first prototype
I’m talking about many years ago
they ran pascal and had text and these
new prototypes already have image and
we can do a classification a little
more complex we can see the signals and
these signs help us understand
how are the positions of the
different from those and what things mean
each of them to be able to do
then some other type of application
For example , I think baseball
I want to throw a ball and you know
that when the thrower of the ball of
baseball makes a curve is because the
fingers put them in a certain position
about certain parts of the ball for
those who like baseball will tell me
what true
alcaraz the ball but I have been told that
this is how it is done
and then this can be used to play
to throw the ball with different shapes
of relaunching can obviously serve
for language training
address
that’s an idea that came up that way and
well we have advanced to find the
algorithms that can effectively
translate the positions of the alphabet not
of the alphabet of the Mexican language of
signs but the alphabet of the language
American Sign Language because the language
American sign and not language
Mexican first because the
research was obviously done there
the impact had to be regional
there and there was too much information
on this subject and when what we did
move to the Mexican language
what we found was much smaller
much better information much better
better understanding and agreements between the
people who use it to see if
exists or does not exist a stand if there is
or there is no common language and in the
others that do not
in Mexico there is no language like
Mexican language could be called as
the most common but it is not the one that
used throughout the country there are
regionalisms and apart from language
Mexican has lyrics that do not have the
Mexican language for example the chela
in and wl it’s moving and you’re
we just could not characterize them
for this job but we can do
all of the alphabet of the abcdef
ghijk but I do not know if they will be able to see
until here the result of the
classification although I made the photo more
great that can with him
the connection we make an acknowledgment
of all of all the sensors
involved in
in the fingers and depending on the of the
opposition of the censors we can
go through the alphabet and then do
one to one
we can already be a game in the
game what is shown is a word and
then the person who is
learning the language to spell
can reggae do the word with the
hand and then the ce for this case
he says capable although they do not believe me then
The person must wear gloves and get out
zeta
and if he manages to do well then the
reward with another word and then the
h ave word says business and l
and if they do it well, it rewards them with another
word that we find we find that
this device as well as this one allows
to people who want to learn the
sign language learn it in a way
faster and in we reduced the time
necessary to do internships
practically half with this
apprentice with excellent with this
device
I learned the spelling so in
the case of this these technologies already
They are open to public
patented in 2002 is about to
be the patent
there was still a period of
marketing but generally the
ideas of these technologies is not
keep them hidden and not disseminate the
be able to make other people take
this and generate more technologies and
solve new problems new
that is , it’s your turn
which is harder to capture if
we have to generate new technologies
If you whose turn it to the
linguists do not agree or
so you have to enter then the
engineers and propose their own under
your own interests that are followed
developing technologies like this
what we call the blog access
new methods and models are proposed
for example this sequence of quine more
and it’s the first time he used the
word has more in public not what
had publish now it’s public and
this is going to be called carry forward and
believe in this one in this matter of
understand things propose to fight
against the comments that sometimes do not
are optimal to get off the brick that
one gets dizzy to accept the reality that
they will not give us the grade the time
to do things is finite that no
comes out the first time they are needed
10 thousand hours seat to be able to take
good ideas and good in all these
things even as we go forward
we are just scratching the surface
already
[Applause]
”
Be First to Comment