when I woke up this morning I checked the weather probably like many of you
the weather probably like many of you
the weather probably like many of you and that’s how I decide what I’m gonna
and that’s how I decide what I’m gonna
and that’s how I decide what I’m gonna wear today and it was kind of cold so I
wear today and it was kind of cold so I
wear today and it was kind of cold so I put a sweater on and just like that it’s
put a sweater on and just like that it’s
put a sweater on and just like that it’s so simple and it’s kind of like that for
so simple and it’s kind of like that for
so simple and it’s kind of like that for a lot of our different parts of our
a lot of our different parts of our
a lot of our different parts of our lives that we checked the weather to
lives that we checked the weather to
lives that we checked the weather to decide what we’re going to do when I go
decide what we’re going to do when I go
decide what we’re going to do when I go on a trip I checked the weather to
on a trip I checked the weather to
on a trip I checked the weather to decide where I’m gonna go how I’m gonna
decide where I’m gonna go how I’m gonna
decide where I’m gonna go how I’m gonna get there and again what I’m gonna wear
get there and again what I’m gonna wear
get there and again what I’m gonna wear but it’s not just only the decisions you
but it’s not just only the decisions you
but it’s not just only the decisions you make for yourselves the decisions others
make for yourselves the decisions others
make for yourselves the decisions others make for you also depend on the weather
make for you also depend on the weather
make for you also depend on the weather the flight I chose to take the flight
the flight I chose to take the flight
the flight I chose to take the flight the air traffic control uses the weather
the air traffic control uses the weather
the air traffic control uses the weather information to decide whether or not the
information to decide whether or not the
information to decide whether or not the fight is even going to go and we’re able
fight is even going to go and we’re able
fight is even going to go and we’re able to do all this because weather tracking
to do all this because weather tracking
to do all this because weather tracking is relatively comprehensive weather
is relatively comprehensive weather
is relatively comprehensive weather stations are everywhere there’s in the
stations are everywhere there’s in the
stations are everywhere there’s in the cities they’re up in the mountains you
cities they’re up in the mountains you
cities they’re up in the mountains you even buy one and put one in your
even buy one and put one in your
even buy one and put one in your backyard if you wanted to and where we
backyard if you wanted to and where we
backyard if you wanted to and where we can’t put weather stations such as an
can’t put weather stations such as an
can’t put weather stations such as an ocean or up in the sky
ocean or up in the sky
ocean or up in the sky we have satellite imaging to be able to
we have satellite imaging to be able to
we have satellite imaging to be able to fill that and having all those things
fill that and having all those things
fill that and having all those things together allows us to plan our lives
together allows us to plan our lives
together allows us to plan our lives around the weather so easily so today I
around the weather so easily so today I
around the weather so easily so today I want to ask a question what would it be
want to ask a question what would it be
want to ask a question what would it be like if we can plan around our health
like if we can plan around our health
like if we can plan around our health like the way we plan around the weather
what would it be like if I woke up in
what would it be like if I woke up in the morning and instead of just checking
the morning and instead of just checking
the morning and instead of just checking the weather I can track my health and
the weather I can track my health and
the weather I can track my health and say you know what do I want to wear
say you know what do I want to wear
say you know what do I want to wear today before going on a trip can I check
today before going on a trip can I check
today before going on a trip can I check how my knees are doing and decide what
how my knees are doing and decide what
how my knees are doing and decide what shoes I’m going to wear and whether or
shoes I’m going to wear and whether or
shoes I’m going to wear and whether or not I should take that road or that road
not I should take that road or that road
not I should take that road or that road maybe I should take a card
maybe I should take a card
maybe I should take a card but before we can even ask that question
but before we can even ask that question
but before we can even ask that question we have asked a different question and
we have asked a different question and
we have asked a different question and that’s how do we even get that
that’s how do we even get that
that’s how do we even get that information how do we track health like
information how do we track health like
information how do we track health like the way we track the weather and right
the way we track the weather and right
the way we track the weather and right now the way that the way we track health
now the way that the way we track health
now the way that the way we track health is very different from the way we track
is very different from the way we track
is very different from the way we track the weather we don’t have the equivalent
the weather we don’t have the equivalent
the weather we don’t have the equivalent of a weather station for health what we
of a weather station for health what we
of a weather station for health what we do have are hospitals and clinics and
do have are hospitals and clinics and
do have are hospitals and clinics and these centralized entities of a hospital
these centralized entities of a hospital
these centralized entities of a hospital or clinic are operated by specialized
or clinic are operated by specialized
or clinic are operated by specialized technicians and doctors and nurses and
technicians and doctors and nurses and
technicians and doctors and nurses and have expensive equipments and that’s how
have expensive equipments and that’s how
have expensive equipments and that’s how we deal with our health and you might be
we deal with our health and you might be
we deal with our health and you might be thinking you know I live pretty close to
thinking you know I live pretty close to
thinking you know I live pretty close to the hospital but you’re never gonna have
the hospital but you’re never gonna have
the hospital but you’re never gonna have the same health tracking capabilities as
the same health tracking capabilities as
the same health tracking capabilities as a hospital at home or when you take your
a hospital at home or when you take your
a hospital at home or when you take your kids to the park or when you’re on it on
kids to the park or when you’re on it on
kids to the park or when you’re on it on the road for a trip and not just that we
the road for a trip and not just that we
the road for a trip and not just that we don’t deviate from this concept of a
don’t deviate from this concept of a
don’t deviate from this concept of a clinic very far what we do is if we try
clinic very far what we do is if we try
clinic very far what we do is if we try to get hmm I do not go well we don’t
to get hmm I do not go well we don’t
to get hmm I do not go well we don’t devio actually that worked out really
devio actually that worked out really
devio actually that worked out really well
well
well we don’t deviate from this at all really
we don’t deviate from this at all really
we don’t deviate from this at all really when we try to get health tracking out
when we try to get health tracking out
when we try to get health tracking out into remote places in the world or in
into remote places in the world or in
into remote places in the world or in during disaster relief we basically pack
during disaster relief we basically pack
during disaster relief we basically pack up the clinic and then bring it out
up the clinic and then bring it out
up the clinic and then bring it out there and then we set up clinic and then
there and then we set up clinic and then
there and then we set up clinic and then we try to do health sensing in a
we try to do health sensing in a
we try to do health sensing in a different part of the world and that’s
different part of the world and that’s
different part of the world and that’s very limiting because you can’t really
very limiting because you can’t really
very limiting because you can’t really do this in every place and everywhere
do this in every place and everywhere
do this in every place and everywhere and this is particularly an issue for
and this is particularly an issue for
and this is particularly an issue for global health problems when you don’t
global health problems when you don’t
global health problems when you don’t have this kind of distributed sensing in
have this kind of distributed sensing in
have this kind of distributed sensing in a particular for a problem called anemia
a particular for a problem called anemia
a particular for a problem called anemia this is an issue that afflicts about a
this is an issue that afflicts about a
this is an issue that afflicts about a quarter of the world’s population and
quarter of the world’s population and
quarter of the world’s population and what it is when someone has anemia is
what it is when someone has anemia is
what it is when someone has anemia is they have a lack of hemoglobin in their
they have a lack of hemoglobin in their
they have a lack of hemoglobin in their blood and human globin is a protein that
blood and human globin is a protein that
blood and human globin is a protein that allows your body to bind oxygen and
allows your body to bind oxygen and
allows your body to bind oxygen and bring it around your body and your body
bring it around your body and your body
bring it around your body and your body needs oxygen and so when you’re anemic
needs oxygen and so when you’re anemic
needs oxygen and so when you’re anemic your body doesn’t have really the
your body doesn’t have really the
your body doesn’t have really the capability to distribute oxygen and let
capability to distribute oxygen and let
capability to distribute oxygen and let your organs and your body really
your organs and your body really
your organs and your body really function and
function and
function and this is oftentimes an issue when it
this is oftentimes an issue when it
this is oftentimes an issue when it comes to malnutrition malnutrition is
comes to malnutrition malnutrition is
comes to malnutrition malnutrition is causes this issue of you don’t have the
causes this issue of you don’t have the
causes this issue of you don’t have the right kind of basically nutrients to be
right kind of basically nutrients to be
right kind of basically nutrients to be able to build the right kind of blood to
able to build the right kind of blood to
able to build the right kind of blood to be able to help you with this so what do
be able to help you with this so what do
be able to help you with this so what do people do now to understand this is that
people do now to understand this is that
people do now to understand this is that we have to have a complex coordination
we have to have a complex coordination
we have to have a complex coordination of improvements in nutrition bettering
of improvements in nutrition bettering
of improvements in nutrition bettering our public sanitation and that the crux
our public sanitation and that the crux
our public sanitation and that the crux of it all is how do you track anemia and
of it all is how do you track anemia and
of it all is how do you track anemia and to do this government organizations and
to do this government organizations and
to do this government organizations and public health organizations have joined
public health organizations have joined
public health organizations have joined together to find ways to actually
together to find ways to actually
together to find ways to actually surveyed the field and figure out who is
surveyed the field and figure out who is
surveyed the field and figure out who is anemic and to do so community health
anemic and to do so community health
anemic and to do so community health workers basically pack up what’s in the
workers basically pack up what’s in the
workers basically pack up what’s in the clinic to bring blood testing into
clinic to bring blood testing into
clinic to bring blood testing into different regions of the world they
different regions of the world they
different regions of the world they basically go on boats through the Amazon
basically go on boats through the Amazon
basically go on boats through the Amazon to go up the river for a few hours and
to go up the river for a few hours and
to go up the river for a few hours and then set up shop in different
then set up shop in different
then set up shop in different communities for a few days and people by
communities for a few days and people by
communities for a few days and people by the hundreds come in wait out the door
the hundreds come in wait out the door
the hundreds come in wait out the door to get their blood tested kind of like
to get their blood tested kind of like
to get their blood tested kind of like this and you can imagine in a few days
this and you can imagine in a few days
this and you can imagine in a few days you got a screen for hundreds of kids
you got a screen for hundreds of kids
you got a screen for hundreds of kids whether or not they’re anemic you know
whether or not they’re anemic you know
whether or not they’re anemic you know every every minute or two you got a
every every minute or two you got a
every every minute or two you got a screen through this and it’s very
screen through this and it’s very
screen through this and it’s very stressful kids are crying babies are
stressful kids are crying babies are
stressful kids are crying babies are crying babies are watching babies cry
crying babies are watching babies cry
crying babies are watching babies cry and it’s it’s a madhouse and and in the
and it’s it’s a madhouse and and in the
and it’s it’s a madhouse and and in the middle of it all the nurses are trying
middle of it all the nurses are trying
middle of it all the nurses are trying to grab the kids hand and stab them and
to grab the kids hand and stab them and
to grab the kids hand and stab them and then say all right let me give you a
then say all right let me give you a
then say all right let me give you a little get a little bit of blood and
little get a little bit of blood and
little get a little bit of blood and that’s it it’s pretty crazy and you know
that’s it it’s pretty crazy and you know
that’s it it’s pretty crazy and you know you do this for two three days and you
you do this for two three days and you
you do this for two three days and you pack up and then you go to the next spot
pack up and then you go to the next spot
pack up and then you go to the next spot and the next spot and the next spot and
and the next spot and the next spot and
and the next spot and the next spot and and to be fair and in the last few years
and to be fair and in the last few years
and to be fair and in the last few years this have the community health workers
this have the community health workers
this have the community health workers have done a great job in surveying the
have done a great job in surveying the
have done a great job in surveying the field and trying to figure out how many
field and trying to figure out how many
field and trying to figure out how many people are anemic and that’s how I you
people are anemic and that’s how I you
people are anemic and that’s how I you know how I was able to say a quarter of
know how I was able to say a quarter of
know how I was able to say a quarter of the world’s population is anemic but
the world’s population is anemic but
the world’s population is anemic but that information is outdated we’re not
that information is outdated we’re not
that information is outdated we’re not we don’t know right now what is the
we don’t know right now what is the
we don’t know right now what is the anemia in in the world right now
anemia in in the world right now
anemia in in the world right now and it’s kind of like you know going
and it’s kind of like you know going
and it’s kind of like you know going back to that that weather analogy it’s
back to that that weather analogy it’s
back to that that weather analogy it’s kind of like trying to trying to plan
kind of like trying to trying to plan
kind of like trying to trying to plan your on your flight tomorrow based on
your on your flight tomorrow based on
your on your flight tomorrow based on the weather that’s you know a year ago
the weather that’s you know a year ago
the weather that’s you know a year ago and you know for anemia that’s kind of
and you know for anemia that’s kind of
and you know for anemia that’s kind of like you know going going blind on that
like you know going going blind on that
like you know going going blind on that right it’s you know how do I know that
right it’s you know how do I know that
right it’s you know how do I know that my treatment plan for this community is
my treatment plan for this community is
my treatment plan for this community is actually working and whether or not the
actually working and whether or not the
actually working and whether or not the it’s it’s actually parasite issues and
it’s it’s actually parasite issues and
it’s it’s actually parasite issues and not malnutrition or vice versa
not malnutrition or vice versa
not malnutrition or vice versa how do you plan your treatment without
how do you plan your treatment without
how do you plan your treatment without the right information so what would be
the right information so what would be
the right information so what would be more sensible would be actually to
more sensible would be actually to
more sensible would be actually to empower the municipal municipalities to
empower the municipal municipalities to
empower the municipal municipalities to be able to do this at a much more
be able to do this at a much more
be able to do this at a much more distributed timeline and allow school
distributed timeline and allow school
distributed timeline and allow school teachers or the local community centers
teachers or the local community centers
teachers or the local community centers to be able to engage and be able to do
to be able to engage and be able to do
to be able to engage and be able to do this but it would be super Li costly to
this but it would be super Li costly to
this but it would be super Li costly to bring a blood test device at every
bring a blood test device at every
bring a blood test device at every single community that’s out in the
single community that’s out in the
single community that’s out in the Amazon jungle in the highlands of Peru
Amazon jungle in the highlands of Peru
Amazon jungle in the highlands of Peru and in the desert of Africa it’s just
and in the desert of Africa it’s just
and in the desert of Africa it’s just incredibly expensive and every time you
incredibly expensive and every time you
incredibly expensive and every time you do a test there’s a disposable as well
do a test there’s a disposable as well
do a test there’s a disposable as well so you need to resupply that and that
so you need to resupply that and that
so you need to resupply that and that distribution network isn’t there so two
distribution network isn’t there so two
distribution network isn’t there so two years ago we at the University of
years ago we at the University of
years ago we at the University of Washington’s ubiquitous computing lab
Washington’s ubiquitous computing lab
Washington’s ubiquitous computing lab took on this problem and our solution is
took on this problem and our solution is
took on this problem and our solution is called human human is a way of measuring
called human human is a way of measuring
called human human is a way of measuring hemoglobin using the smartphone’s camera
hemoglobin using the smartphone’s camera
hemoglobin using the smartphone’s camera and LED flash all by putting your finger
and LED flash all by putting your finger
and LED flash all by putting your finger over to camera and the flash he map
over to camera and the flash he map
over to camera and the flash he map measures your hemoglobin levels in your
measures your hemoglobin levels in your
measures your hemoglobin levels in your blood
blood
blood without drawing any blood it sounds like
without drawing any blood it sounds like
without drawing any blood it sounds like magic right the way it works actually is
magic right the way it works actually is
magic right the way it works actually is when you’re anemic the hemoglobin levels
when you’re anemic the hemoglobin levels
when you’re anemic the hemoglobin levels in your blood is lower and hemoglobin is
in your blood is lower and hemoglobin is
in your blood is lower and hemoglobin is a protein that is sorry compound I want
a protein that is sorry compound I want
a protein that is sorry compound I want to say the wrong thing here that is red
to say the wrong thing here that is red
to say the wrong thing here that is red and that is the that is why your blood
and that is the that is why your blood
and that is the that is why your blood is red and so when you’re human globin
is red and so when you’re human globin
is red and so when you’re human globin level is lower than your blood it
level is lower than your blood it
level is lower than your blood it essentially becomes a little bit less
essentially becomes a little bit less
essentially becomes a little bit less red and what the camera is able to see
red and what the camera is able to see
red and what the camera is able to see is that color of your blood and with
is that color of your blood and with
is that color of your blood and with data that we collected with
data that we collected with
data that we collected with collaborations from the University of
collaborations from the University of
collaborations from the University of Washington’s Medical Center and
Washington’s Medical Center and
Washington’s Medical Center and Seattle’s Children’s Hospital we’ve been
Seattle’s Children’s Hospital we’ve been
Seattle’s Children’s Hospital we’ve been able to develop a novel machine learning
able to develop a novel machine learning
able to develop a novel machine learning algorithm that can look at the blood in
algorithm that can look at the blood in
algorithm that can look at the blood in your thing
your thing
your thing and I equate that to hemoglobin you
and I equate that to hemoglobin you
and I equate that to hemoglobin you might be thinking you know how do you
might be thinking you know how do you
might be thinking you know how do you deal with skin tone and finger sizes all
deal with skin tone and finger sizes all
deal with skin tone and finger sizes all those things the way we deal with that
those things the way we deal with that
those things the way we deal with that I’ll give you a little bit science on
I’ll give you a little bit science on
I’ll give you a little bit science on this is that every time your heart beats
this is that every time your heart beats
this is that every time your heart beats it pushes a little bit of blood into
it pushes a little bit of blood into
it pushes a little bit of blood into your finger and when the camera looks at
your finger and when the camera looks at
your finger and when the camera looks at your finger that color changes a little
your finger that color changes a little
your finger that color changes a little bit every single time your heart beats
bit every single time your heart beats
bit every single time your heart beats and that’s how we optically extract out
and that’s how we optically extract out
and that’s how we optically extract out blood and not anything else and then by
blood and not anything else and then by
blood and not anything else and then by applying that machine learning we can
applying that machine learning we can
applying that machine learning we can measure hemoglobin and we’ve been able
measure hemoglobin and we’ve been able
measure hemoglobin and we’ve been able to test this in a few clinical studies
to test this in a few clinical studies
to test this in a few clinical studies and we’ve been able to show that the
and we’ve been able to show that the
and we’ve been able to show that the results are fairly promising and we’ve
results are fairly promising and we’ve
results are fairly promising and we’ve been able to have the comparable results
been able to have the comparable results
been able to have the comparable results with some of the blood tests and other
with some of the blood tests and other
with some of the blood tests and other fda-approved devices and so now what
fda-approved devices and so now what
fda-approved devices and so now what we’ve been able to do is partner up with
we’ve been able to do is partner up with
we’ve been able to do is partner up with organizations in Peru and have them take
organizations in Peru and have them take
organizations in Peru and have them take this out to the field and I went into
this out to the field and I went into
this out to the field and I went into the Amazon with them to see how would
the Amazon with them to see how would
the Amazon with them to see how would this work in an actual setting and we’ve
this work in an actual setting and we’ve
this work in an actual setting and we’ve been able to see some usability problems
been able to see some usability problems
been able to see some usability problems but also been able to see how our
but also been able to see how our
but also been able to see how our accuracy works in the real field so
accuracy works in the real field so
accuracy works in the real field so technically and technologically we can
technically and technologically we can
technically and technologically we can actually just take the camera and take
actually just take the camera and take
actually just take the camera and take the LED flash and make a little clip and
the LED flash and make a little clip and
the LED flash and make a little clip and then measure hemoglobin using the same
then measure hemoglobin using the same
then measure hemoglobin using the same technology and that will probably be
technology and that will probably be
technology and that will probably be cheaper if you really think about it a
cheaper if you really think about it a
cheaper if you really think about it a phone I mean there’s way more than just
phone I mean there’s way more than just
phone I mean there’s way more than just a camera and a flash and by components
a camera and a flash and by components
a camera and a flash and by components why it is cheaper but when you actually
why it is cheaper but when you actually
why it is cheaper but when you actually try to make this into a product it’s
try to make this into a product it’s
try to make this into a product it’s going to cost more than a phone the
going to cost more than a phone the
going to cost more than a phone the reason is that you’re not making this a
reason is that you’re not making this a
reason is that you’re not making this a hundreds of millions in quantity the
hundreds of millions in quantity the
hundreds of millions in quantity the phones are being made in hundreds and
phones are being made in hundreds and
phones are being made in hundreds and millions of in quantity and so when we
millions of in quantity and so when we
millions of in quantity and so when we try to take it and then probably even
try to take it and then probably even
try to take it and then probably even more powerful is that they are already
more powerful is that they are already
more powerful is that they are already everywhere I went bulimic guest everyone
everywhere I went bulimic guest everyone
everywhere I went bulimic guest everyone in this room probably had a phone and
in this room probably had a phone and
in this room probably had a phone and these phones are in the most remote
these phones are in the most remote
these phones are in the most remote parts of the world and so when we tried
parts of the world and so when we tried
parts of the world and so when we tried to leverage the phone that is already
to leverage the phone that is already
to leverage the phone that is already everywhere we can make a entire medical
everywhere we can make a entire medical
everywhere we can make a entire medical infrastructure simply with an app
infrastructure simply with an app
infrastructure simply with an app download and the sensors that are around
download and the sensors that are around
download and the sensors that are around this picture around this phone are all
this picture around this phone are all
this picture around this phone are all sensors are already in the phone and
sensors are already in the phone and
sensors are already in the phone and that opens up entire
that opens up entire
that opens up entire different opportunity it’s not just a
different opportunity it’s not just a
different opportunity it’s not just a camera that we can do measurements we
camera that we can do measurements we
camera that we can do measurements we can use the microphone to measure a lung
can use the microphone to measure a lung
can use the microphone to measure a lung function we can use the camera again to
function we can use the camera again to
function we can use the camera again to screen for pancreatic cancer and by
screen for pancreatic cancer and by
screen for pancreatic cancer and by combining different sensors like the
combining different sensors like the
combining different sensors like the vibration sensor and the camera we can
vibration sensor and the camera we can
vibration sensor and the camera we can measure things like blood pressure let
measure things like blood pressure let
measure things like blood pressure let me tell you how so my colleague my
me tell you how so my colleague my
me tell you how so my colleague my colleague Erik Larson who is now a
colleague Erik Larson who is now a
colleague Erik Larson who is now a professor at Southern Methodist
professor at Southern Methodist
professor at Southern Methodist Methodist University and my uncle who is
Methodist University and my uncle who is
Methodist University and my uncle who is now a professor at Carnegie Mellon
now a professor at Carnegie Mellon
now a professor at Carnegie Mellon University I came up with a way to
University I came up with a way to
University I came up with a way to measure lung function using a microphone
measure lung function using a microphone
measure lung function using a microphone of your phone usually to do this you use
of your phone usually to do this you use
of your phone usually to do this you use a spirometer which is a device that has
a spirometer which is a device that has
a spirometer which is a device that has a little bit of a little turbine in
a little bit of a little turbine in
a little bit of a little turbine in there and you blow your lung at it
there and you blow your lung at it
there and you blow your lung at it really hard some of you might have done
really hard some of you might have done
really hard some of you might have done this if you have asthma or COPD and this
this if you have asthma or COPD and this
this if you have asthma or COPD and this device cost about seven thousand dollars
device cost about seven thousand dollars
device cost about seven thousand dollars and again suffers on the same issue of
and again suffers on the same issue of
and again suffers on the same issue of how do you get this everywhere how do
how do you get this everywhere how do
how do you get this everywhere how do you get a spirometer into every corner
you get a spirometer into every corner
you get a spirometer into every corner world to screen for asthma COPD and all
world to screen for asthma COPD and all
world to screen for asthma COPD and all sorts of other issues so what they came
sorts of other issues so what they came
sorts of other issues so what they came up with is called spiral smart and what
up with is called spiral smart and what
up with is called spiral smart and what spiral smart does is to take advantage
spiral smart does is to take advantage
spiral smart does is to take advantage of when you’re when you do the same lung
of when you’re when you do the same lung
of when you’re when you do the same lung test shall we call it
test shall we call it
test shall we call it it’s basically blowing your lung out at
it’s basically blowing your lung out at
it’s basically blowing your lung out at the at the device it creates a resonance
the at the device it creates a resonance
the at the device it creates a resonance in your vocal tract when you blow harder
in your vocal tract when you blow harder
in your vocal tract when you blow harder the vocal tract rings at a higher
the vocal tract rings at a higher
the vocal tract rings at a higher frequency and when you go down in flow
frequency and when you go down in flow
frequency and when you go down in flow the frequency drops and the microphone
the frequency drops and the microphone
the frequency drops and the microphone can pick up sound so picks up that flow
can pick up sound so picks up that flow
can pick up sound so picks up that flow through that measurement and then uses
through that measurement and then uses
through that measurement and then uses that information to measure your lung
that information to measure your lung
that information to measure your lung flow and again just like you map we’ve
flow and again just like you map we’ve
flow and again just like you map we’ve been able to do a bunch of different
been able to do a bunch of different
been able to do a bunch of different clinical tests and be able to see that
clinical tests and be able to see that
clinical tests and be able to see that it actually works fairly well and it
it actually works fairly well and it
it actually works fairly well and it compares favorably with barometers so
compares favorably with barometers so
compares favorably with barometers so this is my colleague Alex Mario Caucus I
this is my colleague Alex Mario Caucus I
this is my colleague Alex Mario Caucus I love that picture
love that picture
love that picture what he has came up with is a way to
what he has came up with is a way to
what he has came up with is a way to measure bilirubin which is a biomarker
measure bilirubin which is a biomarker
measure bilirubin which is a biomarker for pancreatic cancer using a Selfy
for pancreatic cancer using a Selfy
for pancreatic cancer using a Selfy bilirubin is a yellowish compound that
bilirubin is a yellowish compound that
bilirubin is a yellowish compound that is elevated when you have pancreatic
is elevated when you have pancreatic
is elevated when you have pancreatic cancer and then and it deposits on
cancer and then and it deposits on
cancer and then and it deposits on different parts of your body and such as
different parts of your body and such as
different parts of your body and such as your skin and your eyes and when you
your skin and your eyes and when you
your skin and your eyes and when you have elevated levels of bilirubin your
have elevated levels of bilirubin your
have elevated levels of bilirubin your eyes turning a little bit more yellow
eyes turning a little bit more yellow
eyes turning a little bit more yellow it’s hard to see but what he has been
it’s hard to see but what he has been
it’s hard to see but what he has been able to do is to use the funny-looking
able to do is to use the funny-looking
able to do is to use the funny-looking glasses as a way to calibrate the color
glasses as a way to calibrate the color
glasses as a way to calibrate the color when you take a take a selfie be able to
when you take a take a selfie be able to
when you take a take a selfie be able to capture the whites of the eyes and
capture the whites of the eyes and
capture the whites of the eyes and measure how yellow it is in some essence
measure how yellow it is in some essence
measure how yellow it is in some essence and using machine learning algorithms to
and using machine learning algorithms to
and using machine learning algorithms to be able to translate that image into a
be able to translate that image into a
be able to translate that image into a bilirubin level essentially screen for
bilirubin level essentially screen for
bilirubin level essentially screen for pancreatic cancer using a selfie so far
pancreatic cancer using a selfie so far
pancreatic cancer using a selfie so far what I’ve talked about is only actually
what I’ve talked about is only actually
what I’ve talked about is only actually using a single sensor on a phone but
using a single sensor on a phone but
using a single sensor on a phone but what if we start to combine sensors and
what if we start to combine sensors and
what if we start to combine sensors and create new sensors out of that what can
create new sensors out of that what can
create new sensors out of that what can we do so one of my recent works is to
we do so one of my recent works is to
we do so one of my recent works is to measure blood pressure using a vibration
measure blood pressure using a vibration
measure blood pressure using a vibration sensor and a camera of your phone what
sensor and a camera of your phone what
sensor and a camera of your phone what it does is it’s called seismo and what
it does is it’s called seismo and what
it does is it’s called seismo and what it takes advantage of is this phenomenon
it takes advantage of is this phenomenon
it takes advantage of is this phenomenon called pulse transit time pulse transit
called pulse transit time pulse transit
called pulse transit time pulse transit time is basically the amount of time it
time is basically the amount of time it
time is basically the amount of time it takes your pulse to travel from your
takes your pulse to travel from your
takes your pulse to travel from your heart to a different part of your body
heart to a different part of your body
heart to a different part of your body and how sizeable measures this is it
and how sizeable measures this is it
and how sizeable measures this is it uses the vibration sensor on your phone
uses the vibration sensor on your phone
uses the vibration sensor on your phone when you place it on your chest every
when you place it on your chest every
when you place it on your chest every time your heart beats it kind of
time your heart beats it kind of
time your heart beats it kind of vibrates a little bit and the phone
vibrates a little bit and the phone
vibrates a little bit and the phone captures that using a vibration sensor
captures that using a vibration sensor
captures that using a vibration sensor and when you put your finger over the
and when you put your finger over the
and when you put your finger over the camera
camera
camera it sees when it arrives and captures
it sees when it arrives and captures
it sees when it arrives and captures polish transit time and studies have
polish transit time and studies have
polish transit time and studies have consistently shown that pulse transit
consistently shown that pulse transit
consistently shown that pulse transit time has a correlation with blood
time has a correlation with blood
time has a correlation with blood pressure and what we’ve done now is to
pressure and what we’ve done now is to
pressure and what we’ve done now is to be able to bring all those advantages
be able to bring all those advantages
be able to bring all those advantages Paul transit I’m other people have shown
Paul transit I’m other people have shown
Paul transit I’m other people have shown into a phone
so if we can do this you know above us
so if we can do this you know above us come up with all these different ideas I
come up with all these different ideas I
come up with all these different ideas I think if we can encourage and engage the
think if we can encourage and engage the
think if we can encourage and engage the community in thinking creatively about
community in thinking creatively about
community in thinking creatively about the sensors that are already all around
the sensors that are already all around
the sensors that are already all around us we can take advantage of this
us we can take advantage of this
us we can take advantage of this smartphone infrastructure that are
smartphone infrastructure that are
smartphone infrastructure that are distributed everywhere and basically
distributed everywhere and basically
distributed everywhere and basically transform that into our medical
transform that into our medical
transform that into our medical infrastructure and create our weather
infrastructure and create our weather
infrastructure and create our weather station for our health but I think
station for our health but I think
station for our health but I think smartphones aren’t the only thing that
smartphones aren’t the only thing that
smartphones aren’t the only thing that we can take advantage of what I what I
we can take advantage of what I what I
we can take advantage of what I what I didn’t talk about was that for Spiro
didn’t talk about was that for Spiro
didn’t talk about was that for Spiro smart desperat matauri technology you
smart desperat matauri technology you
smart desperat matauri technology you can actually do that with a landline
can actually do that with a landline
can actually do that with a landline landlines have microphones as well so
landlines have microphones as well so
landlines have microphones as well so what they have done is pick up a
what they have done is pick up a
what they have done is pick up a landline dial one 800 number and do the
landline dial one 800 number and do the
landline dial one 800 number and do the same thing and that data goes to the
same thing and that data goes to the
same thing and that data goes to the cloud and you can do the same algorithm
cloud and you can do the same algorithm
cloud and you can do the same algorithm that measures lung function by using the
that measures lung function by using the
that measures lung function by using the landlines our everywhere so you may be
landlines our everywhere so you may be
landlines our everywhere so you may be smart phones aren’t everywhere yet but
smart phones aren’t everywhere yet but
smart phones aren’t everywhere yet but landlines are pretty well distributed
landlines are pretty well distributed
landlines are pretty well distributed and beyond that we can take advantage of
and beyond that we can take advantage of
and beyond that we can take advantage of new technologies are coming out that are
new technologies are coming out that are
new technologies are coming out that are establishing new infrastructures for us
establishing new infrastructures for us
establishing new infrastructures for us such as a SmartWatch smartwatches are
such as a SmartWatch smartwatches are
such as a SmartWatch smartwatches are creating also the same thing it’s
creating also the same thing it’s
creating also the same thing it’s basically a package of sensors but
basically a package of sensors but
basically a package of sensors but they’re on your body all the time it
they’re on your body all the time it
they’re on your body all the time it introduces a new avenue to measure
introduces a new avenue to measure
introduces a new avenue to measure health could we start to think about
health could we start to think about
health could we start to think about measuring health continuously how would
measuring health continuously how would
measuring health continuously how would that change the way that we interact
that change the way that we interact
that change the way that we interact with health you might have a smart phone
with health you might have a smart phone
with health you might have a smart phone everywhere and you might be able to
everywhere and you might be able to
everywhere and you might be able to measure cardiac function using what I’ve
measure cardiac function using what I’ve
measure cardiac function using what I’ve described but it would be very difficult
described but it would be very difficult
described but it would be very difficult for a smartphone to be there when you
for a smartphone to be there when you
for a smartphone to be there when you suddenly have a stroke I think
suddenly have a stroke I think
suddenly have a stroke I think continuous health monitoring is going to
continuous health monitoring is going to
continuous health monitoring is going to be able to help with that now I’ve
be able to help with that now I’ve
be able to help with that now I’ve talked about all these cool things all
talked about all these cool things all
talked about all these cool things all these different ways to sense health but
these different ways to sense health but
these different ways to sense health but there’s going to be a lot of challenging
there’s going to be a lot of challenging
there’s going to be a lot of challenging questions that’s going to come up as we
questions that’s going to come up as we
questions that’s going to come up as we start to make all these different
start to make all these different
start to make all these different devices
devices
devices and different techniques do all these
and different techniques do all these
and different techniques do all these things such as the FDA is gonna start
things such as the FDA is gonna start
things such as the FDA is gonna start thinking okay if the camera can still be
thinking okay if the camera can still be
thinking okay if the camera can still be used to take a picture what about you
used to take a picture what about you
used to take a picture what about you know what smudge is gonna make a bad
know what smudge is gonna make a bad
know what smudge is gonna make a bad picture but if you try to use you know a
picture but if you try to use you know a
picture but if you try to use you know a picture to screen for can’t really
picture to screen for can’t really
picture to screen for can’t really cancer then it’s no longer just a bad
cancer then it’s no longer just a bad
cancer then it’s no longer just a bad pictures of back diagnosis are we going
pictures of back diagnosis are we going
pictures of back diagnosis are we going to be overwhelmed with the amount of
to be overwhelmed with the amount of
to be overwhelmed with the amount of information amount of information about
information amount of information about
information amount of information about our health to not be able to know what
our health to not be able to know what
our health to not be able to know what to do with that those are questions that
to do with that those are questions that
to do with that those are questions that we need to be able to answer and those
we need to be able to answer and those
we need to be able to answer and those are questions that me my colleagues and
are questions that me my colleagues and
are questions that me my colleagues and many others are trying to answer right
many others are trying to answer right
many others are trying to answer right now there’s a hard questions but I think
now there’s a hard questions but I think
now there’s a hard questions but I think those are certainly worth answering and
those are certainly worth answering and
those are certainly worth answering and I’m very excited by it because I would
I’m very excited by it because I would
I’m very excited by it because I would love to know what would it be like if I
love to know what would it be like if I
love to know what would it be like if I can plan my health just like the way I
can plan my health just like the way I
can plan my health just like the way I planned the weather
planned the weather
”
Be First to Comment