Described herein are embodiments of systems and methods for calculating glucose in a non-invasive manner using head-mounted sensors. In one embodiment, a system that calculates blood glucose levels includes a head-mounted contact photoplethysmography device that measures a signal indicative of a photoplethysmogram signal (PPG signal) at a first region comprising skin on a user's head, and a head-mounted camera configured to capture images of a second region comprising skin on the user's head. The system also includes a computer that identifies, based on the PPG signal, times of systolic notches and times of systolic peaks, and calculates the blood glucose level based on differences between a first subset of the images taken during the times of systolic notches and a second subset of the images taken during the times of systolic peaks. Optionally, the photoplethysmography device and the camera are couple to smartglasses worn on the user's head.
Described herein are embodiments of systems and methods that utilize temperature measurements taken with head-mounted sensors as well as images of a user's face to detect fever and/or intoxication. One embodiment of a system to detect fever includes a first head-mounted temperature sensor that measures skin temperature (Tskin) at a first region on a user's head, a second head-mounted temperature sensor that measures a temperature of the environment (Tenv), and a computer. The computer receives images of a second region on the user's face, captured by a camera sensitive to wavelengths below 1050 nanometer, and calculates, based on the images, values indicative of hemoglobin concentrations at three or more regions on the user's face. The computer can then detect whether the user has a fever based on Tskin, Tenv and the values.
Described herein are embodiments of systems and methods that utilize images of a user's face to detect fever and intoxication. One embodiment of a system to detect fever includes first and second inward-facing head-mounted cameras that are located less than 5 cm from a user's face, are sensitive to wavelengths below 1050 nanometer, and are configured to capture images of respective first and second regions on the user's face. The system also includes a computer that calculates, based on baseline images captured with the cameras while the user did not have a fever, a baseline pattern of hemoglobin concentrations at regions on the face. The computer also calculates, based on a current set of images captured with the cameras, a current pattern of hemoglobin concentrations at the regions, and detects whether the user has a fever based on a deviation of the current pattern from the baseline pattern.
Detecting a respiratory tract infection (RTI) based on changes in coughing sounds, which can provide an early warning of infection with a disease like COVID-19, as well as indications of its progression and severity. In one embodiment, the system includes smartglasses, with sensors mounted thereto, which include an acoustic sensor mounted at a fixed position relative to a user's head, and a movement sensor. A computer receives current measurements of the user, taken with the sensors, while there were head movements that characterize coughing, and also earlier measurements of the user, taken with the sensors, while the user had a known extent of the RTI and while there were head movements that characterize coughing. The computer detects a change relative to the known extent of the RTI based on a difference between the current measurements and the earlier measurements.
Systems for calculating extent of congestive heart failure (CHF) and/or identifying exacerbation of CHF. In one embodiment, a system includes smartglasses configured to be worn on a user's head, and an inward-facing camera and a sensor, both physically coupled to the smartglasses. The inward-facing camera is mounted more than 5 mm away from the head and captures images of an area comprising skin on the user's head, which is larger than 4 cm{circumflex over ( )}2. The sensor measures a signal indicative of a respiration rate of the user (respiration signal). The system also includes a computer that calculates the extent of CHF based on: a facial blood flow pattern recognizable in the images, and respiration rate recognizable in the respiration signal.
A hygienic in-vehicle head-mounted display (HMD) includes: a head piece, a stiff module, and a lock that connects and disconnects the head piece and the stiff module. The head piece is in direct physical contact with the passenger's face. The stiff module includes a display module that projects video into eyes of a passenger of a vehicle while the HMD is worn by the passenger. In one embodiment, a storage module may be used to stow the stiff module. Optionally, the storage module releases the stiff module responsive to the head piece being connected to the stiff module. In another embodiment, a processor instructs the display module to project video responsive to an indication that the head piece and the stiff module are connected, and instructs the display module not to project the video, responsive to an indication that the head piece and the stiff module are not connected.
System and Method to detect an abnormal medical event based on an asymmetrical change to blood flow. The system includes right-side and left-side head-mounted devices to measure signals indicative of photoplethysmographic signals (PPG signals) on the right and left sides of a user's head, and a computer that detects the abnormal medical event based on an asymmetrical change to blood flow recognizable in the PPG signals. Optionally, the asymmetrical change to the blood flow corresponds to a deviation of the PPG signals compared to a baseline that is based on previous measurements of PPG signals of the user, taken before the abnormal medical event.
Head-mounted displays (HMDs) are being used more and more for entertainment and work while traveling in vehicles. However, the use of an HMD can be risky in the event of a collision. This disclosure describes a safety system comprising a head-mounted display (HMD) configured to be worn on a passenger's head while traveling in an automated on-road vehicle, a folded airbag, fixed to the HMD, and an inflation system fixed to the vehicle and connected to the folded airbag through a flexible hose. The flexible hose is configured to convey as generated by the inflation system. The system may further detach the flexible hose from the inflation system after the inflation, such that the airbag is no longer connected to the inflation system shortly after the inflation.
Systems and methods for detecting an occurrence of a transient ischemic attack (TIA). In one embodiment, a device is utilized to measure first and second signals indicative of photoplethysmogram signals at first and second regions on the left and right sides of a user's head (PPGSL and PPGSR, respectively). A computer detects the occurrence of a TIA based on PPGSL and PPGSR that exhibit a pattern that involves the following: (i) an asymmetry between PPGSL and PPGSR, which is below a threshold, during a first period spanning more than a day; (ii) an asymmetry between PPGSL and PPGSR, which exceeds the threshold, during a second period following the first period and spanning between 5 and 180 minutes; and (iii) an asymmetry between PPGSL and PPGSR, which falls below the threshold, during a third period following the second period.
Disclosed herein are systems and methods for detecting a physiological response using different types of photoplethysmography sensors. Examples of physiological responses that may be detected include an allergic reaction, a stroke, a migraine, stress, certain emotional responses, manifestation of pain, and blood pressure. In one embodiment, a head-mounted contact photoplethysmography device measures a signal indicative of photoplethysmogram signal at a first region that includes exposed skin on a user's head (PPG signal). A camera, located more than 10 mm away from the user's head, captures images of a second region that includes exposed skin on the user's head. A computer detects the physiological response based on: (i) imaging photoplethysmogram signals (iPPG signals) recognizable in the images, and (ii) correlations between the PPG signal and the iPPG signals.
Head-mounted displays (HMDs) are being used more and more for entertainment and work while traveling in vehicles. However, the use of an HMD can be risky in the event of a collision if it is not removed from the head in time. This disclosure describes HMDs that are dismantled automatically from the heads of passengers in vehicles. In one embodiment, an HMD includes a display module and a mount that includes a flexible piece and a stiff piece connected by a lock. The mount attaches the display module to a passenger's head while the pieces are connected. Upon receiving an indication of an imminent collision involving the vehicle, the lock disconnects the pieces such that the flexible piece stays on the head shortly after the disconnection, and the stiff piece is removed from the head shortly after the disconnection.
Described herein are embodiments of systems and a method to identify orthostatic hypotension and postural-orthostatic tachycardia syndrome. One system includes a head-mounted device configured to measure photoplethysmographic signal (PPG signal) at a region on a user's head, and a head-mounted camera configured to capture images indicative of the user's posture. Additionally, the system includes a computer that calculates systolic and diastolic blood pressure values based on the PPG signal, and identifies orthostatic hypotension based on a drop of systolic blood pressure below a first threshold, and/or a drop of diastolic blood pressure below a second threshold, within a predetermined duration from a transition in the posture from supine to sitting posture, or from sitting to standing posture.
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
A61B 5/0295 - Measuring blood flow using plethysmography, i.e. measuring the variations in the volume of a body part as modified by the circulation of blood therethrough, e.g. impedance plethysmography
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
A61B 5/08 - Measuring devices for evaluating the respiratory organs
A61B 5/1455 - Measuring characteristics of blood in vivo, e.g. gas concentration, pH-value using optical sensors, e.g. spectral photometrical oximeters
A61B 5/083 - Measuring rate of metabolism by using breath test, e.g. measuring rate of oxygen consumption
A61B 5/0295 - Measuring blood flow using plethysmography, i.e. measuring the variations in the volume of a body part as modified by the circulation of blood therethrough, e.g. impedance plethysmography
move, a coaching indication; and present, via a user interface, the coaching indication to the user. In one example, the coaching indication is indicative of a change the user should make to one or more of the following: cadence of movements, stride length, breathing rate, breathing type (mouth or nasal), and duration of exhales.
A61B 3/113 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for determining or recording eye movement
A61B 5/11 - Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
A61B 5/16 - Devices for psychotechnics; Testing reaction times
G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
G02B 7/00 - Mountings, adjusting means, or light-tight connections, for optical elements
G02B 13/14 - Optical objectives specially designed for the purposes specified below for use with infra-red or ultra-violet radiation
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
A61B 5/0205 - Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
A63B 71/06 - Indicating or scoring devices for games or players
A63B 23/18 - Exercising apparatus specially adapted for particular parts of the body for improving respiratory function
A63B 23/00 - Exercising apparatus specially adapted for particular parts of the body
A head mounted system (HMS) configured to collect facial expressions of the user wearing the HMS. The HMS includes a frame and at least four cameras coupled to the frame. First and second cameras capture the user's right and left eyebrows, and third and fourth cameras capture the right and left sides of the user's upper lip. An optional computer utilizes the images captured by the cameras to detect facial expressions, microexpressions, and/or to improve the user's emotional awareness.
ROI taken while the user was exposed to certain sensitive data, whether the user experienced the irregular physiological response while being exposed to the certain sensitive data.
A61B 3/113 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for determining or recording eye movement
A61B 5/0205 - Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
A61B 5/16 - Devices for psychotechnics; Testing reaction times
A61B 5/02 - Measuring pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography; Heart catheters for measuring blood pressure
22.
Calculating respiratory parameters from thermal measurements
ROI of the user taken during different days. Optionally, the respiratory parameter is indicative of the user's breathing rate. Optionally, the computer detects whether the user breathed primarily through the mouth or through the nose.
G16H 50/50 - ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for simulation or modelling of medical disorders
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
In order to enable collection of data from a head-mounted inward-facing camera, a clip-on device is attached to eyeglasses. The clip-on device optionally weighs less than 40 g and includes: (i) a body that may be attached and detached, multiple times, from a pair of eyeglasses in order to secure and release the clip-on device from the eyeglasses, (ii) an inward-facing camera fixed to the body, and (iii) a wireless communication module fixed to the body.
Some aspects of this disclosure involve head-mounted systems that are utilized to take thermal measurements of a user's face to detect various physiological responses, such as an allergic reaction, stress, a headache, a stroke, to name a few. Typically, these systems involve one or more head-mounted thermal cameras that may be physically coupled to a frame worn on the user's head and are utilized to take thermal measurements of one or more regions of interest (ROIs). Some of the systems described in this disclosure are intended for "real world", uncontrolled day-to-day use, in which detection of the physiological response may be hampered by "confounding factors". A confounding factor can be a cause of warming and/or cooling of certain ROIs the face, which is unrelated to a physiological response being detected, and as such, can reduce the accuracy of the detection of the physiological response.
A61M 21/02 - Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis for inducing sleep or relaxation, e.g. by direct nerve stimulation, hypnosis, analgesia
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
A61B 5/053 - Measuring electrical impedance or conductance of a portion of the body
A61M 21/00 - Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
27.
SYSTEMS AND METHODS TO DETECT STRESS, ALLERGY AND THERMAL ASYMMETRY
Collecting thermal measurements of various regions on a user's face can have many health-related (and other) applications. However, movements of the user and/or of the user's head can make acquiring this data difficult with many of the known approaches. Some embodiments described herein utilize various combinations of head-mounted thermal cameras, which may be physically coupled to a frame of a head-mounted system (HMS), in order to collect the thermal measurements. In one embodiment, the thermal measurements are utilized by a computer to detect a physiological response such as stress, an allergic reaction, a headache, a stroke, or an expression of a certain emotion (e.g., joy, fear, sadness, or anger).
Described herein are various embodiments of wearable systems that collect thermal measurements related to respiration and/or brain activity. The systems may optionally include a frame that is worn on a user's head, and at least one non-contact thermal camera that is physically coupled to the frame and located close to the user's face. In one embodiment, each thermal camera takes thermal measurements of at least one of: a portion of the right side of the user's upper lip, a portion of the left side of the user's upper lip, and a portion of the user's mouth. The thermal measurements used by a computer to calculate breathing related parameters, such as breathing rate, an extent to which the breathing was done through the mouth/nostrils, and ratio between exhaling and inhaling durations. In another embodiment, a thermal camera takes measurements of the forehead, which are indicative of brain activity of the user.
ROI1 taken while the user was not under elevated stress. Some embodiments may utilize additional thermal cameras that take thermal measurements of other regions on the face, which may be utilized to detect the stress level.
G06F 16/583 - Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
G06F 16/335 - Filtering based on additional data, e.g. user or group profiles
A61B 5/05 - Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves
G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
N of the user taken during different days. Some embodiments may utilize additional thermal cameras that take thermal measurements of other regions on the face, which may be utilized by the computer to generate additional feature values that are used to detect the allergic reaction. In some cases, detection of the allergic reaction may occur following a rise in nasal temperature, even before the user becomes aware of the allergic reaction.
ROI1, was higher than the effects of most of the potential stressors. Optionally, thermal measurements of other regions on the face may also be utilized to detect the extents of stress.
A61B 5/08 - Measuring devices for evaluating the respiratory organs
A61B 5/093 - Measuring volume of inspired or expired gases, e.g. to determine lung capacity the gases being exhaled into, or inhaled from, an expansible chamber, e.g. bellows or expansible bag
S, which are indicative of the SHAPE, and utilizes a model to select the state of the user, from among potential states of the user, based on the feature values. Optionally, the system includes a user interface that present the user's selected state.
ROI2 of the user taken during different days. Optionally, the physiological response is indicative of an occurrence of an emotional state of the user, such as joy, fear, sadness or anger.
One aspect of this disclosure involves a wearable device that includes a frame that is worn on a user's head, and an inward-facing camera (camera) physically coupled to the frame. The optical axis of the camera is either above the Frankfort horizontal plane and pointed upward to capture an image of a region of interest (ROI) above the user's eyes, or the optical axis is below the Frankfort horizontal plane and pointed downward to capture an image of an ROI below the user's eyes. The camera includes a sensor and a lens. The sensor plane is tilted by more than 2° relative to the lens plane according to the Scheimpflug principle in order to capture a sharper image. The Scheimpflug principle is a geometric rule that describes the orientation of the plane of focus of a camera when the lens plane is tilted relative to the sensor plane.
A wearable system configured to collect thermal measurements related to respiration. The system includes a frame configured to be worn on a user's head, and at least one non-contact thermal camera (e.g., thermopile or microbolometer based sensor). The thermal camera is small and lightweight, physically coupled to the frame, located close to the user's face, does not occlude any of the user's mouth and nostrils, and is configured to take thermal measurements of: a portion of the right side of the user's upper lip, a portion of the left side of the user's upper lip, and a portion of the user's mouth. The thermal measurements are forwarded to a computer that calculates breathing related parameters, such as breathing rate, an extent to which the breathing was done through the mouth, an extent to which the breathing was done through the nostrils, and ratio between exhaling and inhaling durations.
A61B 5/16 - Devices for psychotechnics; Testing reaction times
A61B 5/091 - Measuring volume of inspired or expired gases, e.g. to determine lung capacity
A61M 21/02 - Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis for inducing sleep or relaxation, e.g. by direct nerve stimulation, hypnosis, analgesia
A61B 5/0205 - Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
A61B 5/11 - Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
A61M 21/00 - Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
42.
Systems for collecting thermal measurements of the face
This disclosure describes various systems for collecting thermal measurements of regions of a user's face. Each of the systems includes a frame configured to be worn on the user's head, and one or more lightweight thermal cameras that are coupled to the frame and configured to take thermal measurements of a region of interest on the user's face. Due to their coupling to the frame, the thermal cameras remain pointed at their respective regions of interest even when the user's head performs angular movements. The thermal measurements collected by some embodiments of the systems described herein may be utilized for a variety of applications that involve detecting different types of physiological responses or medical disorders.
Wearable devices for taking symmetric thermal measurements. One device includes first and second thermal cameras physically coupled to a frame worn on a user's head. The first thermal camera takes thermal measurements of a first region of interest that covers at least a portion of the right side of the user's forehead. The second thermal camera takes thermal measurements of a second ROI that covers at least a portion of the left side of the user's forehead. Wherein the first and second thermal cameras are not in physical contact with their corresponding ROIs, and as a result of being coupled to the frame, the thermal cameras remain pointed at their corresponding ROIs when the user's head makes angular movements.
System and method for estimating posture of a user based on a model and images captured by at least two head-mounted cameras that are worn by the user and are oriented downward such that portions of the user's torso are in the respective fields of view of the cameras when the user stands up straight.
patents
