Embodiments disclosed herein utilize biometric verification from wearable devices to approve access for shared spaces. Requests to occupy the shared spaces are received and conditional reservations are made pending health checks of the requesters. Prior to occupation, fresh biometric measurements are captured via the user's wearable device, which include physiological signals validating both ongoing good health as well as identity match to the original requester. When recent biometric verification indicates both healthy status and unchanged identity, access to the reserved space is approved. These embodiments securely manage reservations while protecting the health of other occupants through conditional access related to the requester's current health condition.
G01J 5/12 - Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors using thermoelectric elements, e.g. thermocouples
2.
Image cropping based on eye position for a video-based eye tracker
Systems, methods, and computer programs for eye tracking. In one embodiment, an eye tracking system includes a head-mounted device that takes measurements indicative of a position of the eye of a user. A head-mounted camera captures an image of the eye. A computer calculates the position of the eye based on the measurements, utilizes the position of the eye to crop the image around the pupil, and provides a cropped image to a video-based eye tracker. Optionally, the size of the cropped image is less than a third of the size of its respective uncropped image. Optionally, the head-mounted device includes one or more of the following: a photosensor-oculography device (PSOG), an electrooculography device (EOG), an electromyography device (EMG), an optical flow sensor, and a range sensor. Optionally, the image-based eye tracker calculates, based on the cropped image, at least one of pupil diameter and pupillary response.
A61B 5/145 - Measuring characteristics of blood in vivo, e.g. gas concentration, pH-value
A61B 5/1455 - Measuring characteristics of blood in vivo, e.g. gas concentration, pH-value using optical sensors, e.g. spectral photometrical oximeters
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
G06V 40/16 - Human faces, e.g. facial parts, sketches or expressions
H04N 23/611 - Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
H04N 23/65 - Control of camera operation in relation to power supply
H04N 23/951 - Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
3.
Operating an eye tracker camera according to eye position
Systems, methods, and computer programs for efficient use of head-mounted cameras in eye tracking. In one embodiment, a system includes a head-mounted device that takes measurements indicative of positions of an eye of a user, and a head-mounted camera that captures images of the eye. A first range of eye positions trackable from the images is narrower than a second range of eye positions trackable from the measurements. A computer calculates the eye positions based on the measurements. When the eye positions fall within the first range, the computer reads images at a first bitrate from the head-mounted camera. And when the eye positions fall outside the first range, the computer refrains from reading images from the head-mounted camera, or reads the images from the head-mounted camera at a second bitrate that is less than half the first bitrate.
A61B 5/145 - Measuring characteristics of blood in vivo, e.g. gas concentration, pH-value
A61B 5/1455 - Measuring characteristics of blood in vivo, e.g. gas concentration, pH-value using optical sensors, e.g. spectral photometrical oximeters
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
G06V 40/16 - Human faces, e.g. facial parts, sketches or expressions
H04N 23/611 - Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
H04N 23/65 - Control of camera operation in relation to power supply
H04N 23/951 - Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
4.
Efficient image capturing based on eyelid position
Systems, methods, and computer programs for eye tracking involving a camera that is operated according to eyelid position. In one embodiment, an inward-facing head-mounted camera captures images of an eye. A head-mounted device emits electromagnetic waves towards the eye and measures reflections of these waves from the eye. The average rate of reflection measurements is at least ten times the average rate of image capture. A computer detects the position of at least one of the eyelids covering the eye based on the reflection measurements. And the camera operation is adjusted according to the eyelid position in a manner that decreases, in the captured images, areas depicting the eyelids, and optionally increases areas depicting the iris.
A61B 5/145 - Measuring characteristics of blood in vivo, e.g. gas concentration, pH-value
A61B 5/1455 - Measuring characteristics of blood in vivo, e.g. gas concentration, pH-value using optical sensors, e.g. spectral photometrical oximeters
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
G06V 40/16 - Human faces, e.g. facial parts, sketches or expressions
H04N 23/611 - Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
H04N 23/65 - Control of camera operation in relation to power supply
H04N 23/951 - Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
5.
Using a camera to compensate for sensor-shift in a photosensor-based facial expression detector
Disclosed herein is photosensor-based detection of facial landmarks that utilizes images in order to detect and account for sensor shifts. In one embodiment, a system that detects positions of facial landmarks includes a head-mounted device comprising: (i) light sources that emit light towards a first region on a user’s face, and (ii) discrete photosensors, spread over more than 2 cm, which take measurements of reflections of the light from the first region. The system also includes a head-mounted camera that captures images of a second region on the face. A computer calculates, based on the images, values indicative of a location and/or orientation of the device relative to the face, and detects, based on the reflections and the values, positions of facial landmarks at an average rate higher than an average rate at which the images are captured.
A61B 5/145 - Measuring characteristics of blood in vivo, e.g. gas concentration, pH-value
A61B 5/1455 - Measuring characteristics of blood in vivo, e.g. gas concentration, pH-value using optical sensors, e.g. spectral photometrical oximeters
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
G06V 40/16 - Human faces, e.g. facial parts, sketches or expressions
H04N 23/611 - Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
H04N 23/65 - Control of camera operation in relation to power supply
H04N 23/951 - Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
Disclosed herein is robust detection of facial expressions that accounts for interferences on the face. In one embodiment, a system includes a head-mounted device that comprises (i) light sources configured to emit light towards a first region on a user's face, and (ii) discrete photosensors, spread over more than 2 cm, which take measurements of reflections of the light from the first region. Additionally, the system includes a head-mounted camera that captures images of a second region on the face. A computer calculates, based on the images, an extent of presence of hair over a portion of the first region. Optionally, the computer calculates extents of other interferences such as perspiration, applied makeup, and skin infection. The computer then detects facial expressions of the user based on the measurements of the reflections and the calculated extent of the hair and/or other interferences.
A61B 5/145 - Measuring characteristics of blood in vivo, e.g. gas concentration, pH-value
A61B 5/1455 - Measuring characteristics of blood in vivo, e.g. gas concentration, pH-value using optical sensors, e.g. spectral photometrical oximeters
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
H04N 5/347 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled by combining or binning pixels in SSIS
7.
Controlling an eye tracking camera according to eye movement velocity
Disclosed herein is utilization of photosensor-oculography along with a video camera to implement a novel form of eye tracking, which can be important for many applications, such as augmented reality (AR) on smartglasses. In one embodiment, an eye tracking system includes a photosensor-oculography device (PSOG) that emits light and takes measurements of reflections of the light from an eye of a user, and a camera that captures images of the eye. A computer calculates values indicative of eye movement velocity (EMV) based on the measurements of the reflections obtained by the PSOG. These values then are used to determine how data is read from the camera, which can save power in some cases: the computer reads data from the camera at a higher bitrate when the values are indicative of the EMV are below a threshold compared to when the values are indicative of the EMV are above the threshold.
A61B 5/145 - Measuring characteristics of blood in vivo, e.g. gas concentration, pH-value
A61B 5/1455 - Measuring characteristics of blood in vivo, e.g. gas concentration, pH-value using optical sensors, e.g. spectral photometrical oximeters
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
G06V 40/16 - Human faces, e.g. facial parts, sketches or expressions
H04N 23/611 - Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
H04N 23/65 - Control of camera operation in relation to power supply
H04N 23/951 - Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
H04N 25/46 - Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by combining or binning pixels
8.
Smart windowing to reduce power consumption of a head-mounted camera used for iPPG
Disclosed herein is utilization of windowing for efficient capturing of imaging photoplethysmogram signals (iPPG signals) with head-mounted cameras (e.g., cameras mounted to frames of smartglasses). In order to save power involved in obtaining iPPG signals, in one embodiment, a head-mounted camera with an image sensor that supports changing of its region of interest (ROI) is utilized to capture images of a region comprising skin on a user's head. A computer calculates quality scores for iPPG signals extracted from windows in the images, and selects a proper subset of the iPPG signals whose quality scores reach a threshold. The computer then reads from the camera at least one ROI that covers one or more of the windows from which the proper subset of the iPPG signals is extracted. Optionally, the at least one ROI read from the camera covers below 75% of the skin region's area.
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
A61B 5/145 - Measuring characteristics of blood in vivo, e.g. gas concentration, pH-value
A61B 5/1455 - Measuring characteristics of blood in vivo, e.g. gas concentration, pH-value using optical sensors, e.g. spectral photometrical oximeters
A61B 5/0205 - Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
A novel design for untethered smartglasses with wireless connectivity in which electronic components and electric wiring are mounted in a manner than enables at least a portion of temples of the smartglasses to be bent around the ear to improve the smartglasses' fit. In one embodiment, the smartglasses include a front element that supports lenses and two temples, coupled to the front element through hinges that enable folding and unfolding. At least one of the temples includes: a first portion coupled to the front element with first electronic components, a second portion coupled to the first portion with electric wires, and a third portion coupled to the second portion with second electronic components. The second portion is designed to be bent around a human ear to improve the smartglasses' fit, and the first and third portions are not designed to be bent to improve the smartglasses' fit.
Due to the many interactions that can occur in places of gatherings, such as workplaces, schools, theaters, etc., these locations can be considered dangerous to enter during times of epidemics. It is difficult to keep track of the health state of all the people who visited a location, and thus ascertain if visits to the location pose any risk of contracting a disease. Some embodiments disclosed herein utilize wearable devices that measure physiological signals of their wearer in order to determine whether people who were at a location were healthy, and thus be able to certify the location as contagion-safe.
G16H 50/80 - ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for detecting, monitoring or modelling epidemics or pandemics, e.g. flu
G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
G16H 50/30 - ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for individual health risk assessment
G06F 1/16 - Constructional details or arrangements
11.
Wearable-based health state verification for physical access authorization
Embodiments disclosed herein involve a wearable-based system that can help determine in a privacy-preserving manner whether a user is healthy (and thus poses low risk of contagiousness), and use determinations of this nature to grant passage through a doorway. In one embodiment, a wearable device takes measurements of a user comprising a photoplethysmogram signal (PPG signal) and a temperature measurement. A computer calculates a health score based on a difference between baseline measurements of the user, measured one or more days earlier, and more current measurements of the user. Additionally, the computer calculates an extent of similarity between characteristics of the PPG signal in the current measurements and characteristics of the PPG signal in the baseline measurements. The computer authorizes the user's passage through the doorway responsive to the health score reaching a first threshold and the extent of the similarity reaching a second threshold.
A61B 5/16 - Devices for psychotechnics; Testing reaction times
G01J 5/12 - Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors using thermoelectric elements, e.g. thermocouples
Disclosed herein is a doorway that facilitates passage from an inside to an outside, and which includes a barrier that moves between opened and closed positions based on commands sent by a computer. Sensors measure signals indicating whether a first user is on the outside, and whether a second user on the inside. The computer detects that the first user is on the outside and receives, from a device of the first user, an indication indicating the first user is healthy. The computer detects whether the second user is on the inside, and commands the barrier to move to the opened position if: (i) the second user is not on the inside, or (ii) the second user is on the inside and the computer receives, from a device of the second user, an indication indicating the second user is healthy.
A61B 5/16 - Devices for psychotechnics; Testing reaction times
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
G01J 5/12 - Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors using thermoelectric elements, e.g. thermocouples
Described herein are embodiments of systems and methods for calculating glucose in a non-invasive manner using head-mounted sensors. In one embodiment, a system that calculates blood glucose levels includes a head-mounted contact photoplethysmography device that measures a signal indicative of a photoplethysmogram signal (PPG signal) at a first region comprising skin on a user's head, and a head-mounted camera configured to capture images of a second region comprising skin on the user's head. The system also includes a computer that identifies, based on the PPG signal, times of systolic notches and times of systolic peaks, and calculates the blood glucose level based on differences between a first subset of the images taken during the times of systolic notches and a second subset of the images taken during the times of systolic peaks. Optionally, the photoplethysmography device and the camera are couple to smartglasses worn on the user's head.
G01J 5/12 - Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors using thermoelectric elements, e.g. thermocouples
A61B 5/16 - Devices for psychotechnics; Testing reaction times
A61B 5/145 - Measuring characteristics of blood in vivo, e.g. gas concentration, pH-value
G01J 5/00 - Radiation pyrometry, e.g. infrared or optical thermometry
A61B 5/1477 - Measuring characteristics of blood in vivo, e.g. gas concentration, pH-value using chemical or electrochemical methods, e.g. by polarographic means non-invasive
G01J 5/12 - Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors using thermoelectric elements, e.g. thermocouples
Described herein are embodiments of systems and methods that utilize images of a user's face to detect fever and intoxication. One embodiment of a system to detect fever includes first and second inward-facing head-mounted cameras that are located less than 5 cm from a user's face, are sensitive to wavelengths below 1050 nanometer, and are configured to capture images of respective first and second regions on the user's face. The system also includes a computer that calculates, based on baseline images captured with the cameras while the user did not have a fever, a baseline pattern of hemoglobin concentrations at regions on the face. The computer also calculates, based on a current set of images captured with the cameras, a current pattern of hemoglobin concentrations at the regions, and detects whether the user has a fever based on a deviation of the current pattern from the baseline pattern.
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
G01J 5/12 - Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors using thermoelectric elements, e.g. thermocouples
Detecting a respiratory tract infection (RTI) based on changes in coughing sounds, which can provide an early warning of infection with a disease like COVID-19, as well as indications of its progression and severity. In one embodiment, the system includes smartglasses, with sensors mounted thereto, which include an acoustic sensor mounted at a fixed position relative to a user's head, and a movement sensor. A computer receives current measurements of the user, taken with the sensors, while there were head movements that characterize coughing, and also earlier measurements of the user, taken with the sensors, while the user had a known extent of the RTI and while there were head movements that characterize coughing. The computer detects a change relative to the known extent of the RTI based on a difference between the current measurements and the earlier measurements.
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
G01J 5/12 - Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors using thermoelectric elements, e.g. thermocouples
A61B 5/16 - Devices for psychotechnics; Testing reaction times
Systems for calculating extent of congestive heart failure (CHF) and/or identifying exacerbation of CHF. In one embodiment, a system includes smartglasses configured to be worn on a user's head, and an inward-facing camera and a sensor, both physically coupled to the smartglasses. The inward-facing camera is mounted more than 5 mm away from the head and captures images of an area comprising skin on the user's head, which is larger than 4 cm{circumflex over ( )}2. The sensor measures a signal indicative of a respiration rate of the user (respiration signal). The system also includes a computer that calculates the extent of CHF based on: a facial blood flow pattern recognizable in the images, and respiration rate recognizable in the respiration signal.
G01J 5/12 - Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors using thermoelectric elements, e.g. thermocouples
A hygienic in-vehicle head-mounted display (HMD) includes: a head piece, a stiff module, and a lock that connects and disconnects the head piece and the stiff module. The head piece is in direct physical contact with the passenger's face. The stiff module includes a display module that projects video into eyes of a passenger of a vehicle while the HMD is worn by the passenger. In one embodiment, a storage module may be used to stow the stiff module. Optionally, the storage module releases the stiff module responsive to the head piece being connected to the stiff module. In another embodiment, a processor instructs the display module to project video responsive to an indication that the head piece and the stiff module are connected, and instructs the display module not to project the video, responsive to an indication that the head piece and the stiff module are not connected.
B60R 1/00 - Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
B60Q 9/00 - Arrangement or adaptation of signal devices not provided for in one of main groups
19.
Eyeglasses to detect abnormal medical events including stroke and migraine
System and Method to detect an abnormal medical event based on an asymmetrical change to blood flow. The system includes right-side and left-side head-mounted devices to measure signals indicative of photoplethysmographic signals (PPG signals) on the right and left sides of a user's head, and a computer that detects the abnormal medical event based on an asymmetrical change to blood flow recognizable in the PPG signals. Optionally, the asymmetrical change to the blood flow corresponds to a deviation of the PPG signals compared to a baseline that is based on previous measurements of PPG signals of the user, taken before the abnormal medical event.
G01J 5/12 - Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors using thermoelectric elements, e.g. thermocouples
Head-mounted displays (HMDs) are being used more and more for entertainment and work while traveling in vehicles. However, the use of an HMD can be risky in the event of a collision. This disclosure describes a safety system comprising a head-mounted display (HMD) configured to be worn on a passenger's head while traveling in an automated on-road vehicle, a folded airbag, fixed to the HMD, and an inflation system fixed to the vehicle and connected to the folded airbag through a flexible hose. The flexible hose is configured to convey as generated by the inflation system. The system may further detach the flexible hose from the inflation system after the inflation, such that the airbag is no longer connected to the inflation system shortly after the inflation.
B60Q 9/00 - Arrangement or adaptation of signal devices not provided for in one of main groups
B60R 1/00 - Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
21.
Detecting a transient ischemic attack using photoplethysmogram signals
G01J 5/12 - Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors using thermoelectric elements, e.g. thermocouples
A61B 5/16 - Devices for psychotechnics; Testing reaction times
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
Disclosed herein are systems and methods for detecting a physiological response using different types of photoplethysmography sensors. Examples of physiological responses that may be detected include an allergic reaction, a stroke, a migraine, stress, certain emotional responses, manifestation of pain, and blood pressure. In one embodiment, a head-mounted contact photoplethysmography device measures a signal indicative of photoplethysmogram signal at a first region that includes exposed skin on a user's head (PPG signal). A camera, located more than 10 mm away from the user's head, captures images of a second region that includes exposed skin on the user's head. A computer detects the physiological response based on: (i) imaging photoplethysmogram signals (iPPG signals) recognizable in the images, and (ii) correlations between the PPG signal and the iPPG signals.
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
G01J 5/12 - Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors using thermoelectric elements, e.g. thermocouples
Head-mounted displays (HMDs) are being used more and more for entertainment and work while traveling in vehicles. However, the use of an HMD can be risky in the event of a collision if it is not removed from the head in time. This disclosure describes HMDs that are dismantled automatically from the heads of passengers in vehicles. In one embodiment, an HMD includes a display module and a mount that includes a flexible piece and a stiff piece connected by a lock. The mount attaches the display module to a passenger's head while the pieces are connected. Upon receiving an indication of an imminent collision involving the vehicle, the lock disconnects the pieces such that the flexible piece stays on the head shortly after the disconnection, and the stiff piece is removed from the head shortly after the disconnection.
B60Q 9/00 - Arrangement or adaptation of signal devices not provided for in one of main groups
B60R 1/00 - Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
24.
Identification of posture-related syncope using head-mounted sensors
Described herein are embodiments of systems and a method to identify orthostatic hypotension and postural-orthostatic tachycardia syndrome. One system includes a head-mounted device configured to measure photoplethysmographic signal (PPG signal) at a region on a user's head, and a head-mounted camera configured to capture images indicative of the user's posture. Additionally, the system includes a computer that calculates systolic and diastolic blood pressure values based on the PPG signal, and identifies orthostatic hypotension based on a drop of systolic blood pressure below a first threshold, and/or a drop of diastolic blood pressure below a second threshold, within a predetermined duration from a transition in the posture from supine to sitting posture, or from sitting to standing posture.
G01J 5/12 - Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors using thermoelectric elements, e.g. thermocouples
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
A61B 5/0295 - Measuring blood flow using plethysmography, i.e. measuring the variations in the volume of a body part as modified by the circulation of blood therethrough, e.g. impedance plethysmography
A head mounted system (HMS) configured to collect facial expressions of the user wearing the HMS. The HMS includes a frame and at least four cameras coupled to the frame. First and second cameras capture the user's right and left eyebrows, and third and fourth cameras capture the right and left sides of the user's upper lip. An optional computer utilizes the images captured by the cameras to detect facial expressions, microexpressions, and/or to improve the user's emotional awareness.
A61B 5/16 - Devices for psychotechnics; Testing reaction times
G01J 5/12 - Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors using thermoelectric elements, e.g. thermocouples
ROI taken while the user was exposed to certain sensitive data, whether the user experienced the irregular physiological response while being exposed to the certain sensitive data.
A61B 3/113 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for determining or recording eye movement
A61B 5/0205 - Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
G01J 5/00 - Radiation pyrometry, e.g. infrared or optical thermometry
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
A61B 5/16 - Devices for psychotechnics; Testing reaction times
A61B 5/02 - Measuring pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography; Heart catheters for measuring blood pressure
32.
Calculating respiratory parameters from thermal measurements
ROI of the user taken during different days. Optionally, the respiratory parameter is indicative of the user's breathing rate. Optionally, the computer detects whether the user breathed primarily through the mouth or through the nose.
G16H 50/50 - ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for simulation or modelling of medical disorders
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
In order to enable collection of data from a head-mounted inward-facing camera, a clip-on device is attached to eyeglasses. The clip-on device optionally weighs less than 40 g and includes: (i) a body that may be attached and detached, multiple times, from a pair of eyeglasses in order to secure and release the clip-on device from the eyeglasses, (ii) an inward-facing camera fixed to the body, and (iii) a wireless communication module fixed to the body.
A61M 21/02 - Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis for inducing sleep or relaxation, e.g. by direct nerve stimulation, hypnosis, analgesia
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
A61B 5/053 - Measuring electrical impedance or conductance of a portion of the body
A61M 21/00 - Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
36.
Detecting stress based on thermal measurements of the face
ROI1 taken while the user was not under elevated stress. Some embodiments may utilize additional thermal cameras that take thermal measurements of other regions on the face, which may be utilized to detect the stress level.
G01J 5/00 - Radiation pyrometry, e.g. infrared or optical thermometry
G06F 16/583 - Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
G06F 16/335 - Filtering based on additional data, e.g. user or group profiles
A61B 5/05 - Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves
G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
N of the user taken during different days. Some embodiments may utilize additional thermal cameras that take thermal measurements of other regions on the face, which may be utilized by the computer to generate additional feature values that are used to detect the allergic reaction. In some cases, detection of the allergic reaction may occur following a rise in nasal temperature, even before the user becomes aware of the allergic reaction.
ROI1, was higher than the effects of most of the potential stressors. Optionally, thermal measurements of other regions on the face may also be utilized to detect the extents of stress.
A61B 5/08 - Measuring devices for evaluating the respiratory organs
A61B 5/093 - Measuring volume of inspired or expired gases, e.g. to determine lung capacity the gases being exhaled into, or inhaled from, an expansible chamber, e.g. bellows or expansible bag
S, which are indicative of the SHAPE, and utilizes a model to select the state of the user, from among potential states of the user, based on the feature values. Optionally, the system includes a user interface that present the user's selected state.
ROI2 of the user taken during different days. Optionally, the physiological response is indicative of an occurrence of an emotional state of the user, such as joy, fear, sadness or anger.
G01J 5/12 - Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors using thermoelectric elements, e.g. thermocouples
One aspect of this disclosure involves a wearable device that includes a frame that is worn on a user's head, and an inward-facing camera (camera) physically coupled to the frame. The optical axis of the camera is either above the Frankfort horizontal plane and pointed upward to capture an image of a region of interest (ROI) above the user's eyes, or the optical axis is below the Frankfort horizontal plane and pointed downward to capture an image of an ROI below the user's eyes. The camera includes a sensor and a lens. The sensor plane is tilted by more than 2° relative to the lens plane according to the Scheimpflug principle in order to capture a sharper image. The Scheimpflug principle is a geometric rule that describes the orientation of the plane of focus of a camera when the lens plane is tilted relative to the sensor plane.
A wearable system configured to collect thermal measurements related to respiration. The system includes a frame configured to be worn on a user's head, and at least one non-contact thermal camera (e.g., thermopile or microbolometer based sensor). The thermal camera is small and lightweight, physically coupled to the frame, located close to the user's face, does not occlude any of the user's mouth and nostrils, and is configured to take thermal measurements of: a portion of the right side of the user's upper lip, a portion of the left side of the user's upper lip, and a portion of the user's mouth. The thermal measurements are forwarded to a computer that calculates breathing related parameters, such as breathing rate, an extent to which the breathing was done through the mouth, an extent to which the breathing was done through the nostrils, and ratio between exhaling and inhaling durations.
A61B 5/16 - Devices for psychotechnics; Testing reaction times
A61B 5/091 - Measuring volume of inspired or expired gases, e.g. to determine lung capacity
A61M 21/02 - Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis for inducing sleep or relaxation, e.g. by direct nerve stimulation, hypnosis, analgesia
A61B 5/0205 - Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
A61B 5/11 - Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
A61M 21/00 - Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
49.
Systems for collecting thermal measurements of the face
This disclosure describes various systems for collecting thermal measurements of regions of a user's face. Each of the systems includes a frame configured to be worn on the user's head, and one or more lightweight thermal cameras that are coupled to the frame and configured to take thermal measurements of a region of interest on the user's face. Due to their coupling to the frame, the thermal cameras remain pointed at their respective regions of interest even when the user's head performs angular movements. The thermal measurements collected by some embodiments of the systems described herein may be utilized for a variety of applications that involve detecting different types of physiological responses or medical disorders.
G01J 5/12 - Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors using thermoelectric elements, e.g. thermocouples
Wearable devices for taking symmetric thermal measurements. One device includes first and second thermal cameras physically coupled to a frame worn on a user's head. The first thermal camera takes thermal measurements of a first region of interest that covers at least a portion of the right side of the user's forehead. The second thermal camera takes thermal measurements of a second ROI that covers at least a portion of the left side of the user's forehead. Wherein the first and second thermal cameras are not in physical contact with their corresponding ROIs, and as a result of being coupled to the frame, the thermal cameras remain pointed at their corresponding ROIs when the user's head makes angular movements.
G01J 5/12 - Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors using thermoelectric elements, e.g. thermocouples
System and method for estimating posture of a user based on a model and images captured by at least two head-mounted cameras that are worn by the user and are oriented downward such that portions of the user's torso are in the respective fields of view of the cameras when the user stands up straight.
A61B 5/16 - Devices for psychotechnics; Testing reaction times
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
G01J 5/12 - Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors using thermoelectric elements, e.g. thermocouples
patents
