G06F 1/16 - Constructional details or arrangements
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 5/10 - Methods or arrangements for data conversion without changing the order or content of the data handled for changing the speed of data flow, i.e. speed regularising having a sequence of storage locations each being individually accessible for both enqueue and dequeue operations, e.g. using random access memory
G06T 19/20 - Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
G09G 3/3208 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED] organic, e.g. using organic light-emitting diodes [OLED]
G09G 3/3225 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED] organic, e.g. using organic light-emitting diodes [OLED] using an active matrix
G09G 3/3233 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED] organic, e.g. using organic light-emitting diodes [OLED] using an active matrix with pixel circuitry controlling the current through the light-emitting element
Methods and systems for presenting digital content on a see-through display are disclosed. In some embodiments, the digital content is presented based on a display attribute associated with personal information related to a user of a wearable head device comprising the see-through display. In some embodiments, the digital content is associated with a geo-spatial location of a physical structure, and presenting the digital content on the see-through display comprises indicating a spatial relationship between the digital content and the physical structure.
H04L 51/222 - Monitoring or handling of messages using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area
H04L 51/224 - Monitoring or handling of messages providing notification on incoming messages, e.g. pushed notifications of received messages
Aspects of the present invention relate to speaker assemblies for head worn computers, including speaker assemblies in a temple portion of a head-worn computer.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
A63F 13/00 - Video games, i.e. games using an electronically generated display having two or more dimensions
G06F 1/16 - Constructional details or arrangements
G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 3/038 - Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
G06F 3/00 - Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
G06T 19/00 - Manipulating 3D models or images for computer graphics
G06V 10/147 - Optical characteristics of the device performing the acquisition or on the illumination arrangements - Details of sensors, e.g. sensor lenses
G06V 10/22 - Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
Aspects of the present disclosure relate to haptic feedback systems and methods for use in head-worn computing systems. A head worn computer includes a frame adapted to hold a computer display in front of a user's eye, a processor adapted to present digital content in the computer display and to produce a haptic signal in coordination with the digital content display, and a haptic system including a plurality of haptic segments, wherein each of the haptic segments is individually controlled in coordination with the haptic signal.
G06T 19/00 - Manipulating 3D models or images for computer graphics
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G02B 26/08 - Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
G02B 27/28 - Optical systems or apparatus not provided for by any of the groups , for polarising
G06F 1/16 - Constructional details or arrangements
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
G06F 3/00 - Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
Head-worn computers include a front frame mechanically adapted to secure a see-through computer display and an arm, secured to the front frame, mechanically adapted to secure the front frame to a head of a user. The arm includes an internal speaker system, enclosed by the arm, wherein the internal speaker system comprises a speaker having a first side and an opposing second side and a first cavity positioned along the first side of the speaker, the arm further comprising a vent positioned to vent the first cavity and a second cavity positioned along the second side of the speaker.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
H04R 1/28 - Transducer mountings or enclosures designed for specific frequency response; Transducer enclosures modified by provision of mechanical or acoustic impedances, e.g. resonator, damping means
G06F 1/16 - Constructional details or arrangements
G06F 3/038 - Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form
Embodiments of the present disclosure relate to a head-worn apparatus, comprising: a frame adapted to be mounted to a head of a user; a light emitting system positioned within the frame to provide light to an eye of the user; a sound system adapted to provide audio to the user; a haptic system positioned within the frame to provide haptic feedback to the user; and a processor adapted to control the lighting system, audio system and haptic system in a coordinated pattern of light, sound and haptics that causes a mental-health therapeutic stimulus provided to the user, whereby the user experiences an improvement in mental performance based on the coordinated pattern.
G06F 3/044 - Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
G06F 3/038 - Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
10.
TEMPLE AND EAR HORN ASSEMBLY FOR HEADWORN COMPUTER
Aspects of the present invention relate to a head-worn computer having a see-through computer display, a frame mechanically adapted to hold the see-through computer, a first side arm pivotally attached to the frame and adapted to hold the head-worn computer in place on a head of the user, wherein the first side arm comprises a temple section and an ear horn section and the temple section further comprising a compartment adapted to contain a battery, wherein the battery powers the see-through computer display.
Aspects of the present invention relate to methods and devices for receiving and presenting content. In an example method, content is received, the content to be delivered to a plurality of recipients. Each recipient of the plurality of recipients has a preference for a respective first physical location at which the content is to be presented on a display of a wearable head device associated with the recipient. A sender of the content has a preference for a second physical location at which the content is to be presented to the respective recipient of the plurality of recipients. A respective final physical location for the presentation of the content for the respective recipient of the plurality of recipients is identified. The respective final physical location is based on the respective recipient's preference and the sender's preference. It is determined whether the respective recipient is proximate to a zone associated with the respective final physical location. In accordance with a determination that the respective recipient is proximate to the zone, an alert is generated on the wearable head device, the alert associated with the respective final physical location. It is determined whether the respective recipient is in the zone associated with the respective final physical location. In accordance with a determination that the respective recipient is in the zone, the content is caused to be presented to the respective recipient of the plurality of recipients.
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06T 19/20 - Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
G09G 5/00 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
H04L 51/222 - Monitoring or handling of messages using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area
H04L 51/224 - Monitoring or handling of messages providing notification on incoming messages, e.g. pushed notifications of received messages
Aspects of the present disclosure relate to a computer display stray-light suppression system for a head-worn computer comprising an eye cover including a flexible material with a perimeter, wherein the perimeter is formed to substantially encapsulate an eye of a person, and the eye cover including an attachment system adapted to removably and replaceably attach to a perimeter of the head-worn computer to suppress light emitted from a computer display in the head-worn computer.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 1/16 - Constructional details or arrangements
G06F 5/10 - Methods or arrangements for data conversion without changing the order or content of the data handled for changing the speed of data flow, i.e. speed regularising having a sequence of storage locations each being individually accessible for both enqueue and dequeue operations, e.g. using random access memory
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 1/16 - Constructional details or arrangements
G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form
G06F 3/038 - Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
Aspects of the present invention relate to methods and systems for imaging, recognizing, and tracking of a user's eye that is wearing a HWC. Aspects further relate to the processing of images reflected from the user's eye and controlling displayed content in accordance therewith.
A61B 3/14 - Arrangements specially adapted for eye photography
A61B 3/00 - Apparatus for testing the eyes; Instruments for examining the eyes
G06F 3/038 - Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 1/16 - Constructional details or arrangements
G06F 3/00 - Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form
G06F 3/042 - Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
A removable lens for glasses includes an electrochromic layer adapted to transition between at least two states of a transparency level dependent on an electrical condition applied to the electrochromatic layer and an electrical connection element physically adapted to make an electrical connection with the electrochromic layer, wherein the electrical connection element is positioned to align with a variable-power electrode mounted on the glasses such that, when the removable lens is mounted on the glasses, the variable-power electrode and the electrical connection element make the electrical connection between the variable-power electrode and an electrically conductive layer of the electrochromic layer.
Aspects of the present disclosure relate to modular expansion systems for use in head-worn computing systems. In an head-worn computer, an electrical connector is adapted to electrically connect with a modular expansion module, wherein the modular expansion module adds a capability to the head-worn computer and is removeably mounted to the head-worn computer, and a mount is adapted to physically secure the modular expansion module to the head-worn computer.
Head-worn computers with eye-imaging systems include a camera system positioned in a head-worn computer, wherein the camera system is further positioned to capture eye-image light that originates as reflections from a user's eye, wherein the camera system is further positioned to capture eye-image light as a reflection from a partially reflective surface that is positioned in front of an image display in the head-worn computer, wherein image light, from the image display, is transmitted through the partially reflective surface. A processor is adapted to cause the camera system to capture the eye-image light. The processor is further adapted to cause a comparison of the captured eye-image light with a pre-stored eye image of a known user of the head-worn computer. In the event the comparison confirms the identity of the known user, the user is granted permission to view content to be presented in a display of the head-worn computer.
A61B 3/14 - Arrangements specially adapted for eye photography
A61B 3/113 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for determining or recording eye movement
A61B 3/00 - Apparatus for testing the eyes; Instruments for examining the eyes
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
A61B 3/12 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for looking at the eye fundus, e.g. ophthalmoscopes
G06F 21/10 - Protecting distributed programs or content, e.g. vending or licensing of copyrighted material
G06F 21/32 - User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
An apparatus includes an eye cover adapted to be removably mounted on a head-worn computer with a see-through computer display and a flexible audio headset mounted to the eye cover. The flexible audio headset is mounted to the eye cover with a magnetic connection.
G02B 7/00 - Mountings, adjusting means, or light-tight connections, for optical elements
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
G06F 1/16 - Constructional details or arrangements
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
Aspects of the present invention relate to providing see-through computer display optics with improved content presentation. The see-through computer display includes an ambient light sensor adapted to measure environmental scene light in an area that forms the background for digital content presented in the see-through computer display, and a processor adapted to invert a color channel parameter of the digital content based on data from the ambient light sensor.
G09G 5/02 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the way in which colour is displayed
Aspects of the present invention relate to providing assistance to medical professionals during the performance of medical procedures through the use of technologies facilitated through a head-worn computer.
A61B 1/00 - Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
G06T 19/00 - Manipulating 3D models or images for computer graphics
A61B 17/00 - Surgical instruments, devices or methods, e.g. tourniquets
A61B 5/11 - Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
A61B 3/113 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for determining or recording eye movement
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
A61B 34/20 - Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
A61B 90/00 - Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups , e.g. for luxation treatment or for protecting wound edges
A61B 90/50 - Supports for surgical instruments, e.g. articulated arms
G06V 40/18 - Eye characteristics, e.g. of the iris
25.
SEE-THROUGH COMPUTER DISPLAY SYSTEMS WITH STRAY LIGHT MANAGEMENT
Aspects of the present invention relate to methods and systems for the see through computer display systems. In embodiments, the systems and methods use curved display panels to generate image light.
Aspects of the present disclosure relate to optical systems with ergonomic presentation of content for use in head-worn computing systems. A method for controlling a head-worn computer when viewing virtual images, including image content, that encourages an ergonomic head position to reduce neck pain, includes determining an angle of the head-worn computer relative to horizontal, determining an angle of a line of sight to the center of the virtual image as presented to a user's eye, determining a deviation between the determined angle of the line of sight and a predetermined ergonomic angle, and shifting the image content of the virtual image vertically as displayed to the user's eye so that a portion of the image content is not viewable, wherein the amount of shifting is in reverse correspondence to the magnitude of the determined deviation.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
G06T 3/40 - Scaling of a whole image or part thereof
G06T 3/00 - Geometric image transformation in the plane of the image
G06F 1/16 - Constructional details or arrangements
G06T 7/73 - Determining position or orientation of objects or cameras using feature-based methods
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
27.
MEASURING CONTENT BRIGHTNESS IN HEAD WORN COMPUTING
Aspects of the present invention relate to methods and systems for measuring and managing the brightness of digital content in a field of view of a head-worn computer.
G09G 5/00 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G01J 1/32 - Photometry, e.g. photographic exposure meter by comparison with reference light or electric value intensity of the measured or reference value being varied to equalise their effects at the detector, e.g. by varying incidence angle using variation of intensity or distance of source using electric radiation detectors adapted for automatic variation of the measured or reference value
G06F 3/00 - Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form
G09G 3/00 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
G09G 5/02 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the way in which colour is displayed
Systems and methods relating to displaying images are disclosed. In one embodiment, sensor data is received via one or more sensors of a wearable head device comprising a display, the sensor data indicative of a surrounding environment of a user of the wearable head device. An image can be determined based on the sensor data, the image corresponding to the surrounding environment. A visibility of a first portion of the image corresponding to a first portion of the surrounding environment can be enhanced. Enhancing a visibility of a second portion of the image corresponding to a second portion of the surrounding environment can be forgone. The enhanced first portion of the image and a view of the second portion of the surrounding environment can be presented concurrently via the display of the wearable head device.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/04815 - Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
G06T 3/40 - Scaling of a whole image or part thereof
G06T 11/60 - Editing figures and text; Combining figures or text
G06V 10/22 - Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
G06V 20/20 - Scenes; Scene-specific elements in augmented reality scenes
G06V 20/62 - Text, e.g. of license plates, overlay texts or captions on TV images
Disclosure herein concerns a method that includes illuminating a user's eye with an illumination source in a head-worn display, capturing an image of the user's eye with an eye camera in the head-worn display, wherein the image includes an eye glint produced by light from the illumination source that is reflected from a surface of the user's eye, determining a size of an eye glint in the captured image, and identifying a change in focus distance for the user's eye in correspondence with a change in the size of the eye glint.
G06F 1/16 - Constructional details or arrangements
G06F 3/00 - Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
G06V 20/20 - Scenes; Scene-specific elements in augmented reality scenes
G06V 30/142 - Image acquisition using hand-held instruments; Constructional details of the instruments
A see-through head mounted display with controllable light blocking includes an optics module comprising a light source and image source positioned on a same side of an angled partially-reflective surface, wherein the light source projects light off the surface to the image source which reflects the light as image light to the surface which transmits the image light along a first axis. The display also includes a flat combiner positioned to reflect the image light off of a first side and simultaneously transmit incident light through the first and a second side, along an optical axis perpendicular to the first axis to provide a view of a displayed image overlaid onto a see-through view of the environment, and a controllable light blocking element arranged generally parallel to the flat combiner and in front of the second side to block light incident on the same optical axis as the image light.
G02B 26/08 - Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
Aspects of the present invention relate to methods and systems for the see-through computer display systems with integrated IR eye imaging technologies.
Methods and systems for presenting digital content on a see-through display are disclosed. In some embodiments, the digital content is presented based on a display attribute associated with personal information related to a user of a wearable head device comprising the see-through display. In some embodiments, the digital content is associated with a geo-spatial location of a physical structure, and presenting the digital content on the see-through display comprises indicating a spatial relationship between the digital content and the physical structure.
H04L 51/222 - Monitoring or handling of messages using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area
H04L 51/224 - Monitoring or handling of messages providing notification on incoming messages, e.g. pushed notifications of received messages
H04W 4/02 - Services making use of location information
H04W 4/021 - Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
Aspects of the present disclosure relate a head-worn computer with a see-through display wherein computer content is presented to a user wearing the head-worn computer and through which the user sees a surrounding environment, wherein the see-through display generates image light comprised of narrow bandwidths of red, green and blue light and wherein the see-through display further includes a tristimulus notch mirror positioned to reflect the image light towards the user's eye, and wherein the tristimulus notch mirror reflects less than a full width half max of the red image light.
Aspects of the present invention relate presentation of digital content, in a see-through display, representing a known location in an environment proximate to a head worn computer.
G02B 26/08 - Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
Aspects of the present disclosure relate to modular expansion systems for use in head-worn computing systems. In an head-worn computer, an electrical connector is adapted to electrically connect with a modular expansion module, wherein the modular expansion module adds a capability to the head-worn computer and is removeably mounted to the head-worn computer, and a mount is adapted to physically secure the modular expansion module to the head-worn computer.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
G06F 3/0362 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
36.
SEE-THROUGH COMPUTER DISPLAY SYSTEMS WITH ADJUSTABLE ZOOM CAMERAS
Aspects of the present invention relate to methods and systems for the see-through computer display systems with adjustable-zoom cameras positioned such that their respective capture fields-of-view at least partially overlap at a target distance.
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
H04N 13/239 - Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
H04N 13/296 - Synchronisation thereof; Control thereof
H04N 13/383 - Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
A head-worn see-through display includes a display panel adapted to generate image content light, a combiner adapted to reflect the image content light towards an eye of a user, wherein the combiner transmits scene light from a surrounding environment to the eye of the user, and an image expansion optic intermediate the display panel and the combiner. The image expansion optic includes a flat partially reflective and partially reflective surface (the “flat surface”), a curved partially reflective and partially reflective surface (the “curved surface”), and the flat surface adapted to reflect the image content light towards the curved surface and the curved surface adapted to reflect the image light back towards the flat surface, wherein the image light transmits through the flat surface towards the combiner.
Aspects of the present invention relate to methods and systems for the see-through computer display systems with integrated IR eye imaging technologies.
G06F 3/0362 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 1/16 - Constructional details or arrangements
G06F 3/147 - Digital output to display device using display panels
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
Aspects of the present invention relate to a head-worn computer having a see-through computer display, a frame mechanically adapted to hold the see-through computer, a first side arm pivotally attached to the frame and adapted to hold the head-worn computer in place on a head of the user, wherein the first side arm comprises a temple section and an ear horn section and the temple section further comprising a compartment adapted to contain a battery, wherein the battery powers the see-through computer display.
Aspects of the present invention relate to speaker assemblies for head worn computers, including speaker assemblies in a temple portion of a head-worn computer.
G06F 3/033 - Pointing devices displaced or positioned by the user; Accessories therefor
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form
G06F 3/042 - Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
Aspects of the present invention relate to methods and systems for imaging, recognizing, and tracking of a user's eye that is wearing a HWC. Aspects further relate to the processing of images reflected from the user's eye and controlling displayed content in accordance therewith.
A61B 3/14 - Arrangements specially adapted for eye photography
A61B 3/00 - Apparatus for testing the eyes; Instruments for examining the eyes
G06F 3/038 - Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 1/16 - Constructional details or arrangements
G06F 3/00 - Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
Aspects of the present invention relate to methods and systems for providing a high transmission see-through view of the environment while trapping escaping light from the display system. In embodiments, a camera system is also provided that is aligned with the display system to provide images of the environment in a viewing direction of the user.
A head-worn computer includes a camera system positioned to capture a surrounding environment in front of a user, a processor that identifies a position of a plurality of light emitters mounted on a hand-held controller from images captured by the camera system and tracks the position of the plurality of light emitters as the hand-held controller moves in the surrounding environment and interprets the tracked position as positional changes of the hand-held controller. The processor uses the position of the plurality of light emitters as markers in three dimensional space, the markers used as an anchor for virtual content presented in a see-through display of the head-worn computer.
Aspects of the present disclosure relate to modular expansion systems for use in head-worn computing systems. In an head-worn computer, an electrical connector is adapted to electrically connect with a modular expansion module, wherein the modular expansion module adds a capability to the head-worn computer and is removeably mounted to the head-worn computer, and a mount is adapted to physically secure the modular expansion module to the head-worn computer.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
G06F 3/0362 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
47.
Modification of peripheral content in world-locked see-through computer display systems
G06T 19/00 - Manipulating 3D models or images for computer graphics
G06T 19/20 - Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
G06F 1/16 - Constructional details or arrangements
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 5/10 - Methods or arrangements for data conversion without changing the order or content of the data handled for changing the speed of data flow, i.e. speed regularising having a sequence of storage locations each being individually accessible for both enqueue and dequeue operations, e.g. using random access memory
G09G 3/3208 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED] organic, e.g. using organic light-emitting diodes [OLED]
G09G 3/3225 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED] organic, e.g. using organic light-emitting diodes [OLED] using an active matrix
G09G 3/3233 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED] organic, e.g. using organic light-emitting diodes [OLED] using an active matrix with pixel circuitry controlling the current through the light-emitting element
A removable lens for glasses includes an electrochromic layer adapted to transition between at least two states of a transparency level dependent on an electrical condition applied to the electrochromatic layer and an electrical connection element physically adapted to make an electrical connection with the electrochromic layer, wherein the electrical connection element is positioned to align with a variable-power electrode mounted on the glasses such that, when the removable lens is mounted on the glasses, the variable-power electrode and the electrical connection element make the electrical connection between the variable-power electrode and an electrically conductive layer of the electrochromic layer.
Aspects of the present invention relate to methods and systems for the see-through computer display systems with integrated IR eye imaging technologies.
An optical system for a head-worn computer includes an upper optical module adapted to convert illumination into image light by illuminating a reflective display through a field lens, wherein the image light is transmitted back through the field lens, then through a partially reflective partially transmissive surface and into a lower optic module adapted to present the image light to an eye of a user wearing the head-worn computer and the upper optical module being positioned within a housing for the head-worn computer and having a height of less than 24 mm, as measured from the reflective display to the bottom edge of the rotationally curved partial mirror.
Aspects of the present invention relate to methods and systems for measuring and managing the brightness of digital content in a field of view of a head-worn computer.
G09G 5/00 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
G09G 3/00 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
G09G 5/02 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the way in which colour is displayed
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 3/00 - Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form
G01J 1/32 - Photometry, e.g. photographic exposure meter by comparison with reference light or electric value intensity of the measured or reference value being varied to equalise their effects at the detector, e.g. by varying incidence angle using variation of intensity or distance of source using electric radiation detectors adapted for automatic variation of the measured or reference value
52.
Eye glint imaging in see-through computer display systems
Disclosure herein concerns a method that includes illuminating a user's eye with an illumination source in a head-worn display, capturing an image of the user's eye with an eye camera in the head-worn display, wherein the image includes an eye glint produced by light from the illumination source that is reflected from a surface of the user's eye, determining a size of an eye glint in the captured image, and identifying a change in focus distance for the user's eye in correspondence with a change in the size of the eye glint.
G06F 1/16 - Constructional details or arrangements
G06F 3/00 - Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
G06V 20/20 - Scenes; Scene-specific elements in augmented reality scenes
G06V 30/142 - Image acquisition using hand-held instruments; Constructional details of the instruments
Aspects of the present disclosure relate a head-worn computer with a see-through display wherein computer content is presented to a user wearing the head-worn computer and through which the user sees a surrounding environment, wherein the see-through display generates image light comprised of narrow bandwidths of red, green and blue light and wherein the see-through display further includes a tristimulus notch mirror positioned to reflect the image light towards the user's eye, and wherein the tristimulus notch mirror reflects less than a full width half max of the red image light.
Systems and methods relating to displaying images are disclosed. In one embodiment, sensor data is received via one or more sensors of a wearable head device comprising a display, the sensor data indicative of a surrounding environment of a user of the wearable head device. An image can be determined based on the sensor data, the image corresponding to the surrounding environment. A visibility of a first portion of the image corresponding to a first portion of the surrounding environment can be enhanced. Enhancing a visibility of a second portion of the image corresponding to a second portion of the surrounding environment can be forgone. The enhanced first portion of the image and a view of the second portion of the surrounding environment can be presented concurrently via the display of the wearable head device.
H04N 7/18 - Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
G06F 3/04815 - Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
G06V 10/22 - Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
G06V 20/20 - Scenes; Scene-specific elements in augmented reality scenes
G06V 20/62 - Text, e.g. of license plates, overlay texts or captions on TV images
Methods and systems for presenting digital content on a see-through display are disclosed. In some embodiments, the digital content is presented based on a display attribute associated with personal information related to a user of a wearable head device comprising the see-through display. In some embodiments, the digital content is associated with a geo-spatial location of a physical structure, and presenting the digital content on the see-through display comprises indicating a spatial relationship between the digital content and the physical structure.
H04L 51/222 - Monitoring or handling of messages using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area
H04L 51/224 - Monitoring or handling of messages providing notification on incoming messages, e.g. pushed notifications of received messages
H04W 4/02 - Services making use of location information
H04W 4/021 - Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
Aspects of the present invention relate to methods and devices for receiving and presenting content. In an example method, content is received, the content to be delivered to a plurality of recipients. Each recipient of the plurality of recipients has a preference for a respective first physical location at which the content is to be presented on a display of a wearable head device associated with the recipient. A sender of the content has a preference for a second physical location at which the content is to be presented to the respective recipient of the plurality of recipients. A respective final physical location for the presentation of the content for the respective recipient of the plurality of recipients is identified. The respective final physical location is based on the respective recipient's preference and the sender's preference. It is determined whether the respective recipient is proximate to a zone associated with the respective final physical location. In accordance with a determination that the respective recipient is proximate to the zone, an alert is generated on the wearable head device, the alert associated with the respective final physical location. It is determined whether the respective recipient is in the zone associated with the respective final physical location. In accordance with a determination that the respective recipient is in the zone, the content is caused to be presented to the respective recipient of the plurality of recipients.
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06T 19/20 - Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
G09G 5/00 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
H04L 51/222 - Monitoring or handling of messages using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area
H04L 51/224 - Monitoring or handling of messages providing notification on incoming messages, e.g. pushed notifications of received messages
H04W 4/021 - Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
H04W 4/02 - Services making use of location information
G06F 3/0362 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 1/16 - Constructional details or arrangements
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 1/16 - Constructional details or arrangements
G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form
G06F 3/038 - Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
Aspects of the present invention relate to methods and systems for collecting an using eye heading and sight heading information in head worn computing.
Aspects of the present invention relate to methods and systems for the see-through computer display systems. In embodiments, the systems and methods use curved display panels to generate image light.
Provided herein are examples of an impact resistant glass-waveguide configuration for a see-through head-worn computer display. In embodiments, the configuration includes vision correction and content density control through electrochromic and/or photochromic systems.
Head-worn computers include a front frame mechanically adapted to secure a see-through computer display and an arm, secured to the front frame, mechanically adapted to secure the front frame to a head of a user. The arm includes an internal speaker system, enclosed by the arm, wherein the internal speaker system comprises a speaker having a first side and an opposing second side and a first cavity positioned along the first side of the speaker, the arm further comprising a vent positioned to vent the first cavity and a second cavity positioned along the second side of the speaker.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
H04R 1/28 - Transducer mountings or enclosures designed for specific frequency response; Transducer enclosures modified by provision of mechanical or acoustic impedances, e.g. resonator, damping means
G06F 1/16 - Constructional details or arrangements
G06F 3/038 - Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form
G06F 3/044 - Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
G06F 3/038 - Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
65.
Modification of peripheral content in world-locked see-through computer display systems
G06T 19/20 - Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
G06F 1/16 - Constructional details or arrangements
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 5/10 - Methods or arrangements for data conversion without changing the order or content of the data handled for changing the speed of data flow, i.e. speed regularising having a sequence of storage locations each being individually accessible for both enqueue and dequeue operations, e.g. using random access memory
G09G 3/3208 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED] organic, e.g. using organic light-emitting diodes [OLED]
G09G 3/3225 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED] organic, e.g. using organic light-emitting diodes [OLED] using an active matrix
G09G 3/3233 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED] organic, e.g. using organic light-emitting diodes [OLED] using an active matrix with pixel circuitry controlling the current through the light-emitting element
G06F 3/033 - Pointing devices displaced or positioned by the user; Accessories therefor
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form
G06F 3/042 - Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
Head-worn computers with eye-imaging systems include a camera system positioned in a head-worn computer, wherein the camera system is further positioned to capture eye-image light that originates as reflections from a user's eye, wherein the camera system is further positioned to capture eye-image light as a reflection from a partially reflective surface that is positioned in front of an image display in the head-worn computer, wherein image light, from the image display, is transmitted through the partially reflective surface. A processor is adapted to cause the camera system to capture the eye-image light. The processor is further adapted to cause a comparison of the captured eye-image light with a pre-stored eye image of a known user of the head-worn computer. In the event the comparison confirms the identity of the known user, the user is granted permission to view content to be presented in a display of the head-worn computer.
A61B 3/113 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for determining or recording eye movement
A61B 3/00 - Apparatus for testing the eyes; Instruments for examining the eyes
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
A61B 3/12 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for looking at the eye fundus, e.g. ophthalmoscopes
G06F 21/10 - Protecting distributed programs or content, e.g. vending or licensing of copyrighted material
G06F 21/32 - User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
A system and method for providing assisted safety to an operator of a vehicle using a head-mounted display that provides displayed content and a see-through view of a surrounding environment, includes determining whether the operator is looking through the windshield of the vehicle or is not looking through the windshield, if the user is looking through the windshield, preventing displayed content from being provided within a display field of view of the head-mounted display, thereby providing an unencumbered see-through view of the surrounding environment, if the user is not looking through the windshield, providing displayed content for viewing by the user within the display field of view, and if important information relating to the safety of the vehicle is detected by a system associated with the vehicle while the user is looking not looking through the windshield, interrupting the displayed content and providing an alert to the operator.
G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
G02B 27/28 - Optical systems or apparatus not provided for by any of the groups , for polarising
G06F 3/00 - Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
G10L 15/20 - Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise or of stress induced speech
G06V 10/147 - Optical characteristics of the device performing the acquisition or on the illumination arrangements - Details of sensors, e.g. sensor lenses
G06V 10/22 - Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
G06V 20/20 - Scenes; Scene-specific elements in augmented reality scenes
Aspects of the present invention relate to providing assistance to medical professionals during the performance of medical procedures through the use of technologies facilitated through a head-worn computer.
A61B 1/00 - Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
A61B 17/00 - Surgical instruments, devices or methods, e.g. tourniquets
A61B 3/113 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for determining or recording eye movement
A61B 5/06 - Devices, other than using radiation, for detecting or locating foreign bodies
A61B 5/11 - Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
A61B 90/00 - Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups , e.g. for luxation treatment or for protecting wound edges
A61B 90/50 - Supports for surgical instruments, e.g. articulated arms
G06T 19/00 - Manipulating 3D models or images for computer graphics
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
A61B 34/20 - Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
G06V 40/18 - Eye characteristics, e.g. of the iris
A61B 5/1455 - Measuring characteristics of blood in vivo, e.g. gas concentration, pH-value using optical sensors, e.g. spectral photometrical oximeters
A61B 5/145 - Measuring characteristics of blood in vivo, e.g. gas concentration, pH-value
A61B 3/11 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for measuring interpupillary distance or diameter of pupils
A61B 3/12 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for looking at the eye fundus, e.g. ophthalmoscopes
A61B 34/10 - Computer-aided planning, simulation or modelling of surgical operations
G06V 30/142 - Image acquisition using hand-held instruments; Constructional details of the instruments
Aspects of the present disclosure relate to optical systems with ergonomic presentation of content for use in head-worn computing systems. A method for controlling a head-worn computer when viewing virtual images, including image content, that encourages an ergonomic head position to reduce neck pain, includes determining an angle of the head-worn computer relative to horizontal, determining an angle of a line of sight to the center of the virtual image as presented to a user's eye, determining a deviation between the determined angle of the line of sight and a predetermined ergonomic angle, and shifting the image content of the virtual image vertically as displayed to the user's eye so that a portion of the image content is not viewable, wherein the amount of shifting is in reverse correspondence to the magnitude of the determined deviation.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
G06T 3/40 - Scaling of a whole image or part thereof
G06T 3/00 - Geometric image transformation in the plane of the image
G06F 1/16 - Constructional details or arrangements
G06T 7/73 - Determining position or orientation of objects or cameras using feature-based methods
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
Aspects of the present invention relate to methods and systems for imaging, recognizing, and tracking of a user's eye that is wearing a HWC. Aspects further relate to the processing of images reflected from the user's eye and controlling displayed content in accordance therewith.
A61B 3/14 - Arrangements specially adapted for eye photography
A61B 3/00 - Apparatus for testing the eyes; Instruments for examining the eyes
G06F 3/038 - Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 1/16 - Constructional details or arrangements
G06F 3/00 - Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
A head-worn computer includes a camera system positioned to capture a surrounding environment in front of a user, a processor that identifies a position of a plurality of light emitters mounted on a hand-held controller from images captured by the camera system and tracks the position of the plurality of light emitters as the hand-held controller moves in the surrounding environment and interprets the tracked position as positional changes of the hand-held controller. The processor uses the position of the plurality of light emitters as markers in three dimensional space, the markers used as an anchor for virtual content presented in a see-through display of the head-worn computer.
Aspects of the present invention relate to methods and systems for the see-through computer display systems with adjustable-zoom cameras positioned such that their respective capture fields-of-view at least partially overlap at a target distance.
G06F 3/00 - Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
H04N 5/232 - Devices for controlling television cameras, e.g. remote control
H04N 13/239 - Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
H04N 13/296 - Synchronisation thereof; Control thereof
H04N 13/383 - Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
G03B 37/04 - Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe with cameras or projectors providing touching or overlapping fields of view
G06F 1/16 - Constructional details or arrangements
H04N 5/262 - Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects
H04N 9/31 - Projection devices for colour picture display
76.
Eye glint imaging in see-through computer display systems
Disclosure herein concerns a method that includes illuminating a user's eye with an illumination source in a head-worn display, capturing an image of the user's eye with an eye camera in the head-worn display, wherein the image includes an eye glint produced by light from the illumination source that is reflected from a surface of the user's eye, determining a size of an eye glint in the captured image, and identifying a change in focus distance for the user's eye in correspondence with a change in the size of the eye glint.
G06F 1/16 - Constructional details or arrangements
G06F 3/00 - Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
G06V 20/20 - Scenes; Scene-specific elements in augmented reality scenes
G06V 30/142 - Image acquisition using hand-held instruments; Constructional details of the instruments
Methods and systems for presenting digital content on a see-through display are disclosed. In some embodiments, the digital content is presented based on a display attribute associated with personal information related to a user of a wearable head device comprising the see-through display. In some embodiments, the digital content is associated with a geo-spatial location of a physical structure, and presenting the digital content on the see-through display comprises indicating a spatial relationship between the digital content and the physical structure.
G06T 19/00 - Manipulating 3D models or images for computer graphics
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
H04L 51/224 - Monitoring or handling of messages providing notification on incoming messages, e.g. pushed notifications of received messages
H04L 51/222 - Monitoring or handling of messages using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area
G09G 5/00 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
G06T 19/20 - Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
H04W 4/02 - Services making use of location information
H04W 4/021 - Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
Aspects of the present disclosure relate to modular expansion systems for use in head-worn computing systems. In an head-worn computer, an electrical connector is adapted to electrically connect with a modular expansion module, wherein the modular expansion module adds a capability to the head-worn computer and is removeably mounted to the head-worn computer, and a mount is adapted to physically secure the modular expansion module to the head-worn computer.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
G06F 3/0362 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
A see-through head mounted display with controllable light blocking includes an optics module comprising a light source and image source positioned on a same side of an angled partially-reflective surface, wherein the light source projects light off the surface to the image source which reflects the light as image light to the surface which transmits the image light along a first axis. The display also includes a flat combiner positioned to reflect the image light off of a first side and simultaneously transmit incident light through the first and a second side, along an optical axis perpendicular to the first axis to provide a view of a displayed image overlaid onto a see-through view of the environment, and a controllable light blocking element arranged generally parallel to the flat combiner and in front of the second side to block light incident on the same optical axis as the image light.
G02B 26/08 - Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/038 - Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
G06F 1/16 - Constructional details or arrangements
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form
A63F 13/00 - Video games, i.e. games using an electronically generated display having two or more dimensions
Aspects of the present invention relate to methods and devices for receiving and presenting content. In an example method, content is received, the content to be delivered to a plurality of recipients. Each recipient of the plurality of recipients has a preference for a respective first physical location at which the content is to be presented on a display of a wearable head device associated with the recipient. A sender of the content has a preference for a second physical location at which the content is to be presented to the respective recipient of the plurality of recipients. A respective final physical location for the presentation of the content for the respective recipient of the plurality of recipients is identified. The respective final physical location is based on the respective recipient's preference and the sender's preference. It is determined whether the respective recipient is proximate to a zone associated with the respective final physical location. In accordance with a determination that the respective recipient is proximate to the zone, an alert is generated on the wearable head device, the alert associated with the respective final physical location. It is determined whether the respective recipient is in the zone associated with the respective final physical location. In accordance with a determination that the respective recipient is in the zone, the content is caused to be presented to the respective recipient of the plurality of recipients.
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
H04L 51/224 - Monitoring or handling of messages providing notification on incoming messages, e.g. pushed notifications of received messages
H04L 51/222 - Monitoring or handling of messages using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area
G06T 19/20 - Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
G06T 19/00 - Manipulating 3D models or images for computer graphics
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
G09G 5/00 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
H04W 4/021 - Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
H04W 4/02 - Services making use of location information
A head-worn see-through display includes a display panel adapted to generate image content light, a combiner adapted to reflect the image content light towards an eye of a user, wherein the combiner transmits scene light from a surrounding environment to the eye of the user, and an image expansion optic intermediate the display panel and the combiner. The image expansion optic includes a flat partially reflective and partially reflective surface (the “flat surface”), a curved partially reflective and partially reflective surface (the “curved surface”), and the flat surface adapted to reflect the image content light towards the curved surface and the curved surface adapted to reflect the image light back towards the flat surface, wherein the image light transmits through the flat surface towards the combiner.
A see-through head mounted display with controllable light blocking includes an optics module comprising a light source and image source positioned on a same side of an angled partially-reflective surface, wherein the light source projects light off the surface to the image source which reflects the light as image light to the surface which transmits the image light along a first axis. The display also includes a flat combiner positioned to reflect the image light off of a first side and simultaneously transmit incident light through the first and a second side, along an optical axis perpendicular to the first axis to provide a view of a displayed image overlaid onto a see-through view of the environment, and a controllable light blocking element arranged generally parallel to the flat combiner and in front of the second side to block light incident on the same optical axis as the image light.
G02B 26/08 - Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
Aspects of the present invention relate to methods and systems for measuring and managing the brightness of digital content in a field of view of a head-worn computer.
G09G 5/00 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
G09G 3/00 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
G09G 5/02 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the way in which colour is displayed
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 3/00 - Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form
G01J 1/32 - Photometry, e.g. photographic exposure meter by comparison with reference light or electric value intensity of the measured or reference value being varied to equalise their effects at the detector, e.g. by varying incidence angle using variation of intensity or distance of source using electric radiation detectors adapted for automatic variation of the measured or reference value
86.
Optical configurations for head-worn see-through displays
Aspects of the present invention relate to methods and systems for providing a high transmission see-through view of the environment while trapping escaping light from the display system. In embodiments, a camera system is also provided that is aligned with the display system to provide images of the environment in a viewing direction of the user.
An optical system for a head-worn computer includes an upper optical module adapted to convert illumination into image light by illuminating a reflective display through a field lens, wherein the image light is transmitted back through the field lens, then through a partially reflective partially transmissive surface and into a lower optic module adapted to present the image light to an eye of a user wearing the head-worn computer and the upper optical module being positioned within a housing for the head-worn computer and having a height of less than 24 mm, as measured from the reflective display to the bottom edge of the rotationally curved partial mirror.
G06F 3/0362 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
Embodiments of the present disclosure relate to a head-worn apparatus, comprising: a frame adapted to be mounted to a head of a user; a light emitting system positioned within the frame to provide light to an eye of the user; a sound system adapted to provide audio to the user; a haptic system positioned within the frame to provide haptic feedback to the user; and a processor adapted to control the lighting system, audio system and haptic system in a coordinated pattern of light, sound and haptics that causes a mental-health therapeutic stimulus provided to the user, whereby the user experiences an improvement in mental performance based on the coordinated pattern.
A removable lens for glasses includes an electrochromic layer adapted to transition between at least two states of a transparency level dependent on an electrical condition applied to the electrochromatic layer and an electrical connection element physically adapted to make an electrical connection with the electrochromic layer, wherein the electrical connection element is positioned to align with a variable-power electrode mounted on the glasses such that, when the removable lens is mounted on the glasses, the variable-power electrode and the electrical connection element make the electrical connection between the variable-power electrode and an electrically conductive layer of the electrochromic layer.
Embodiments include a head-worn display including a display panel sized and positioned to produce a field of view to present digital content to an eye of a user, and a processor adapted to present the digital content to the display panel such that the digital content is only presented in a portion of the field of view, the portion being in the middle of the field of view such that horizontally opposing edges of the field of view are blank areas. The processor is adapted to shift the digital content into one of the blank areas to adjust the convergence distance of the digital content and thereby change the perceived distance from the user to the digital content.
H05B 45/12 - Controlling the intensity of the light using optical feedback
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06T 19/00 - Manipulating 3D models or images for computer graphics
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
G06F 5/10 - Methods or arrangements for data conversion without changing the order or content of the data handled for changing the speed of data flow, i.e. speed regularising having a sequence of storage locations each being individually accessible for both enqueue and dequeue operations, e.g. using random access memory
G02B 30/34 - Stereoscopes providing a stereoscopic pair of separated images corresponding to parallactically displaced views of the same object, e.g. 3D slide viewers
H05B 45/10 - Controlling the intensity of the light
G02B 27/28 - Optical systems or apparatus not provided for by any of the groups , for polarising
G02B 27/09 - Beam shaping, e.g. changing the cross-sectioned area, not otherwise provided for
G09G 3/3208 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED] organic, e.g. using organic light-emitting diodes [OLED]
H04N 7/18 - Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
G06F 3/04815 - Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
G06V 10/22 - Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
G06V 20/20 - Scenes; Scene-specific elements in augmented reality scenes
G06V 20/62 - Text, e.g. of license plates, overlay texts or captions on TV images
Aspects of the present invention relate to a head-worn computer having a see-through computer display, a frame mechanically adapted to hold the see-through computer, a first side arm pivotally attached to the frame and adapted to hold the head-worn computer in place on a head of the user, wherein the first side arm comprises a temple section and an ear horn section and the temple section further comprising a compartment adapted to contain a battery, wherein the battery powers the see-through computer display.
Aspects of the present invention relate to providing see-through computer display optics with improved content presentation. The see-through computer display includes an ambient light sensor adapted to measure environmental scene light in an area that forms the background for digital content presented in the see-through computer display, and a processor adapted to invert a color channel parameter of the digital content based on data from the ambient light sensor.
G09G 5/02 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the way in which colour is displayed
Aspects of the present invention relate to a head-worn computer, comprising a removable and replaceable adjustable nose bridge assembly, wherein the adjustable nose bridge assembly has at least three user adjustable features to adapt the adjustable nose bridge assembly to the user's nose, wherein a first adjustment of the at least three user adjustable features is adapted to move the adjustable nose bridge up and down relative to a lens of the head-worn computer, wherein a second adjustment of the at least three user adjustable features is adapted to rotate a nose pad of the adjustable nose bridge about an axis substantially perpendicular to a top frame of the head-worn computer, and wherein a third adjustment of the at least three user adjustable features is adapted to flare the nose pad to the side of the axis.
An apparatus includes an eye cover adapted to be removably mounted on a head-worn computer with a see-through computer display and a flexible audio headset mounted to the eye cover. The flexible audio headset is mounted to the eye cover with a magnetic connection.
G02B 7/00 - Mountings, adjusting means, or light-tight connections, for optical elements
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 1/16 - Constructional details or arrangements
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
H04R 5/033 - Headphones for stereophonic communication
G06F 3/147 - Digital output to display device using display panels
G06F 3/0362 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 1/16 - Constructional details or arrangements
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0484 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
G06F 3/0482 - Interaction with lists of selectable items, e.g. menus
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 1/16 - Constructional details or arrangements
G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form
G06F 3/038 - Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry