Systems and methods for tracking the position of one or more objects, such as components of a head-mounted display (HMD) system. One or more objects may carry a plurality of angle sensitive optical detectors. Each of the optical detectors may include an optical subsystem that is configured to vary at least one of phase or intensity of light imparted on the optical detector. The optical subsystem may include one or more of diffractive optical elements, lens arrays, intensity masks, phase masks, or the like. The optical detectors may include a photodetector that includes a plurality of optically active areas, such as a quadrant cell photodetector, an image sensor with an array of photodiodes, etc. Control circuitry may cause light sources to emit light, and may receive sensor data from the plurality of optical detectors. Control circuitry may process the sensor data to track a position of one or more objects.
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
G01B 11/26 - Measuring arrangements characterised by the use of optical techniques for testing the alignment of axes
G02F 1/139 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells characterised by the electro-optical or magneto-optical effect, e.g. field-induced phase transition, orientation effect, guest-host interaction or dynamic scattering based on orientation effects in which the liquid crystal remains transparent
2.
SYSTEMS AND METHODS FOR INCENTIVIZING CONTENT EXPLORATION
There may be large numbers of content items available at current content provider systems. Incentive items may be inserted among content items, for example, associated with content categories, that may reward uses for viewing content items. When incentive items are selected by a user, the user may be associated with credit towards a bonus item or award a bonus item. Incentive items may have associated preference factors that may be manipulated to increase the probability of such incentive items being presented to the user.
G06Q 30/02 - Marketing; Price estimation or determination; Fundraising
H04L 9/32 - Arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system
3.
ACTIVE REDUCTION OF FAN NOISE IN A HEAD-MOUNTED DISPLAY
Described herein are active noise reduction (ANR) techniques for reducing noise produced by a fan(s) of a head-mounted display (HMD). An example process may include receiving data indicative of a noise that is being produced by the fan(s), determining, based at least in part on the data and using a model(s), one or more audio parameter values, and outputting, via one or more off-ear speakers of the HMD, a sound(s) having one or more audio characteristics based at least in part on the one or more audio parameter values to reduce the noise produced by the fan(s) at a location(s) of an ear(s) of the user of the HMD.
G10K 11/178 - Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
4.
OPTICAL TRACKING INCLUDING IMAGING-BASED ANGLE SENSITIVE DETECTORS
The present disclosure is directed to systems and methods of object tracking for use in various applications, such as eye tracking in virtual reality or augmented reality applications that include head-mounted display devices. An eye tracking system may be provided that includes a plurality of assemblies that each include a light detector, such as a quadrant photodetector, and an imaging lens configured to generate an image of the eye on the quadrant photodetector. Machine learning or other techniques may be used to track or otherwise determine a user's gaze direction, which may be used by one or more components of an HMD device to improve its functionality in various ways.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
A61B 3/113 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for determining or recording eye movement
G01J 1/42 - Photometry, e.g. photographic exposure meter using electric radiation detectors
Described herein are, among other things, techniques, devices, and systems for generating content-item recommendations that are based, at least in part, on data that is unique to respective geographical regions associated with respective users. For instance, the content-item recommendations may be based at least in part on sales data for the respective geographical regions.
Methods and systems relating generally to information displays, and more particularly to systems and methods for backlight assemblies for information displays that provide improved efficiency. A backlight assembly may include a light guide that is sized and dimensioned to illuminate only a portion of the display that is imaged or focused by an optics system. The backlight assembly may include a light source, such as one or more laser diodes, that directs a light beam into the light guide wherein the beam reflects via total internal reflection. The light guide may include a plurality of light extraction features configured to diffuse light toward a display panel, such as a liquid crystal display (LCD) panel.
A multi-coil voice coil motor (VCM) may be configured to be used as a haptic actuator for providing haptic feedback to a user. When implemented in a handheld controller having one or more controls, the multi-coil VCM may be configured to provide haptic feedback to a user of the controller. The multi-coil VCM may include a housing, multiple concentric coils, and a magnet coupled to the housing. The multiple concentric coils may include a first coil disposed on a first support coupled to the housing and a second coil disposed on a second support coupled to the housing, wherein the multiple concentric coils may have different diameters to allow for the concentricity of the coils. A system may include one or more haptic actuators, such as the multi-coil VCM, the haptic actuator(s) being configured to provide haptic feedback by causing at least a portion of a finger-operated control(s) to vibrate.
H02K 33/18 - Motors with reciprocating, oscillating or vibrating magnet, armature or coil system with coil systems moving upon intermittent or reversed energisation thereof by interaction with a fixed field system, e.g. permanent magnets
A63F 13/285 - Generating tactile feedback signals via the game input device, e.g. force feedback
An optical system of a head-mounted display (HMD) system that includes a diffractive optical element coupled to a display, for example, via lamination or a suitable optically clear adhesive. The optical system may include a reflective polarizer and a quarter-wave plate that, together with the diffractive optical element, form a catadioptric or "pancake" configuration that focuses light from a display system to an eye of a user of the head mounted display system. In some examples, an LCD display device includes several components. Two of the components are the display matrix, which obstructs light in a granular or pixelated fashion to create an image, and a light source or backlight.
Systems and methods for tracking the position of one or more head-mounted display (HMD) system components of an HMD system. The HMD components may carry a plurality of angle sensitive detectors or other types of detectors. The HMD system may be operative to detect corrupted position tracking samples, allowing such samples to be ignored, thereby improving the position tracking process. Control circuitry causes light sources to emit light according a specified pattern, and receives sensor data from the plurality of detectors. Control circuitry may process the sensor data, for example using machine learning or other techniques, to track a position of one or more HMD components.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
A optical system of a head mounted display (HMD) system that includes a lens assembly comprising a first lens element and a second lens element that are directly or indirectly coupled together, for example, via a suitable optically clear adhesive. The lens assembly may include a quarter-wave plate disposed between the first and second lens elements. The first lens element may include a surface with an anti-reflective coating thereon, and the second lens element may include a surface with a partially reflective coating thereon. The optical system may include a reflective polarizer that, together with the lens assembly, focuses light from a display system to an eye of a user of the head mounted display system.
A controller for an electronic system may include a linear hand strap adjuster to accommodate different hand sizes of users who may hold the controller in their hand. For example, a linear slot may be defined in the handle at a proximal end of the handle that is adjacent to the neck region where the handle is adjoined to the head. The linear slot may extend longitudinally along the handle. An anchor disposed within the linear slot may protrude from the outer surface of the handle to provide a point of attachment for an end of the hand strap. Accordingly, a first end of the hand strap is configured to be coupled to the anchor, and the anchor is movable along the linear slot to adjust the first end of the hand strap.
A63F 13/245 - Constructional details thereof, e.g. game controllers with detachable joystick handles specially adapted to a particular type of game, e.g. steering wheels
Methods and systems relating generally to information displays, and more particularly to systems and methods for backlight assemblies for information displays that include light expanding structures. A backlight assembly may include light expander structures that include a plurality of layer sets, wherein each layer set includes a reflective polarizer layer and a wave retarder layer. The layer sets may together be operative transform point light source, such as a laser light beam, into a surface light source for use as a backlight for various types of information displays.
G02B 6/00 - Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
G09G 3/34 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix by control of light from an independent source
A head-mounted display includes a front having a display housing and a back having a rear housing. A first member extends between the front and the back and is adjustable via an actuation of a first rotatable actuator and a first cabling mechanism. A second member extends between the front and the back and is adjustable via an actuation of a second rotatable actuator and a second cabling mechanism. A third member extends between the front and the back and is adjustable via the actuation of the second rotatable actuator and a third cabling mechanism.
Described herein are, among other things, techniques, devices, and systems for identifying portions of a new version of an application that are new to the new version and portions of the new version that are common to the new version and a previous version of the application, such that a client computing device may efficiently update from the previous version to the new version.
Client machines running game executables of a video game(s) may utilize a file system proxy component that is configured to track read operations made by the game executable during a game session, to generate access data based on the tracked read operations, and to report the access data to a remote system. This telemetry approach allows the remote system to collect access data reported by multiple client machines, to catalogue the access data according to client system configuration, and to analyze the access data to generate data that is usable by client machines to implement various game-related features including, without limitation, "instant play" of video games, discarding of unused blocks of game data to free up local memory resources, and/or local prefetching of game data for reducing latency during gameplay.
A63F 13/73 - Authorising game programs or game devices, e.g. checking authenticity
A63F 13/30 - Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
A63F 13/35 - Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers - Details of game servers
A63F 13/803 - Driving vehicles or craft, e.g. cars, airplanes, ships, robots or tanks
Described herein are, among other things, techniques, devices, and systems for generating personalized game-notification feeds for users. In some instances, a remote computing system that offers one or more games for acquisition may determine which notifications generated by respective game publishers are likely to be of interest to different users and, after doing so, may generate personalized game-notification feeds comprising the selected notifications. Further, each of the users may provide feedback regarding one or more of the notifications in the notification feed, which the system may use to re-select notifications and re-generating personalized game-notification feeds.
Systems and methods provide improved illumination optics for various applications. The illumination optics may include an optical beam spreading structure that provides a large spread angle for an incident collimated beam or provides finer detail or resolution compared to convention diffractive optical elements. The optical beam spreading structure may include first and second spatially varying polarizers that are optically aligned with each other. The first and second spatially varying polarizers may be formed of a liquid crystal material, such as a multi-twist retarder (MTR). The first and second spatially varying polarizers may diffract light of orthogonal polarization states, which allows for different diffraction patterns to be used in a single optical structure. The two patterns may provide a combined field of view that is larger than either of the first and second fields of view or may provide finer detail or resolution than the first or second fields of view can provide alone.
G02B 26/08 - Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
Controllers that allow for adjusting various features of the controller are disclosed. The controller may include one or more speakers for outputting sound or audio content. A user may contact one or more of the speakers with a finger(s) to adjust a characteristic of the audio content and/or to adjust audio settings. For example, a user may touch a speaker with his/her finger to change (e.g., increase or decrease) the volume or to mute the sound. In some instances, the speakers may be located on the controller body of the handheld controller for convenient and quick access by the user.
G06F 3/045 - Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact
19.
POLARIMETRY CAMERA FOR HIGH FIDELITY SURFACE CHARACTERIZATION MEASUREMENTS
Systems and methods for providing a polarimetry camera operative to obtain high fidelity surface characterization measurements. A polarimetry camera may include an multi-twist retarder component that is operative selectively switch between two or more polarization filtering states, wherein in each polarization filtering state, the multi-twist retarder component only passes light having a particular polarization state or orientation (e.g., horizontal linear polarization, vertical linear polarization, 45 degree linear polarization, circular polarization) and reflects or absorbs light having other polarization states. The multi-twist retarder may also include one or more diffraction patterns that focus light. The polarimetry camera may capture images using a sensor array as the multi-twist retarder is switched between the at least two polarization filtering states, thereby capturing a sequence of polarization specific images that may be displayed or used to determine one or more Stokes parameters for a scene in real-time.
Described herein are controllers with sensor-rich controls for enhanced controller functionality. An example control may include a pressure sensor that is configured to detect an amount of a force of a press on a cover of the control based at least in part on a proximity of a metal layer to the pressure sensor. This control may further include a touch sensor for detecting an object contacting the cover of the control. Additional embodiments disclose, among other things, integrated trackpads and D-pads, as well as backlighting features that indicate a functional state of the controller.
A63F 13/214 - Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
A63F 13/218 - Input arrangements for video game devices characterised by their sensors, purposes or types using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
A63F 13/245 - Constructional details thereof, e.g. game controllers with detachable joystick handles specially adapted to a particular type of game, e.g. steering wheels
A63F 13/24 - Constructional details thereof, e.g. game controllers with detachable joystick handles
A63F 13/21 - Input arrangements for video game devices characterised by their sensors, purposes or types
A63F 13/20 - Input arrangements for video game devices
A63F 13/213 - Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
22.
DYNAMICALLY ENABLING OR DISABLING CONTROLS OF A CONTROLLER
A handheld controller may include controls that are actuatable by a user. The handheld controller may further include one or more sensors that are configured to detect an object in proximity to certain controls, and/or that sense a grip or position of a hand on a handle portion of the controller. Based on data from a sensor(s), certain controls may be enabled and/or disabled. The sensors may therefore be used to determine which controls are being used or are intended to be used, and/or which controls are likely accessible or inaccessible to the user based on sensor data, and to cause one or more controls of the handheld controller to be enabled and/or disabled accordingly.
G06F 3/045 - Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact
A controller system for surfacing selectable elements on a display of the controller along with game content associated with a video game is described. In an example, a user may provide touch input on the display, and, in response, a game content window that is presenting the game content may scale and/or move to a new position on the display in order to create space on the display for presenting one or more selectable elements outside of the scaled and/or repositioned game content window. The surfaced element(s) may be selectable to cause performance of a game-related action. In this manner, the selectable element(s) do(es) not occlude the game content, and the user may interact with both the game content and the selectable element(s) presented on the display.
Described herein are motion smoothing techniques for a display, or display system, such as a head-mounted display (HMD), to account for motion of moving or animating objects in a way that mitigates judder. The display system may be separate from, yet communicatively coupled to, a host computer where a graphics-based application, such as a video game, is outputting frames for rendering on the display system. The host computer may generate motion vectors representing compressed pixel data for transmission to the display system. The motion vectors can be used by the display system to modify pixel data of a frame. The modified pixel data for the frame is "motion-smoothed" for rendering on the display system in a manner that mitigates judder of moving or animating objects.
H04N 19/182 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
H04N 19/517 - Processing of motion vectors by encoding
25.
POLARIZATION COMPENSATION FOR WIRE GRID POLARIZER OF HEAD-MOUNTED DISPLAY SYSTEM
The present disclosure relates generally to techniques for improving the performance and efficiency of optical systems, such as optical systems for using head-mounted display system. The optical systems of the present disclosure may include polarized catadioptric optics, or "pancake optics," which utilize a wire grid polarizer as a reflective polarizer. Wire grid polarizers may not perform uniformly over wavelength or over varying angles of incidence. To improve performance, a spatially varying polarizer is provided in the optical system that operates to provide polarization compensation for the wire grid polarizer so that the wire grid polarizer performs more uniformly over wavelength and/or over incidence angles (e.g., on-axis and off-axis). The spatially varying polarizer may be formed of a liquid crystal material, such as a multi-twist retarder.
G02B 27/14 - Beam splitting or combining systems operating by reflection only
G02F 1/01 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
26.
VIEWING FIELD-BASED OPTICAL CORRECTION USING SPATIALLY VARYING POLARIZERS
An optical system is provided. The optical system includes a gaze tracker operative to track a gaze of a user and output data representative of the gaze and a correction portion including multiple spatially varying polarizers. A first polarizer of the spatially varying polarizers has a first control input configured to receive a first control signal indicating whether the first polarizer is to be active or inactive. The first polarizer, when active, provides a first optical correction on light passing through at a location corresponding to a first region of a virtual image. The optical system includes a controller configured to receive the data representative of the gaze, determine, based on the gaze, whether to implement the first optical correction on the light and in response to determining to implement the first optical correction on the light, output the first control signal indicating the first polarizer is to be active.
G02B 30/25 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer’s left and right eyes of the stereoscopic type using polarisation techniques
The present disclosure related generally to techniques for improving the performance and efficiency of display systems, such as laser scan beam display systems or other types of display systems (e.g., micro-displays) of an HMD or other device. Display systems of the present disclosure may include a polarization compensation optic, such as a spatially varying polarizer, that provides phase retardation that varies as a function of position, which provides polarization compensation to provide light that is well suited for a polarization sensitive optic of the display system, such as a waveguide-based optical system, a pancake optical system, a birdbath optical system, a coating-based optical system, etc. The spatially varying polarizer may be varied spatially in real-time based on a user's gaze location to provide an optimized field of view in a region where the user is known or inferred to be gazing, thereby providing improved optical performance.
Systems and methods for tracking the position of a head-mounted display (HMD) system component. The HMD component may carry a plurality of angle sensitive detectors that are able to detect the angle of light emitted from a light source. The HMD component may include one or more scatter detectors that detect whether light has been scattered or reflected, so such light can be ignored. Control circuitry causes light sources to emit light according a specified pattern, and receives sensor data from the plurality of angle sensitive detectors. The processor may process the sensor data and scatter detector data, for example using machine learning or other techniques, to track a position of the HMD component. An angle sensitive detector may include a spatially-varying polarizer having a position-varying polarizing pattern and one or more polarizer layers that together are operative to detect the angle of impinging light.
A63F 13/213 - Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
G02F 1/13 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells
G09G 3/36 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix by control of light from an independent source using liquid crystals
Systems and methods for providing a display for an electronic device that includes a liquid crystal display panel assembly, a backlight assembly that includes a light source, and a spatially varying polarizer that provides phase retardation that varies as a function of propagation length away from the light source. The display may also include a linear polarizer and other optical components that improve the efficiency of the backlight assembly, thereby reducing power consumption, cost, space requirements, and provide other advantages.
The present disclosure is related generally to techniques for improving the performance and efficiency of display systems, such as laser scan beam display systems or other types of display systems (e.g., micro-displays) of an HMD system or other device. Display systems of the present disclosure may utilize polarization multiplexing that allow for improved optimization of diffraction optics. In at least some implementations, a display system may selectively polarize light dependent on wavelength (e.g., color) or field of view. An optical combiner may include polarization sensitive diffractive optical elements that are each optimized for a subset of colors or portions of an overall field of view, thereby providing improved correction optics for a display system.
An optical system is provided that includes a correction portion including one or more spatially varying polarizers. A first spatially varying polarizer of the one or more spatially varying polarizers has a first control input configured to receive a first control signal indicating whether the first spatially varying polarizer is to be active or inactive. When active, the first spatially varying polarizer is operative to provide a first optical correction on light passing through the correction portion. The optical system includes a controller configured to determine whether to implement the first optical correction on the light passing through the correction portion and in response to determining to implement the first optical correction on the light passing through the correction portion, output the first control signal indicating the first spatially varying polarizer is to be active. Additional spatially varying polarizers may be controlled to provide additional or alternative optical corrections.
G02B 30/25 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer’s left and right eyes of the stereoscopic type using polarisation techniques
G09G 3/36 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix by control of light from an independent source using liquid crystals
G02F 1/13363 - Birefringent elements, e.g. for optical compensation
32.
CORRECTION POLARIZATION COMPENSATION OPTIC FOR DISPLAY SYSTEMS
The present disclosure related generally to techniques for improving the performance and efficiency of display systems, such as laser scan beam display systems or other types of display systems (e.g., micro-displays). Display systems of the present disclosure may include a polarization compensation optic, such as a spatially varying polarizer, that provides phase retardation that varies as a function of position, which provides polarization compensation to provide light that is well suited for a polarization sensitive optic of the display system, such as a waveguide-based optical system, a pancake optical system, a birdbath optical system, a coating-based optical system, etc. The display systems of the present disclosure may be components of head-mounted display systems, or other types of display systems.
G02B 26/08 - Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
Systems and methods for providing a polarization recycling structure for use in applications, such as display systems that include a liquid crystal display assembly. The polarization recycling structure may include a first spatially varying polarizer spaced apart from a second spatially varying polarizer. The first spatially varying polarizer may include a lens array that receives light from a light source and focuses light of a first polarization state and passes light of a second polarization state. The second spatially varying polarizer receive light from the first spatially varying polarizer, passes the focused light of the first polarization state, and transforms the light of the second polarization state into the first polarization state, thereby providing only light of the first polarization state at the output of the polarization recycling structure. The polarization recycling structures improve the efficiency of lighting subsystems, thereby reducing power consumption, cost, space requirements, and providing other advantages.
The present disclosure is directed to systems and methods of eye tracking for use in various applications, such as virtual reality or augmented reality applications that include head-mounted display devices. An eye tracking subsystem may be provided that includes a plurality of assemblies that each include a light source, such as an LED, a light detector, such as a silicon photodiode, and a polarizer that is configured to prevent light reflected via specular reflection from reaching the light detectors so that only scattered light is detected by the light detectors. Machine learning or other techniques may be used to track or otherwise determine a user's gaze direction, which may be used by one or more components of an HMD device to improve its functionality in various ways.
Systems and methods for tracking the position of a head-mounted display (HMD) system component, such as a wearable HMD device or a hand-held controller. The HMD component may include a support structure that carries a plurality of angle sensitive detectors that are able to detect the angle of arrival of light emitted from a light source. A processor causes light sources to emit light according a specified pattern, and receive sensor data from the plurality of angle sensitive detectors. The processor may process the received sensor data using machine learning or other techniques to track a position of the head-mounted display component based on the processing of the received sensor data.
A rendering workload for an individual frame can be split between a head-mounted display (HMD) and a host computer that is executing an application. To split a rendering workload for a frame, the HMD may send head tracking data to the host computer, which may be used by the host computer to generate pixel data associated with the frame and extra data in addition to the pixel data. The extra data can include, without limitation, pose data, depth data, motion vector data, and/or extra pixel data. The HMD may receive the pixel data and at least some of the extra data, determine an updated pose for the HMD, and apply re-projection adjustments to the pixel data based on the updated pose and the received extra data to obtain modified pixel data, which is used to present an image on the display panel(s) of the HMD.
A head-mounted display, or other near-to-eye display, incorporates optics that include a spatially-varying retarder (SVR). The SVR may be manufactured with a correction factor applied thereto in order to compensate for one or more manufacturing errors that are exhibited in a molded lens and/or a polarizing beam splitter included in the optics of the system.
A trained machine learning model(s) is used to determine scores indicative of probabilities that certain types of user input will be provided to a player's game controller while playing a video game in order to compensate for latency between player action and player perception of video game content relating to the player action. In an example process, sensor data received from a client machine and/or game state data received from a video game is provided as input to a trained machine learning model(s), and a score as output therefrom, the score relating to a probability that a type of user input will be provided to a player's game controller. In this manner, game control data corresponding to the type of user input can be generated based on the score and provided to the video game as input before actual game control data is even received.
Systems and methods for providing an optical system in a head-mounted display (HMD) that is operable to modify virtual image light to correct for one or more vision conditions of a user's eyes. The optical system includes a left optical subsystem for the left eye and a right optical system for the right eye. Each optical subsystem includes a first correction portion and a second correction portion each having a lens assembly. A first lens assembly includes a first set of lenses having a first lens selectively adjustable along a first axis transverse to an optical path of the virtual image light. A second lens assembly includes a second set of lenses having a second lens selectively rotatable around a second axis transverse to the first axis. Selective adjustment of the first lens and the second lens helps to correct for the vision conditions in the user's eyes.
G02B 7/02 - Mountings, adjusting means, or light-tight connections, for optical elements for lenses
G02B 7/09 - Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification adapted for automatic focusing or varying magnification
G02C 7/08 - Auxiliary lenses; Arrangements for varying focal length
40.
MACHINE-LEARNED TRUST SCORING BASED ON SENSOR DATA
A trained machine learning model(s) is used to determine scores for user accounts registered with a video game service, and the scores are used to match players together in multiplayer video game settings. For example, sensor data received from client machines can be input to the trained machine learning model(s), and the model(s) generates scores as output, which relate to probabilities that the game control data received from those client machines was generated by handheld devices, as opposed to having been synthesized and/or modified using software. In this manner, subsets of logged-in user accounts executing a video game can be assigned to different matches (e.g., by isolating non-human players from human players) based at least in part on the scores determined for those logged-in user accounts, and the video game is executed in the assigned match for each logged-in user account.
A63F 13/30 - Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
A63F 13/79 - Game security or game management aspects involving player-related data, e.g. identities, accounts, preferences or play histories
A63F 13/85 - Providing additional services to players
G07F 17/32 - Coin-freed apparatus for hiring articles; Coin-freed facilities or services for games, toys, sports, or amusements
Described herein are, among other things, techniques to enable a user to navigate a color picker or other graphical-user-interface (GUI) tool using an input device of a handheld controller. For example, a user may operate a color picker presented on a display by pressing upwards on a joystick to activate selection of hue. In some instances, the user may also operate the joystick to alter a tint, tone, shade, or brightness.
G06F 3/0487 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
A63F 13/533 - Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game for prompting the player, e.g. by displaying a game menu
A63F 13/42 - Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
A head-mounted display including a front, a back, a first actuator, a second actuator, a first adjustable member extending between the front and the back and operably engaging the first actuator, and a second adjustable member extending between the front and the back and operably engaging the second actuator. The first adjustable member and the second adjustable member may be adjustable in length via the second actuator to vary a gap distance between the front and the back. In some embodiments, the head-mounted display may include a wire routing assembly for routing wire(s) between the front and the back of the head-mounted display. Additionally, in some embodiments, the head-mounted display may include a harness for engaging a user.
Described herein are, among other things, techniques, devices, and systems for generating one or more trained machine-learning models used for generating content-item recommendations. Also described herein are techniques, devices, and systems for applying a consumption history of a particular user to the trained model(s) to generate score data indicating a correlation between each content-item title and the consumption history, as well as modifying this score data using one or more biasing factors for generating result data. In addition, the techniques, devices, and systems may use this result data, along with received user input, for determining an order in which to present one or more content items to the user. For example, this may include determining which content items to recommend to a user and in which order to do so.
A63F 13/79 - Game security or game management aspects involving player-related data, e.g. identities, accounts, preferences or play histories
A63F 9/24 - Games using electronic circuits not otherwise provided for
A63F 13/00 - Video games, i.e. games using an electronically generated display having two or more dimensions
A63F 13/35 - Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers - Details of game servers
G06Q 30/02 - Marketing; Price estimation or determination; Fundraising
G06Q 99/00 - Subject matter not provided for in other groups of this subclass
Described herein are, among other things, techniques, devices, and systems for generating one or more trained machine-learning models. Also described herein are techniques, devices, and systems for applying a consumption history of a particular user to the trained model(s) to generate score data indicating a correlation between each content-item title and the consumption history. The techniques then determine a ranked list of content items having a highest correlation to the consumption history, which may be used to retrieve videos associated with the most-correlated content items for generating a compilation video composed of these retrieved videos.
H04N 21/25 - Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication or learning user preferences for recommending movies
H04N 21/442 - Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed or the storage space available from the internal hard disk
H04N 21/466 - Learning process for intelligent management, e.g. learning user preferences for recommending movies
H04N 21/482 - End-user interface for program selection
The logic of a handheld controller system may use a clustering algorithm to determine which sensors of a touch sensor array, such as capacitive pads, to assign to individual fingers of a user's hand. The clustering algorithm disclosed herein allows for dynamically determining the controller configuration on-the-fly for a given user. An example process includes receiving data generated by a plurality of sensors of a touch sensor array of the handheld controller, generating a covariance matrix that indicates correlations between pairs of sensors, determining a plurality of feature vectors based at least in part on the covariance matrix, each feature vector corresponding to an individual sensor and describing that sensor's correlation(s) with one or more other sensors, clustering the feature vectors using a clustering algorithm, and configuring the touch sensor array according to a controller configuration that assigns sensors to respective fingers of a hand.
G06F 3/044 - Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06K 9/62 - Methods or arrangements for recognition using electronic means
A63F 13/214 - Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
Described herein are, among other things, techniques to enable a user to navigate a color picker or other graphical-user-interface (GUI) tool using an input device of a handheld controller. For example, a user may operate a color picker presented on a display by pressing upwards on a joystick to activate selection of hue, down and to the left to activate selection of saturation, and down and to the right to activate selection of lightness or value.
A63F 13/2145 - Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads the surface being also a display device, e.g. touch screens
A63F 13/24 - Constructional details thereof, e.g. game controllers with detachable joystick handles
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
G06F 3/0338 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of limited linear or angular displacement of an operating part of the device from a neutral position, e.g. isotonic or isometric joysticks
G06F 3/044 - Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
48.
DISPLAY SYSTEM WITH DYNAMIC LIGHT OUTPUT ADJUSTMENT FOR MAINTAINING CONSTANT BRIGHTNESS
Light output of a display can be dynamically adjusted on-the-fly. When implemented on a low-persistence display that supports a variable refresh rate, this adjustment maintains a constant brightness over a series of frames to eliminate flickering of the display. When pixel data of a given frame is output to a frame buffer for presenting an image on the display, a time difference between an illumination of the display's light emitting elements for a preceding frame and an upcoming illumination of the light emitting elements for the given frame may be determined, and this time difference is used to determine a value of a light output parameter. During presentation of the image, the light emitting elements can be illuminated in accordance with the value of the light output parameter. This determination iterates over a series of frames to dynamically adjust the display's light output.
An electronic controller includes a controller body having a head that adjoins a handle at a neck region, and that includes at least one thumb-operated control. The controller includes a hand retainer that in a closed position is configured to physically bias the users palm against an outer surface of the handle. The hand retainer includes a resilient member that biases the hand retainer towards an open position. An adjustment mechanism couples the resilient member to the head and permits the resilient member to be adjusted between a plurality of discrete positions to adjust the resilient member towards or away from the users purlicue. The adjustment mechanism may include an anchor that is movable peripherally about the head between the plurality of discrete positions and is pivotably attached to the resilient member with a two-part fastener, with a friction member interposed between the resilient member and the anchor.
A63F 13/212 - Input arrangements for video game devices characterised by their sensors, purposes or types using sensors worn by the player, e.g. for measuring heart beat or leg activity
A63F 13/00 - Video games, i.e. games using an electronically generated display having two or more dimensions
A63F 13/20 - Input arrangements for video game devices
A63F 13/21 - Input arrangements for video game devices characterised by their sensors, purposes or types
A63F 13/24 - Constructional details thereof, e.g. game controllers with detachable joystick handles
A63F 13/245 - Constructional details thereof, e.g. game controllers with detachable joystick handles specially adapted to a particular type of game, e.g. steering wheels
50.
ADJUSTABLE HEAD-MOUNTED DISPLAY TO ACCOMMODATE DIFFERENT HEAD AND FACE SIZES
A head-mounted display (HMD) includes various features that allow for customizing the HMD to different users. The HMD may include an interpupillary distance (IPD) adjustment mechanism that includes a double biasing assembly for smooth, controlled adjustment of the spacing between lens tubes. The HMD may include a field of view (FOV) adjustment mechanism that includes first and second gear assemblies connected via a connecting rod to allow uniform adjustment of the spacing between the lenses and the user's face. The HMD may further include a swappable face gasket, a swappable visor, a removable head strap, and a modular accessory compartment for further customizations to the HMD. The HMD may further include inconspicuous spectrum-transmissive windows that are made with a spectrum-transmissive base material for the HMD housing that is coated with a spectrum-opaque material, and the spectrum-opaque material is selectively removed.
This application describes a head-mounted display (HMD) for use in virtual-reality (VR) environments. The systems and methods described herein may determine information about a real-world environment surrounding the user, a location of the user within the real-world environment, and/or a pose of the user within the real-world environment. Such information may allow the HMD to display images of the real-world environment in a pass-through manner and without detracting the user from the VR environment. In some instances, the HMD may pass-through images of the real-world environment based on one or more triggering events.
A handheld video game controller is operable in Bluetooth Low Energy (BLE) mode to allow for sending controller input data to a target BLE device in a manner that bypasses any operating system (OS) restrictions that might otherwise be imposed on game controller input. When operating in the BLE mode, the handheld video game controller pairs (establishes a radio link) with a BLE device executing a client application used for video game streaming. During gameplay, the video game executes on a host computer and the player provides user input to the game controller to control an aspect of the video game. In response to such user input, the game controller sends controller input data to the BLE device via a radio of the game controller. The player may switch between operating the game controller in BLE mode and receiver mode using input gestures on the game controller.
Various embodiments are directed towards employing one or more physical sensors arranged on or in proximity to a video game player to obtain biofeedback measures that are then useable to dynamically modify a state of play of a video game. The sensors may be connected or even unconnected to the game player, replace, or otherwise augment traditional physical game controllers. The sensors gather various biofeedback measures and provide such measures to a biofeedback application programming interface (API). Before and/or during video game play, the video game queries the biofeedback API to request inferences about the game player's internal state. Responses are then used to modify the state of the video game play. Where the video game is a multi-player video game, biofeedback measures from other game players may also be obtained and used to further modify the state of the video game play.
Logic of a handheld controller can implement sensor fusion algorithms based on force data provided by a force sensing resistor (FSR) in combination with touch sensor data provided by a touch sensor. An example sensor fusion algorithm can be used to pause calibration adjustments for the touch sensor - at least with respect to a high-level value that corresponds to a touch of a control - in response to a user pressing upon the control of the handheld controller with an above-threshold amount of force, which may be detected by a FSR associated with the control. For instance, calibration adjustments with respect to the high-level value can be paused in response to FSR values crossing a threshold value from below the threshold value to above the threshold value, and the calibration adjustments can be resumed in response to the FSR values crossing the threshold value in the opposite direction.
G06F 3/041 - Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
G06F 3/044 - Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
A method including determining a range of values for a proximity sensor, receiving proximity data from the proximity sensor, decaying a limit associated with a maximum value, decaying a limit associated with a minimum value, determining a range of values detected by the proximity sensor, and determining an updated scale factor for the proximity sensor.
A63F 13/22 - Setup operations, e.g. calibration, key configuration or button assignment
G01B 11/14 - Measuring arrangements characterised by the use of optical techniques for measuring distance or clearance between spaced objects or spaced apertures
H03K 17/955 - Proximity switches using a capacitive detector
The application is directed to techniques, devices, and systems for updating files. For example, a remote system may store first data representing a first version of a file and second data representing a second version of the file. The remote system may then determine that a first portion of the first data corresponds to a first portion of the second data. Based at least in part on the determination, the remote system may identify a second portion of the first data using the first portion of the first data and identify a second portion of the second data using the first portion of the second data. The remote system may then generate third data representing a difference between the second portion of the second data and the second portion of the first data. Additionally, the remote system may store the third data in association with the file.
G06F 15/16 - Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs
57.
WIRELESS DATA TRANSPORT SYSTEM FOR HEAD-MOUNTED DISPLAYS
Systems and methods for providing low latency and high bandwidth wireless data transport for various applications, such as virtual reality, augmented reality, or video applications. A wireless data transport system is provided that includes an electrically steerable antenna, such as a phased-array antenna, that is operative to selectively steer its beam based on control input. The wireless data transport system includes a tracking subsystem that is operative to track a mobile wireless device (e.g., head-mounted display (HMD), tablet computer, smart phone) as the mobile wireless device moves around in a tracked volume. The wireless data transport system utilizes the known position, orientation, or movement of the mobile wireless device receiving the data (e.g., video data) from the tracking subsystem and compensates for movement of the mobile wireless device by selectively adjusting the beamforming pattern of the steerable antenna based at least in part on the tracking data received from the tracking subsystem.
G06T 7/70 - Determining position or orientation of objects or cameras
H01Q 3/28 - Arrangements for changing or varying the orientation or the shape of the directional pattern of the waves radiated from an antenna or antenna system varying the distribution of energy across a radiating aperture varying the amplitude
H01Q 3/30 - Arrangements for changing or varying the orientation or the shape of the directional pattern of the waves radiated from an antenna or antenna system varying the distribution of energy across a radiating aperture varying the phase
H01Q 21/06 - Arrays of individually energised antenna units similarly polarised and spaced apart
H04B 7/04 - Diversity systems; Multi-antenna systems, i.e. transmission or reception using multiple antennas using two or more spaced independent antennas
H04B 7/06 - Diversity systems; Multi-antenna systems, i.e. transmission or reception using multiple antennas using two or more spaced independent antennas at the transmitting station
58.
COUNTERROTATION OF DISPLAY PANELS AND/OR VIRTUAL CAMERAS IN A HMD
A head-mounted display (HMD) system may include a HMD with a housing and a pair of display panels, mounted within the housing, that are counterrotated in orientation. A compositor of the HMD system may also be configured to provide camera pose data with counterrotated camera orientations to an executing application (e.g., a video game application), and to resample the frames received from the application, with or without rotational adjustments in the clockwise and counterclockwise directions depending on whether the display panels of the HMD are upright-oriented or counterrotated in orientation. A combined approach may use the counterrotated camera orientations in combination with counterrotated display panels to provide a HMD with optimized display performance.
A head-mounted display (HMD) with a rolling illumination display panel can dynamically target a render time for a given frame based on eye tracking. Using this approach, re-projection adjustments are minimized at the location of the display(s) where the user is looking, which mitigates unwanted, re-projection-based visual artifacts in that "region of interest." For example, logic of the HMD may predict a location on the display panel where a user will be looking during an illumination time period for a given frame, determine a time, within that illumination time period, at which an individual subset of the pixels that corresponds to the predicted location will be illuminated, predict a pose that the HMD will be in at the determined time, and send pose data indicative of this predicted pose to an application for rendering the frame.
A method including receiving data corresponding to one or more objects in proximity to the controller, determining scores for controller configurations of the controller, ranking the scores of controller configurations, selecting a controller configuration among the controller configurations, and configuring a touch sensor of the controller according to a selected controller configuration.
A63F 9/24 - Games using electronic circuits not otherwise provided for
G06F 3/045 - Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact
G09G 5/00 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
61.
PLAYER BIOFEEDBACK FOR DYNAMICALLY CONTROLLING A VIDEO GAME STATE
Various embodiments are directed towards employing one or more physical sensors arranged on or in proximity to a video game player to obtain biofeedback measures that are then useable to dynamically modify a state of play of a video game. The sensors may be connected or even unconnected to the game player, replace, or otherwise augment traditional physical game controllers. The sensors gather various biofeedback measures and provide such measures to a biofeedback application programming interface (API). Before and/or during video game play, the video game queries the biofeedback API to request inferences about the game player's state of arousal. The response to the query is then used to modify the state of the video game play. Where the video game is a multi-player video game, biofeedback measures from other game players may also be obtained and used to further modify the state of the video game play.
Described herein are, among other things, handheld controllers that include one or more touchpads (i.e., touch-sensitive controls) configured to detachably couple to one or more overlays that effectively transform the respective touchpad into a different control. For instance, one example handheld controller may include a circular trackpad that is configured to detect a position of a finger on a top surface of the trackpad. This position may be used to control a cursor or avatar, for scrolling, or for any other type of command. In general, most or all of the top surface may be usable by a user for providing input to the controller and/or a remote system coupled to the controller. As described herein, however, one or more different overlays may detachably couple to a housing of the controller and/or the trackpad itself to effectively change the use of the trackpad.
A63F 13/24 - Constructional details thereof, e.g. game controllers with detachable joystick handles
A63F 13/214 - Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
Disclosed herein are techniques and systems for classifying and moderating text using a machine learning approach that is based on a word embedding process. For instance, word embedding vectors may be used to determine clusters of associated text (e.g., similar words) from a corpus of comments maintained by a remote computing system. The remote computing system may then identify, within the corpus of comments, a subset of comments that include text from a given cluster that was determined, from human labeling input, to include a particular type of word or speech. Using this information, the corpus of comments may be labeled with one of multiple class labels. A machine learning model(s) may be trained to classify text as one of the multiple class labels using a sampled set of labeled comments as training data. At runtime, text can be moderated based on its class label.
Described herein are motion smoothing techniques for a display system to account for motion of moving or animating objects in a way that mitigates judder. For example, first pixel data and second pixel data associated with two previously-rendered frames may be provided to a graphics processing unit (GPU) as input. The video encoder of the GPU can process the input pixel data to generate an array of motion vectors which is used to modify third pixel data of a re-projected frame. The modified third pixel data for the re-projected frame is "motion-smoothed" for rendering on a display, such as a head-mounted display (HMD), in a manner that mitigates judder of moving or animating objects.
H04N 19/13 - Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
H04N 19/134 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
H04N 19/136 - Incoming video signal characteristics or properties
H04N 19/137 - Motion inside a coding unit, e.g. average field, frame or block difference
H04N 19/139 - Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
65.
REDUCED BANDWIDTH STEREO DISTORTION CORRECTION FOR FISHEYE LENSES OF HEAD-MOUNTED DISPLAYS
Systems and methods of providing stereo depth cameras for head-mounted display systems that require less memory and/or processing power. The stereo depth camera may include a left camera and a right camera spaced apart from each other by a distance. Each of the left and right cameras may be skewed outward by a non-zero angle from a forward direction of the head-mounted display system to provide a relatively wide field of view for the stereo depth camera. Each of the left and right cameras may include a camera sensor array and a camera lens positioned forward of the camera sensor array. Each of the camera lenses may include an optical axis that is laterally offset from the center of the associated camera sensor array toward a center of the support structure to center the left camera lens substantially on a scene center or principal point.
An augmented reality (AR) system allows for providing AR in video games. The disclosed AR system allows for layering AR content on top of the built-in features of video games to provide a unique "in-game" AR experience for gamers. A remote computing system provides a central data warehouse for AR content and related data that may be accessed by select client machines to render augmented frames with AR content. The AR content may be spatially-relevant AR content that is rendered at appropriate locations within a game world. The AR content may be event specific such that the AR content is added in response to game-related events. The disclosed AR system allows for adding multiplayer aspects to otherwise single player games, and/or sharing of AR content in real-time to provide augmentative features such as spectating, mixing of game worlds, and/or teleportation through AR objects.
A63F 13/26 - Output arrangements for video game devices having at least one additional display device, e.g. on the game controller or outside a game booth
A63F 13/35 - Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers - Details of game servers
A63F 13/86 - Watching games played by other players
Described herein are, among other things, handheld controllers that include housings having one or more receiver portions for detachably coupling to one or more controls. For example, a housing of one such controller may include, on a front surface of the housing, a receiver that is configured to detachably couple to one or more joysticks, one or more D-pads, one or more track pads, one or more buttons, and/or the like. In some instances, a user may swap a first control for a second control based on a current application (e.g., game title) that the user is playing, based on comfort of the user, and/or for any other reason.
A63F 13/24 - Constructional details thereof, e.g. game controllers with detachable joystick handles
A63F 13/20 - Input arrangements for video game devices
G05G 9/047 - Manually-actuated control mechanisms provided with one single controlling member co-operating with two or more controlled members, e.g. selectively, simultaneously the controlling member being movable in different independent ways, movement in each individual way actuating one controlled member only in which movement in two or more ways can occur simultaneously the controlling member being movable by hand about orthogonal axes, e.g. joysticks
G06F 1/16 - Constructional details or arrangements
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/033 - Pointing devices displaced or positioned by the user; Accessories therefor
68.
SYSTEMS AND METHODS FOR LONG REACH HIGH EFFICIENCY POWER DISTRIBUTION
Systems and methods for distributing power over a relatively long distance by sending high frequency alternating current (AC) over a transmission subsystem between a sender subsystem and a receiver subsystem. Power may be sent from the sender subsystem to the receiver subsystem over a transmission subsystem that includes first and second conductors, such as pair of shielded or unshielded wires twisted together. The sender subsystem may utilize a resonant converter to provide sinusoidal oscillation, which greatly reduces the radio emissions normally caused in DC systems due to high frequency current draws by a load. The receiver system may include a resonant converter or discontinuous conduction mode flyback converter, which provides DC power to a load.
H02M 3/335 - Conversion of dc power input into dc power output with intermediate conversion into ac by static converters using discharge tubes with control electrode or semiconductor devices with control electrode to produce the intermediate ac using devices of a triode or a transistor type requiring continuous application of a control signal using semiconductor devices only
H02M 3/28 - Conversion of dc power input into dc power output with intermediate conversion into ac by static converters using discharge tubes with control electrode or semiconductor devices with control electrode to produce the intermediate ac
A trained machine learning model(s) is used to determine scores (e.g., trust scores) for user accounts registered with a video game service, and the scores are used to match players together in multiplayer video game settings. In an example process, a computing system may access data associated with registered user accounts, provide the data as input to the trained machine learning model(s), and the trained machine learning model(s) generates the scores as output, which relate to probabilities of players behaving, or not behaving, in accordance with a particular behavior while playing a video game in multiplayer mode. Thereafter, subsets of logged-in user accounts executing a video game can be assigned to different matches based at least in part on the scores determined for those logged-in user accounts, and the video game is executed in the assigned match for each logged-in user account.
A63F 13/79 - Game security or game management aspects involving player-related data, e.g. identities, accounts, preferences or play histories
A63F 13/00 - Video games, i.e. games using an electronically generated display having two or more dimensions
A63F 13/30 - Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
A63F 13/537 - Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game using indicators, e.g. showing the condition of a game character on screen
G06Q 30/02 - Marketing; Price estimation or determination; Fundraising
G06Q 99/00 - Subject matter not provided for in other groups of this subclass
70.
HEAD-MOUNTED DISPLAY (HMD) WITH SPATIALLY-VARYING RETARDER OPTICS
A head-mounted display, or other near-to-eye display, incorporates optics that include a spatially-varying retarder (SVR). The SVR may include one or more layers of birefringent material. Light that enters and exits the SVR experiences a change in polarization where the phase of the light is modified by amounts that are different for different portions of the SVR. Focal length of light of an image generated by a pixelated display device is shortened by the optics so that the image can be focused onto a user's eye, which is relatively close to the pixelated display device.
Described herein are techniques for adjusting a prediction level and a throttle level, as frames are being rendered on a head-mounted display (HMD), based on an application's rendering performance. The prediction level is increased if a number of late frames, out of a past N rendered frames (N being any suitable number), meets or exceeds a threshold number of late frames, which causes a compositor of the HMD to predict pose data of the HMD farther out into the future. The throttle level can be increased independently from, or in synchronization with, the increase in the prediction level to causes the compositor to throttle the frame rate of the application (e.g., to a fraction of the refresh rate of the HMD). The prediction level (and the throttle level, if at the same level) can be decreased if a particular number of consecutively-rendered frames finish rendering early.
A panel mask(s) rendered on a display panel(s) of a head-mounted display (HMD) may be dynamically adjusted (increased/decreased) in size to hide unwanted visual artifacts from view, as needed. For example, if frames are being rendered on the display panel of the HMD using re-projection, a size value associated with at least a portion of the panel mask can be adjusted based on rotation of the HMD to increase or decrease a size of at least the portion of the panel mask from a current size to an adjusted size, and the panel mask can be rendered with at least the portion of the panel mask at the adjusted size to hide unwanted visual artifacts. The size of the portion of the panel mask can subsequently decrease, over a period of time, if re-projection ceases and/or if head rotation ceases or slows down.
Techniques and devices for holding and releasing virtual objects on a display based on input received from one or more handheld controllers are described herein. In some instances, a handheld controller includes one or more sensors, such as proximity sensors, force sensors (e.g., force resisting sensors, etc.), accelerometers, and/or other types of sensors configured to receive input from a hand of a user gripping the handheld controller. Hardware, software, and/or firmware on the controller and/or on a device coupled to the controller (e.g., a game console, a server, etc.) may receive data from these sensors and generate a representation of a corresponding gesture on a display, such as a monitor, a virtual-reality system, and/or the like.
A63F 13/211 - Input arrangements for video game devices characterised by their sensors, purposes or types using inertial sensors, e.g. accelerometers or gyroscopes
A63F 13/218 - Input arrangements for video game devices characterised by their sensors, purposes or types using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
A63F 13/428 - Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form
G06T 19/20 - Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
A method including receiving at least one of touch data or force data representing a touch input received at the controller, determining one or more model(s), generating image data using the one or more models, the image data representing at least a hand gesture corresponding to the touch input received at the controller, and transmitting the image data to a virtual reality (VR) environment for display.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
A63F 13/00 - Video games, i.e. games using an electronically generated display having two or more dimensions
G06F 3/041 - Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
A63F 13/428 - Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
Techniques and devices for determining how to present the release of the virtual object based at least in part on received sensor data is described herein. For example, when the hardware and/or software determines that the virtual object is to be released, the hardware and/or software may calculate one or more of a velocity of the object (e.g., speed and direction), a position at which the virtual object is to be released, a trajectory of the virtual object from the position of release to the landing point of the virtual object, a landing location of the virtual object, and/or the like. The hardware and/or software may then present the virtual object being released according to this determined information.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
A63F 13/211 - Input arrangements for video game devices characterised by their sensors, purposes or types using inertial sensors, e.g. accelerometers or gyroscopes
A63F 13/212 - Input arrangements for video game devices characterised by their sensors, purposes or types using sensors worn by the player, e.g. for measuring heart beat or leg activity
A63F 13/2145 - Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads the surface being also a display device, e.g. touch screens
A63F 13/27 - Output arrangements for video game devices characterised by a large display in a public venue, e.g. in a movie theatre, stadium or game arena
G09G 5/00 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
76.
SENSOR FUSION ALGORITHMS FOR A HANDHELD CONTROLLER THAT INCLUDES A FORCE SENSING RESISTOR (FSR)
Logic of a handheld controller can implement sensor fusion algorithms based on force data provided by a force sensing resistor (FSR) in combination with touch data or proximity data provided by a touch sensor or an array of proximity sensors, respectively. An example sensor fusion algorithm can be used to re-calibrate the FSR when an object contacts an associated control, as detected by the touch sensor. Another example sensor fusion algorithm can be used to ignore spurious inputs detected by the FSR when an object is in contact with an adjacent control. Another example sensor fusion algorithm can be used to detect a hand size of a hand grasping a handle of the controller, as detected by the array of proximity sensors, and to adjust the threshold force to register a FSR input event at the FSR according to the hand size.
A63F 13/24 - Constructional details thereof, e.g. game controllers with detachable joystick handles
A63F 13/214 - Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
A63F 13/218 - Input arrangements for video game devices characterised by their sensors, purposes or types using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
A63F 13/44 - Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment involving timing of operations, e.g. performing an action within a time slot
G06F 3/038 - Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
G06F 3/041 - Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
77.
POWER MANAGEMENT FOR OPTICAL POSITION TRACKING DEVICES
Described herein are devices and techniques for managing power consumption of a position tracking device. The position tracking device may be a virtual reality (VR) controller having multiple optical sensors oriented to receive optical signals from different directions. A stationary optical emitter projects a laser line into a space and repeatedly scans the laser line through the space. For any given scan, some of the sensors may detect the laser line and some of the sensors may not detect the laser line because they are oriented away from the emitter or because of a blocking object. When an individual sensor fails to detect a laser scan, that sensor is disabled for one or more subsequent laser scans in order to reduce power consumption of the VR controller.
A63F 13/21 - Input arrangements for video game devices characterised by their sensors, purposes or types
A63F 13/213 - Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
A63F 13/219 - Input arrangements for video game devices characterised by their sensors, purposes or types for aiming at specific areas on the display, e.g. light-guns
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G01S 1/70 - Beacons or beacon systems transmitting signals having a characteristic or characteristics capable of being detected by non-directional receivers and defining directions, positions, or position lines fixed relatively to the beacon transmitters; Receivers co-operating therewith using electromagnetic waves other than radio waves
G01S 7/481 - Constructional features, e.g. arrangements of optical elements
G01S 15/06 - Systems determining position data of a target
H02J 50/90 - Circuit arrangements or systems for wireless supply or distribution of electric power involving detection or optimisation of position, e.g. alignment
78.
FORCE SENSING RESISTOR (FSR) WITH POLYIMIDE SUBSTRATE, SYSTEMS, AND METHODS THEREOF
A force sensing resistor (FSR) that is constructed with a first substrate made of polyimide disposed underneath a second substrate that is resistive and flexible. A handheld controller for an electronic system may include the FSR having a first substrate made of polyimide. The FSR may be mounted on a planar surface of a structure within the controller body, such as a structure mounted within a handle of the controller body, and/or a structure that is mounted underneath at least one thumb-operated control that is included on a head of the controller body. The FSR may be configured to measure a resistance value that corresponds to an amount of force applied to an outer surface of the handle and/or an amount of force applied to the at least one thumb-operated control.
H01C 10/10 - Adjustable resistors adjustable by mechanical pressure or force
G01L 1/20 - Measuring force or stress, in general by making use of electrokinetic cells, i.e. liquid-containing cells wherein an electrical potential is produced or varied upon the application of stress
G06F 3/045 - Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact
A63F 13/218 - Input arrangements for video game devices characterised by their sensors, purposes or types using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
79.
AUTOMATICALLY REDUCING USE OF CHEAT SOFTWARE IN AN ONLINE GAME ENVIRONMENT
Techniques are described for automatically reducing cheating in an interactive execution environment, such as to perform automated operations to detect and stop use of cheat software in an online game environment, and to restrict subsequent access to the online game environment for users who are identified as using cheat software. The techniques may include using deep learning techniques to train one or more models to classify particular types of gameplay actions as being unauthorized if cheat software use is detected, including to determine a likelihood of whether a separate cheat detection decision system would decide that particular gameplay actions are authorized or not authorized if the additional cheat detection decision system assesses those gameplay actions, and then using the trained model(s) and in some cases the additional cheat detection decision system for the cheat software detection and prevention.
A63F 13/75 - Enforcing rules, e.g. detecting foul play or generating lists of cheating players
A63F 13/73 - Authorising game programs or game devices, e.g. checking authenticity
A63F 13/71 - Game security or game management aspects using secure communication between game devices and game servers, e.g. by encrypting game data or authenticating players
A63F 13/79 - Game security or game management aspects involving player-related data, e.g. identities, accounts, preferences or play histories
G06F 21/51 - Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems at application loading time, e.g. accepting, rejecting, starting or inhibiting executable software based on integrity or source reliability
80.
HANDHELD CONTROLLERS WITH TOUCH-SENSITIVE CONTROLS
Described herein are, among other things, handheld controllers having touch-sensitive controls, as well as methods for use of the touch-sensitive controls and methods for assembling the handheld controllers. An example handheld controller may include a top-surface control (e.g., a "trigger button") that includes a switch, a pressure sensor, and a touch sensor for detecting a presence, location, and/or gesture of a finger on the top-surface control.
A63F 13/218 - Input arrangements for video game devices characterised by their sensors, purposes or types using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
A63F 13/24 - Constructional details thereof, e.g. game controllers with detachable joystick handles
A63F 13/245 - Constructional details thereof, e.g. game controllers with detachable joystick handles specially adapted to a particular type of game, e.g. steering wheels
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/02 - Input arrangements using manually operated switches, e.g. using keyboards or dials
G06F 3/041 - Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
G06F 3/044 - Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
81.
CONTROLLING IMAGE DISPLAY VIA MAPPING OF PIXEL VALUES TO PIXELS
e.ge.g., by using a 1-to-M mapping of image pixel values to display panel pixels for each such secondary region, where M is greater than 1, such that each such image pixel value controls the display of M such pixels). The image data may further be encoded and optionally decoded in accordance with such a display panel arrangement, such as to encode the image data per the display panel arrangement to reduce its size before transmission to the display panel.
Techniques are described for controlling image display via compression of image data in some image regions while performing less or no compression in other (e.g., peripheral view) regions, with color-specific compression preserving chromatic aberration compensation. Such techniques may be used with display panel(s) of a head-mounted display device used for virtual reality display. A primary region of an image at which to encode and display data at a highest resolution level may be determined by tracking a gaze of a user, while other secondary regions may be selected to be surrounding or other outside the primary region. In the secondary regions, image data for a first (e.g., green) color channel may be encoded at a first compression level for a first resolution level lower higher than for other second color channels, and HDR data may be compressed at higher compression levels than the color-specific data.
Methods and systems relating generally to information displays, and more particularly to systems and methods for backlight assemblies for information displays that emit an angularly narrow cone of light. A backlight assembly that emits a narrow angular cone of light can be particularly beneficial in a head-mounted display configuration, such as for use as part of virtual reality or augmented reality systems, where the head-mounted display comprises a lens assembly that directs light from an information display to the eyes of the user. Such a backlight assembly configuration may help reduce undesirable visual effects like flood illumination, ghost images, glare, and scattering.
H04N 13/332 - Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
G02F 1/29 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the position or the direction of light beams, i.e. deflection
84.
USING DETECTED PUPIL LOCATION TO ALIGN OPTICAL COMPONENTS OF A HEAD-MOUNTED DISPLAY
The disclosure relates generally to techniques for determining pupil location of a display device's user via imaging sensors on the display device, and using that information to verify and/or correct positioning of the display device or its internal components. The display device may be a head-mounted display ("HMD") device with display panels separated from a wearer's eyes via intervening lenses, with the sensors including optical flow sensor integrated circuits mounted on or near at least one of the display panels to capture images of the wearer's eye locations through the lenses, and with the correction to the positioning including modifications to the alignment or other positioning of the HMD device on the wearer user's head and/or its internal components within the HMD device (e.g., based on automated control of motors on the HMD device) to reflect a target alignment of the wearer's eyes relative to displayed information.
Techniques are described for using information from tracking position of a display device to control display of image data. The display device may, for example, be a head-mounted display ("HMD") device used for virtual reality ("VR") and/or augmented reality ("AR") display of images showing part of a simulated environment around a user wearing the HMD device, and the tracking including determining a position of the HMD device in an actual physical environment (e.g., location and/or orientation in 3D space). Operations of the HMD device or other display device and of an associated image rendering system that provides images for display is improved by determining and using information about a latency or other delay between acquiring tracking data for the device and displaying corresponding images on the device, including to initiate a safe mode operation of the device if the determined delay is too large.
A display has an array of light emitting elements. For a given frame of a series of frames that present images on the display at a refresh rate of the display, the light emitting elements may be driven by loading individual subsets of the light emitting elements in sequence with light output data, and by illuminating the individual subsets of the light emitting elements in the sequence and in accordance with the light output data, wherein an illumination time period is within a range of about 2% to 80% of a frame time of the frame, the frame time derivable from the refresh rate. This "rolling burst illumination" technique is characterized by the relatively short illumination time period (e.g., as compared to the frame time), and it can stabilize a scene (or mitigate unwanted visual artifacts) for a viewing user during head motion, as well as optimize display bandwidth utilization.
G09G 3/36 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix by control of light from an independent source using liquid crystals
87.
DISTRIBUTING SHADERS BETWEEN CLIENT MACHINES FOR PRECACHING
Client machines are configured to compile shaders during execution of a program (e.g., a video game) that renders graphics on a display. These client machines may upload information - including a hardware configuration of the client machine, an application identifier (ID) of the program, and a set of shader IDs for compiled shaders - to a remote computing system, which catalogues the shader IDs, selectively requests compiled shader code from one or more of the client machines, and selectively prepares the compiled shader code for redistribution. Thereafter, a requesting client machine with a matching hardware configuration may receive compiled shader code from the remote system for a particular program, and may precache the compiled shader code for use during program execution.
Systems and methods for tracking the position of a head-mounted display (HMD). The HMD may include a support structure that carries a forward facing camera and a plurality of optical flow sensor integrated circuits (ICs). The forward camera captures image sensor data in a forward camera field of view (FOV) at a first frame rate, and each of the plurality of sensor ICs captures image sensor data in a respective plurality of sensor IC FOVs at a second frame rate. The sensor IC FOVs may collectively cover at least a substantial portion of the forward camera FOV. A processor may receive the image sensor data from the camera and the plurality of sensor ICs. The processor may process the received image sensor data and/or other sensor data (e.g., IMU data) to track a position of the head-mounted display based on the processing of the received sensor data.
A controller for an electronic system includes a controller body having a head and a handle, and a tracking member that is fixed to the controller body. The head includes at least one thumb-operated control, and the handle has a tubular housing that is partially wrapped by an outer shell. The controller includes a hand retainer configured to physically bias the user's palm against the outer shell. A first plurality of tracking transducers is disposed in the tracking member, the first plurality of tracking sensors being coupled with the electronic system via electromagnetic radiation. An array of proximity sensors is spatially distributed on the outer shell, the array of proximity sensors being responsive to a proximity of the user's fingers to the outer shell.
A63F 13/24 - Constructional details thereof, e.g. game controllers with detachable joystick handles
A63F 13/214 - Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
90.
ELECTRONIC CONTROLLER WITH FINGER SENSING AND AN ADJUSTABLE HAND RETAINER
A controller for an electronic system includes a tracking member fixed to a controller body. The controller body has a head that adjoins a handle at a neck region, and that includes a thumb-operated control. The controller includes a hand retainer that in a closed position is configured to physically bias the user's palm against an outer surface of the handle. The hand retainer includes a resilient member that biases the hand retainer towards an open position. The resilient member is attached to an anchor that is attached to the head by an adjustment mechanism that permits the resilient member to be moved towards or away from the user's purlicue. The tracking member includes transducers coupled to the electronic system by electromagnetic radiation. Proximity sensors, spatially distributed on the handle, are responsive to a proximity of the user's fingers to the outer surface of the handle.
A63F 13/213 - Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
A63F 13/00 - Video games, i.e. games using an electronically generated display having two or more dimensions
A63F 13/21 - Input arrangements for video game devices characterised by their sensors, purposes or types
A63F 13/24 - Constructional details thereof, e.g. game controllers with detachable joystick handles
A63F 13/245 - Constructional details thereof, e.g. game controllers with detachable joystick handles specially adapted to a particular type of game, e.g. steering wheels
A63F 13/428 - Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
91.
HAND-HELD CONTROLLER WITH A BACK SHELL AND UNDERLYING FORCE SENSITIVE RESISTORS
A hand-held controller includes a controller body having a front and a back, with at least one thumb control on the front of the controller body. A back shell on the back of the controller body has left and right portions, each having top and bottom regions. A first force sensitive resistor (FSR) underlies the top region of the left portion of the back shell. A second FSR underlies the bottom region of the left portion of the back shell. A third FSR underlies the top region of the right portion of the back shell. A fourth FSR underlies the bottom region of the right portion of the back shell.
A controller includes a body having a handle, and an array of proximity sensors spatially distributed on, in, beneath, or near the outer surface of the handle, responsive to a proximity of a user's fingers to that outer surface. A finger tracker converts the output of the array of proximity sensors to a set of joint angles corresponding to a plurality of the user's fingers. The controller may include a renderer for processing the joint angles to deform a hand mesh that is rendered for display. Values may be calculated to facilitate normalization of the output of the proximity sensor array and thereby generate a set of normalized finger detection data. This data may be processed through curl logic to produce a linear estimate of gross finger curl with respect to the user and thereby generate a set of estimates for a plurality of finger joint angles for the user.
The disclosure relates generally to techniques for using information about a user's actual or predicted pupil location for correcting optical distortions that are specific to an optical lens and display assembly through which the user is viewing one or more images. The described techniques may include identifying and mapping optical distortions specific to an optical lens and display assembly, and using such mapped optical distortions to correct images displayed to a wearer or other user receiving images via the assembly, such as based at least in part on pupil location of the wearer or other user. As one example, the one or more optical lens may be mounted inside a head-mounted display (HMD) that also includes a display panel or other image source for an eye of a wearer, and if so one or more pupil tracking mechanisms may be integrated into the HMD.
Systems and methods for providing optical systems which utilize double Fresnel lenses on curved surfaces for use with display systems, such as silicon-based micro display systems (e.g., OLED micro displays) used with head mounted display (HMD) systems. The optical systems disclosed herein may implement multiplexing or blending to provide a smooth profile transition and reduce aberrations between zones or fields (e.g., small FOV angles, large FOV angles) of a Fresnel surface which is defined by multiple Fresnel patterns or functions. An optical system for a micro display is provided which utilizes double Fresnel lenses on curved surfaces to shorten the focal length while maintaining a good shape factor for moldability and aberration control.
B24B 1/00 - Processes of grinding or polishing; Use of auxiliary equipment in connection with such processes
B24B 51/00 - Arrangements for automatic control of a series of individual steps in grinding a workpiece
G01B 11/27 - Measuring arrangements characterised by the use of optical techniques for testing the alignment of axes for testing the alignment of axes
G01B 17/06 - Measuring arrangements characterised by the use of infrasonic, sonic, or ultrasonic vibrations for measuring contours or curvatures
G01S 7/48 - RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES - Details of systems according to groups , , of systems according to group
95.
SENSOR FUSION SYSTEMS AND METHODS FOR EYE-TRACKING APPLICATIONS
Eye-tracking systems and methods for use in consumer-class virtual reality (VR) / augmented reality (AR) applications, among other uses, are described. Certain embodiments combine optical eye tracking that uses camera-based pupil and corneal reflection detection with optical flow hardware running at a higher frequency. This combination provides the accuracy that can be attained with the former and at the same time adds the desirable precision and latency characteristics of the latter, resulting in a higher performing overall system at a relatively reduced cost. By augmenting a camera tracker with an array of optical flow sensors pointed at different targets on the visual field, one can perform sensor fusion to improve precision. Since the camera image provides an overall picture of eye position, that information can be used to cull occluded optical flow sensors, thus mitigating drift and errors due to blinking and other similar phenomena.
A61B 3/113 - Objective types, i.e. instruments for examining the eyes independent of the patients perceptions or reactions for determining or recording eye movement
A61B 3/14 - Arrangements specially adapted for eye photography
G01B 11/00 - Measuring arrangements characterised by the use of optical techniques
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
Methods and apparatus are provided for displaying an image to a viewer, for example in a head- mounted display (HMD) application, with reduced visual artifacts such as screen-door effect. A phase optic is disposed between the HMD lens and the user's eye. The optic changes the distribution of the light so the user's eye cannot focus the light better than the sub-pixel distance. The user can therefore not resolve the sub-pixel structure, and the structure therefore appears as one larger pixel, mitigating the screen-door effect. A significant reduction in screen-door effect visual artifacts arising from the periodic structure of the display panel may therefore be obtained.
G02B 27/14 - Beam splitting or combining systems operating by reflection only
G02B 26/08 - Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
Methods and systems are disclosed for measuring pixel-by-pixel luminosity and/or chrominance variations on a display, encoding and/or storing the measurements as a set of global and/or pixel-by-pixel correction factors, and/or digitally manipulating imagery with the inverse effect as the measured variations, such that the appearance of visual artifacts caused by the variations is reduced. These methods and systems may be used, for example, as part of the production process for virtual reality headsets, as well as in other applications that make high-fidelity use of displays exhibiting such artifacts (e.g., cell phones, watches, augmented reality displays, and the like).
Controller visualization systems and methods for use in virtual/augmented reality environments such as walk-around virtual reality environments are described. The virtual representation of a physical control device may be altered based on the context of the virtual environment. Certain embodiments combine the virtual rendering of the tracked control device with a real-time video representation of part of the operating space. In certain embodiments, the display of additional information relating to the function of interactive elements may be displayed based on context, such as when a specific action is required from a user in the virtual space.
G01S 5/16 - Position-fixing by co-ordinating two or more direction or position-line determinations; Position-fixing by co-ordinating two or more distance determinations using electromagnetic waves other than radio waves
G01S 17/87 - Combinations of systems using electromagnetic waves other than radio waves
G01B 11/00 - Measuring arrangements characterised by the use of optical techniques
Methods and systems are disclosed relating to low f/# lens with desirable imaging characteristics. In certain embodiments, the lens may include an aspheric surface and a Fresnel surface to produce one or more of the following characteristics: a large aperture; a wide field of view; a low spherical aberration and coma; a low field curvature; a monotonic field curvature for both tangential and sagittal planes; and significant but monotonic distortion. A variety of design forms may be used to accomplish the foregoing results including without limitation: an aspheric surface with a Fresnel asphere; a Forbes aspheric surface with a Fresnel asphere; an aspheric surface with a curved, 2-figure Fresnel lens; a Forbes aspheric surface with a curved, 2-figure Fresnel lens; and wide Fresnel zones. The lens may be a single element lens or a multi-element system including a thin field flattener or a negative lens for lateral color collection.
G02B 26/08 - Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
Optical positional tracking systems that may be used in virtual reality (VR) / augmented reality (AR) applications are described. Exemplary implementations comprise one or more receivers and one or more transmitters. Exemplary transmitters contains two orthogonal rotors that each emit a fan- shaped laser beam. Each beam is swept as the rotors are spun at constant speed. Exemplary optical receivers can be relatively small, and mounted at convenient locations on the VR display. These receivers consist of small optical detectors that may be mounted on head-mounted VR displays. Exemplary systems determine position by measuring the time at which each swept beam crosses each receiver/detector.
G01S 3/789 - Systems for determining direction or deviation from predetermined direction using rotating or oscillating beam systems, e.g. using mirrors, prisms
patents
