Described herein are, among other things, techniques, devices, and systems for identifying portions of a new version of an application that are new to the new version and portions of the new version that are common to the new version and a previous version of the application, such that a client computing device may efficiently update from the previous version to the new version.
Described herein are, among other things, techniques, devices, and systems for generating content-item recommendations that are based, at least in part, on data that is unique to respective geographical regions associated with respective users. For instance, the content-item recommendations may be based at least in part on sales data for the respective geographical regions.
Systems and methods for tracking the position of one or more objects, such as components of a head-mounted display (HMD) system. One or more objects may carry a plurality of angle sensitive optical detectors. Each of the optical detectors may include an optical subsystem that is configured to vary at least one of phase or intensity of light imparted on the optical detector. The optical subsystem may include one or more of diffractive optical elements, lens arrays, intensity masks, phase masks, or the like. The optical detectors may include a photodetector that includes a plurality of optically active areas, such as a quadrant cell photodetector, an image sensor with an array of photodiodes, etc. Control circuitry may cause light sources to emit light, and may receive sensor data from the plurality of optical detectors. Control circuitry may process the sensor data to track a position of one or more objects.
There may be large numbers of content items available at current content provider systems. Incentive items may be inserted among content items, for example, associated with content categories, that may reward uses for viewing content items. When incentive items are selected by a user, the user may be associated with credit towards a bonus item or award a bonus item. Incentive items may have associated preference factors that may be manipulated to increase the probability of such incentive items being presented to the user.
G06Q 30/02 - Marketing; Price estimation or determination; Fundraising
H04L 9/32 - Arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system
5.
ACTIVE REDUCTION OF FAN NOISE IN A HEAD-MOUNTED DISPLAY
Described herein are active noise reduction (ANR) techniques for reducing noise produced by a fan(s) of a head-mounted display (HMD). An example process may include receiving data indicative of a noise that is being produced by the fan(s), determining, based at least in part on the data and using a model(s), one or more audio parameter values, and outputting, via one or more off-ear speakers of the HMD, a sound(s) having one or more audio characteristics based at least in part on the one or more audio parameter values to reduce the noise produced by the fan(s) at a location(s) of an ear(s) of the user of the HMD.
G10K 11/16 - Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
A63F 13/54 - Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
G06F 1/16 - Constructional details or arrangements
Client machines running game executables of a video game(s) may utilize a file system proxy component that is configured to track read operations made by the game executable during a game session, to generate access data based on the tracked read operations, and to report the access data to a remote system. This telemetry approach allows the remote system to collect access data reported by multiple client machines, to catalogue the access data according to client system configuration, and to analyze the access data to generate data that is usable by client machines to implement various game-related features including, without limitation, “instant play” of video games, discarding of unused blocks of game data to free up local memory resources, and/or local prefetching of game data for reducing latency during gameplay.
A63F 13/352 - Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers - Details of game servers involving special game server arrangements, e.g. regional servers connected to a national server or a plurality of servers managing partitions of the game world
A63F 13/335 - Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections using Internet
The present disclosure is directed to systems and methods of object tracking for use in various applications, such as eye tracking in virtual reality or augmented reality applications that include head-mounted display devices. An eye tracking system may be provided that includes a plurality of assemblies that each include a light detector, such as a quadrant photodetector, and an imaging lens configured to generate an image of the eye on the quadrant photodetector. Machine learning or other techniques may be used to track or otherwise determine a user's gaze direction, which may be used by one or more components of an HMD device to improve its functionality in various ways.
The present disclosure is related generally to techniques for improving the performance and efficiency of display systems, such as laser scan beam display systems or other types of display systems (e.g., micro-displays) of an HMD system or other device. Display systems of the present disclosure may utilize polarization multiplexing that allow for improved optimization of diffraction optics. In at least some implementations, a display system may selectively polarize light dependent on wavelength (e.g., color) or field of view. An optical combiner may include polarization sensitive diffractive optical elements that are each optimized for a subset of colors or portions of an overall field of view, thereby providing improved correction optics for a display system.
Systems and methods for tracking the position of a head-mounted display (HMD) system component. The HMD component may carry a plurality of angle sensitive detectors that are able to detect the angle of light emitted from a light source. The HMD component may include one or more scatter detectors that detect whether light has been scattered or reflected, so such light can be ignored. Control circuitry causes light sources to emit light according a specified pattern, and receives sensor data from the plurality of angle sensitive detectors. The processor may process the sensor data and scatter detector data, for example using machine learning or other techniques, to track a position of the HMD component. An angle sensitive detector may include a spatially-varying polarizer having a position-varying polarizing pattern and one or more polarizer layers that together are operative to detect the angle of impinging light.
G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G02F 1/139 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells characterised by the electro-optical or magneto-optical effect, e.g. field-induced phase transition, orientation effect, guest-host interaction or dynamic scattering based on orientation effects in which the liquid crystal remains transparent
G02F 1/01 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
11.
Head-mounted display devices with non-rectangular backlight
A head-mounted display device includes a display panel (such as a liquid crystal display), an optics system for focusing a portion of the display onto an eye of a user, and a backlight assembly including a light guide, a plurality of extraction features positioned on a surface of the light guide, and at least one laser diode for directing light into the light guide. The light guide is sized and dimensioned to illuminate only a portion of the display that is focused by the optics system; with the plurality of light extraction features configured to diffuse light toward the display panel for back illuminating the display panel.
Methods and systems are disclosed relating to a lens system that allows for simultaneous focus of near and far-away images with one pair of glasses, heads-up-displays (HUDs), and the like, without the need to move the user's eyes. This lens system may be used in a HUD application, for example, where the user may focus on a display lens that may be approximately one inch from the eye to view computer-generated information such as altitude, temperature, directions, and the like, and simultaneously view the individual's surroundings. The lens system may include a liquid lens that when modulated may vary from a near-focus state to a far-focus state rapidly by using an electrowetting or piezoelectric hydraulic actuator. This variable rate lens may be multiplexed at a rate that allows both near and far-away images to appear in focus simultaneously through the advantageous use of a user's persistence of vision.
C07D 241/26 - Carbon atoms having three bonds to hetero atoms with at the most one bond to halogen, e.g. ester or nitrile radicals with nitrogen atoms directly attached to ring carbon atoms
G02B 26/06 - Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the phase of light
G02B 26/08 - Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
G02B 26/00 - Optical devices or arrangements for the control of light using movable or deformable optical elements
13.
CORRECTION POLARIZATION COMPENSATION OPTIC FOR DISPLAY SYSTEMS
The present disclosure related generally to techniques for improving the performance and efficiency of display systems, such as laser scan beam display systems or other types of display systems (e.g., micro-displays). Display systems of the present disclosure may include a polarization compensation optic, such as a spatially varying polarizer, that provides phase retardation that varies as a function of position, which provides polarization compensation to provide light that is well suited for a polarization sensitive optic of the display system, such as a waveguide-based optical system, a pancake optical system, a birdbath optical system, a coating-based optical system, etc. The display systems of the present disclosure may be components of head-mounted display systems, or other types of display systems.
Systems and methods for providing an optical lens for a head mounted display (HMD) or other application that is cost-effective and has high performance. A lens assembly may include a first, relatively thin lens and a second, relatively thick lens. The first lens may include microfeatures on at least one optical transmission surface thereof. The second lens may include at least one curved surface, such that the second lens is plano-convex, bi-convex, etc. Each of the first lens and the second lens may include mounting areas disposed about a periphery of the respective optical transmission areas of the lenses that include complementary mounting microfeatures thereon that enable the first and second lens to be coupled together and, when so coupled, to be self-aligned with each other within a very low tolerance. The mounting microfeatures may be provided on the lenses using a high precision process (e.g., diamond turning) also used to generate the microfeatures on at least one optical transmission surface of the first, relatively thin, lens of the lens assembly.
A multi-coil voice coil motor (VCM) may be configured to be used as a haptic actuator for providing haptic feedback to a user. When implemented in a handheld controller having one or more controls, the multi-coil VCM may be configured to provide haptic feedback to a user of the controller. The multi-coil VCM may include a housing, multiple concentric coils, and a magnet coupled to the housing. The multiple concentric coils may include a first coil disposed on a first support coupled to the housing and a second coil disposed on a second support coupled to the housing, wherein the multiple concentric coils may have different diameters to allow for the concentricity of the coils. A system may include one or more haptic actuators, such as the multi-coil VCM, the haptic actuator(s) being configured to provide haptic feedback by causing at least a portion of a finger-operated control(s) to vibrate.
H02K 33/18 - Motors with reciprocating, oscillating or vibrating magnet, armature or coil system with coil systems moving upon intermittent or reversed energisation thereof by interaction with a fixed field system, e.g. permanent magnets
G08B 6/00 - Tactile signalling systems, e.g. personal calling systems
An optical system of a head-mounted display (HMD) system that includes a diffractive optical element coupled to a display, for example, via lamination or a suitable optically clear adhesive. The optical system may include a reflective polarizer and a quarter-wave plate that, together with the diffractive optical element, form a catadioptric or “pancake” configuration that focuses light from a display system to an eye of a user of the head mounted display system.
Methods and systems relating to a file distribution scheme in a computer network are disclosed that distributes files in an efficient manner that reduces, among other things, network traffic. In an embodiment of the invention, a method for updating a file is disclosed. In such a method, unique chunks in a first version of a digital file are identified. For a second version of the digital file, chunks that are the same as in the first version are identified. Recompilation information is generated and stored for these identified chunks. Also, for the second version of the digital file, chunks in the second version that are different from chunks in the first version are identified. Recompilation information is generated and stored for these identified chunks. With this information, the second version of the digital file is completely defined and can be efficiently stored.
An optical system is provided that includes a correction portion including one or more spatially varying polarizers. A first spatially varying polarizer of the one or more spatially varying polarizers has a first control input configured to receive a first control signal indicating whether the first spatially varying polarizer is to be active or inactive. When active, the first spatially varying polarizer is operative to provide a first optical correction on light passing through the correction portion. The optical system includes a controller configured to determine whether to implement the first optical correction on the light passing through the correction portion and in response to determining to implement the first optical correction on the light passing through the correction portion, output the first control signal indicating the first spatially varying polarizer is to be active. Additional spatially varying polarizers may be controlled to provide additional or alternative optical corrections.
G02F 1/01 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
G02F 1/139 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells characterised by the electro-optical or magneto-optical effect, e.g. field-induced phase transition, orientation effect, guest-host interaction or dynamic scattering based on orientation effects in which the liquid crystal remains transparent
A handheld video game controller is operable in Bluetooth Low Energy (BLE) mode to allow for sending controller input data to a target BLE device in a manner that bypasses any operating system (OS) restrictions that might otherwise be imposed on game controller input. When operating in the BLE mode, the handheld video game controller pairs (establishes a radio link) with a BLE device executing a client application used for video game streaming. During gameplay, the video game executes on a host computer and the player provides user input to the game controller to control an aspect of the video game. In response to such user input, the game controller sends controller input data to the BLE device via a radio of the game controller. The player may switch between operating the game controller in BLE mode and receiver mode using input gestures on the game controller.
A63F 13/235 - Input arrangements for video game devices for interfacing with the game device, e.g. specific interfaces between game controller and console using a wireless connection, e.g. infrared or piconet
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
H04W 4/80 - Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
H04W 76/20 - Manipulation of established connections
A handheld controller may include controls that are actuatable by a user. The handheld controller may further include one or more sensors that are configured to detect an object in proximity to certain controls, and/or that sense a grip or position of a hand on a handle portion of the controller. Based on data from a sensor(s), certain controls may be enabled and/or disabled. The sensors may therefore be used to determine which controls are being used or are intended to be used, and/or which controls are likely accessible or inaccessible to the user based on sensor data, and to cause one or more controls of the handheld controller to be enabled and/or disabled accordingly.
A63F 13/218 - Input arrangements for video game devices characterised by their sensors, purposes or types using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
A63F 13/98 - Accessories, i.e. detachable arrangements optional for the use of the video game device, e.g. grip supports of game controllers
A63F 13/214 - Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
A63F 13/24 - Constructional details thereof, e.g. game controllers with detachable joystick handles
23.
Position tracking systems and methods for head-mounted display systems
Systems and methods for tracking the position of one or more head-mounted display (HMD) system components of an HMD system. The HMD components may carry a plurality of angle sensitive detectors or other types of detectors. The HMD system may be operative to detect corrupted position tracking samples, allowing such samples to be ignored, thereby improving the position tracking process. Control circuitry causes light sources to emit light according a specified pattern, and receives sensor data from the plurality of detectors. Control circuitry may process the sensor data, for example using machine learning or other techniques, to track a position of one or more HMD components.
Described herein are controllers with sensor-rich controls for enhanced controller functionality. An example control may include a pressure sensor that is configured to detect an amount of a force of a press on a cover of the control based at least in part on a proximity of a metal layer to the pressure sensor. This control may further include a touch sensor for detecting an object contacting the cover of the control. Additional embodiments disclose, among other things, integrated trackpads and D-pads, as well as backlighting features that indicate a functional state of the controller.
A63F 13/24 - Constructional details thereof, e.g. game controllers with detachable joystick handles
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0338 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of limited linear or angular displacement of an operating part of the device from a neutral position, e.g. isotonic or isometric joysticks
A63F 13/214 - Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
A63F 13/285 - Generating tactile feedback signals via the game input device, e.g. force feedback
A63F 13/218 - Input arrangements for video game devices characterised by their sensors, purposes or types using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
A optical system of a head mounted display (HMD) system that includes a lens assembly comprising a first lens element and a second lens element that are directly or indirectly coupled together, for example, via a suitable optically clear adhesive. The lens assembly may include a quarter-wave plate disposed between the first and second lens elements. The first lens element may include a surface with an anti-reflective coating thereon, and the second lens element may include a surface with a partially reflective coating thereon. The optical system may include a reflective polarizer that, together with the lens assembly, focuses light from a display system to an eye of a user of the head mounted display system.
The present disclosure relates generally to techniques for improving the performance and efficiency of optical systems, such as optical systems for using head-mounted display system. The optical systems of the present disclosure may include polarized catadioptric optics, or “pancake optics,” which utilize a wire grid polarizer as a reflective polarizer. Wire grid polarizers may not perform uniformly over wavelength or over varying angles of incidence. To improve performance, a spatially varying polarizer is provided in the optical system that operates to provide polarization compensation for the wire grid polarizer so that the wire grid polarizer performs more uniformly over wavelength and/or over incidence angles (e.g., on-axis and off-axis). The spatially varying polarizer may be formed of a liquid crystal material, such as a multi-twist retarder.
Described herein are, among other things, techniques, devices, and systems for generating one or more trained machine-learning models used for generating content-item recommendations. Also described herein are techniques, devices, and systems for applying a consumption history of a particular user to the trained model(s) to generate score data indicating a correlation between each content-item title and the consumption history, as well as modifying this score data using one or more biasing factors for generating result data. In addition, the techniques, devices, and systems may use this result data, along with received user input, for determining an order in which to present one or more content items to the user. For example, this may include determining which content items to recommend to a user and in which order to do so.
Systems and methods for tracking the position of a head-mounted display (HMD) system component. The HMD component may carry a plurality of angle sensitive detectors that are able to detect the angle of light emitted from a light source. The HMD component may include one or more scatter detectors that detect whether light has been scattered or reflected, so such light can be ignored. Control circuitry causes light sources to emit light according a specified pattern, and receives sensor data from the plurality of angle sensitive detectors. The processor may process the sensor data and scatter detector data, for example using machine learning or other techniques, to track a position of the HMD component. An angle sensitive detector may include a spatially-varying polarizer having a position-varying polarizing pattern and one or more polarizer layers that together are operative to detect the angle of impinging light.
G02F 1/139 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells characterised by the electro-optical or magneto-optical effect, e.g. field-induced phase transition, orientation effect, guest-host interaction or dynamic scattering based on orientation effects in which the liquid crystal remains transparent
G02F 1/01 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
Described herein are, among other things, techniques, devices, and systems for streaming pixel data from a host computer to a wireless display device with low latency. In some embodiments, a user mode driver is executed in user mode of the host computer to configure a wireless network interface controller of the host computer to operate in a low latency manner. The display device may use a Forward Error Correction (FEC) algorithm to reconstruct a frame from the data packets it receives from the host computer. Also disclosed are techniques for scrambling the transmission of a series of data packets using different antenna configurations, as well as setting a modulation and coding scheme (MCS) rate based at least in part on the amount of pixel data to be transmitted to the display device. The display device may comprise a head-mounted display (HMD) that renders virtual reality (VR) game imagery.
A63F 13/327 - Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using local area network [LAN] connections using wireless networks, e.g. Wi-Fi or piconet
H04L 1/00 - Arrangements for detecting or preventing errors in the information received
H04L 12/18 - Arrangements for providing special services to substations for broadcast or conference
G09G 5/36 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of individual graphic patterns using a bit-mapped memory
H04L 67/131 - Protocols for games, networked simulations or virtual reality
A63F 13/35 - Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers - Details of game servers
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
30.
Position tracking system for head-mounted display systems
Systems and methods for tracking the position of a head-mounted display (HMD) system component. The HMD component may carry a plurality of angle sensitive detectors that are able to detect the angle of light emitted from a light source. The HMD component may include one or more scatter detectors that detect whether light has been scattered or reflected, so such light can be ignored. Control circuitry causes light sources to emit light according a specified pattern, and receives sensor data from the plurality of angle sensitive detectors. The processor may process the sensor data and scatter detector data, for example using machine learning or other techniques, to track a position of the HMD component. An angle sensitive detector may include a spatially-varying polarizer having a position-varying polarizing pattern and one or more polarizer layers that together are operative to detect the angle of impinging light.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form
G02F 1/139 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells characterised by the electro-optical or magneto-optical effect, e.g. field-induced phase transition, orientation effect, guest-host interaction or dynamic scattering based on orientation effects in which the liquid crystal remains transparent
G02F 1/01 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
31.
ADJUSTABLE HEAD-MOUNTED DISPLAY TO ACCOMMODATE DIFFERENT HEAD AND FACE SIZES
A head-mounted display (HMD) includes various features that allow for customizing the HMD to different users. The HMD may include an interpupillary distance (IPD) adjustment mechanism that includes a double biasing assembly for smooth, controlled adjustment of the spacing between lens tubes. The HMD may include a field of view (FOV) adjustment mechanism that includes first and second gear assemblies connected via a connecting rod to allow uniform adjustment of the spacing between the lenses and the user's face. The HMD may further include a swappable face gasket, a swappable visor, a removable head strap, and a modular accessory compartment for further customizations to the HMD. The HMD may further include inconspicuous spectrum-transmissive windows that are made with a spectrum-transmissive base material for the HMD housing that is coated with a spectrum-opaque material, and the spectrum-opaque material is selectively removed to create the spectrum-transmissive windows.
A controller for an electronic system may include a linear hand strap adjuster to accommodate different hand sizes of users who may hold the controller in their hand. For example, a linear slot may be defined in the handle at a proximal end of the handle that is adjacent to the neck region where the handle is adjoined to the head. The linear slot may extend longitudinally along the handle. An anchor disposed within the linear slot may protrude from the outer surface of the handle to provide a point of attachment for an end of the hand strap. Accordingly, a first end of the hand strap is configured to be coupled to the anchor, and the anchor is movable along the linear slot to adjust the first end of the hand strap.
A63F 13/245 - Constructional details thereof, e.g. game controllers with detachable joystick handles specially adapted to a particular type of game, e.g. steering wheels
A44B 11/28 - Buckles; Similar fasteners for interconnecting straps or the like, e.g. for safety belts with two or more separable parts with hooks engaging end-pieces on the strap
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
Optical positional tracking systems that may be used in virtual reality (VR)/augmented reality (AR) applications are described. Exemplary implementations comprise one or more receivers and one or more transmitters. Exemplary transmitters contain two orthogonal rotors that each emit a fan-shaped laser beam. Each beam is swept as the rotors are spun at constant speed. Exemplary optical receivers can be relatively small, and mounted at convenient locations on the VR display. These receivers consist of small optical detectors that may be mounted on head-mounted VR displays. Exemplary systems determine position by measuring the time at which each swept beam crosses each receiver/detector.
This application describes a head-mounted display (HMD) for use in virtual-reality (VR) environments. The systems and methods described herein may determine information about a real-world environment surrounding the user, a location of the user within the real-world environment, and/or a pose of the user within the real-world environment. Such information may allow the HMD to display images of the real-world environment in a pass-through manner and without detracting the user from the VR environment. In some instances, the HMD may pass-through images of the real-world environment based on one or more triggering events.
Methods and systems relating generally to information displays, and more particularly to systems and methods for backlight assemblies for information displays that include light expanding structures. A backlight assembly may include light expander structures that include a plurality of layer sets, wherein each layer set includes a reflective polarizer layer and a wave retarder layer. The layer sets may together be operative transform point light source, such as a laser light beam, into a surface light source for use as a backlight for various types of information displays.
Systems and methods for providing a display for an electronic device that includes a liquid crystal display panel assembly, a backlight assembly that includes a light source, and a spatially varying polarizer that provides phase retardation that varies as a function of propagation length away from the light source. The display may also include a linear polarizer and other optical components that improve the efficiency of the backlight assembly, thereby reducing power consumption, cost, space requirements, and provide other advantages.
A head-mounted display includes a front having a display housing and a back having a rear housing. A first member extends between the front and the back and is adjustable via an actuation of a first rotatable actuator and a first cabling mechanism. A second member extends between the front and the back and is adjustable via an actuation of a second rotatable actuator and a second cabling mechanism. A third member extends between the front and the back and is adjustable via the actuation of the second rotatable actuator and a third cabling mechanism.
Various embodiments are directed towards employing one or more physical sensors arranged on or in proximity to a video game player to obtain biofeedback measures that are then useable to dynamically modify a state of play of a video game. The sensors may be connected or even unconnected to the game player, replace, or otherwise augment traditional physical game controllers. The sensors gather various biofeedback measures and provide such measures to a biofeedback application programming interface (API). Before and/or during video game play, the video game queries the biofeedback API to request inferences about the game player's state of arousal. The response to the query is then used to modify the state of the video game play. Where the video game is a multi-player video game, biofeedback measures from other game players may also be obtained and used to further modify the state of the video game play.
A63F 13/42 - Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
A63F 13/212 - Input arrangements for video game devices characterised by their sensors, purposes or types using sensors worn by the player, e.g. for measuring heart beat or leg activity
A63F 13/65 - Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor automatically by game devices or servers from real world data, e.g. measurement in live racing competition
A63F 13/63 - Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor by the player, e.g. authoring using a level editor
Described herein are, among other things, techniques, devices, and systems for generating one or more trained machine-learning models. Also described herein are techniques, devices, and systems for applying a consumption history of a particular user to the trained model(s) to generate score data indicating a correlation between each content-item title and the consumption history. The techniques then determine a ranked list of content items having a highest correlation to the consumption history, which may be used to retrieve videos associated with the most-correlated content items for generating a compilation video composed of these retrieved videos.
Methods and systems are disclosed relating to a lens system that allows for simultaneous focus of near and far-away images with one pair of glasses, heads-up-displays (HUDs), and the like, without the need to move the user's eyes. This lens system may be used in a HUD application, for example, where the user may focus on a display lens that may be approximately one inch from the eye to view computer-generated information such as altitude, temperature, directions, and the like, and simultaneously view the individual's surroundings. The lens system may include a liquid lens that when modulated may vary from a near-focus state to a far-focus state rapidly by using an electrowetting or piezoelectric hydraulic actuator. This variable rate lens may be multiplexed at a rate that allows both near and far-away images to appear in focus simultaneously through the advantageous use of a user's persistence of vision.
C07D 241/26 - Carbon atoms having three bonds to hetero atoms with at the most one bond to halogen, e.g. ester or nitrile radicals with nitrogen atoms directly attached to ring carbon atoms
G02B 26/06 - Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the phase of light
G02B 26/08 - Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
G02B 26/00 - Optical devices or arrangements for the control of light using movable or deformable optical elements
Methods and systems relating generally to information displays, and more particularly to systems and methods for backlight assemblies for information displays that emit an angularly narrow cone of light. A backlight assembly that emits a narrow angular cone of light can be particularly beneficial in a head-mounted display configuration, such as for use as part of virtual reality or augmented reality systems, where the head-mounted display comprises a lens assembly that directs light from an information display to the eyes of the user. Such a backlight assembly configuration may help reduce undesirable visual effects like flood illumination, ghost images, glare, and scattering.
Techniques and devices for determining how to present the release of the virtual object based at least in part on received sensor data is described herein. For example, when the hardware and/or software determines that the virtual object is to be released, the hardware and/or software may calculate one or more of a velocity of the object (e.g., speed and direction), a position at which the virtual object is to be released, a trajectory of the virtual object from the position of release to the landing point of the virtual object, a landing location of the virtual object, and/or the like. The hardware and/or software may then present the virtual object being released according to this determined information.
A63F 13/211 - Input arrangements for video game devices characterised by their sensors, purposes or types using inertial sensors, e.g. accelerometers or gyroscopes
A63F 13/218 - Input arrangements for video game devices characterised by their sensors, purposes or types using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
47.
Using detected pupil location to align optical components of a head-mounted display
The disclosure relates generally to techniques for determining pupil location of a display device's user via imaging sensors on the display device, and using that information to verify and/or correct positioning of the display device or its internal components. The display device may be a head-mounted display (“HMD”) device with display panels separated from a wearer's eyes via intervening lenses, with the sensors including optical flow sensor integrated circuits mounted on or near at least one of the display panels to capture images of the wearer's eye locations through the lenses, and with the correction to the positioning including modifications to the alignment or other positioning of the HMD device on the wearer user's head and/or its internal components within the HMD device (e.g., based on automated control of motors on the HMD device) to reflect a target alignment of the wearer's eyes relative to displayed information.
Client machines running game executables of a video game(s) may utilize a file system proxy component that is configured to track read operations made by the game executable during a game session, to generate access data based on the tracked read operations, and to report the access data to a remote system. This telemetry approach allows the remote system to collect access data reported by multiple client machines, to catalogue the access data according to client system configuration, and to analyze the access data to generate data that is usable by client machines to implement various game-related features including, without limitation, “instant play” of video games, discarding of unused blocks of game data to free up local memory resources, and/or local prefetching of game data for reducing latency during gameplay.
A63F 13/352 - Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers - Details of game servers involving special game server arrangements, e.g. regional servers connected to a national server or a plurality of servers managing partitions of the game world
A63F 13/335 - Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections using Internet
Described herein are, among other things, techniques, devices, and systems for identifying portions of a new version of an application that are new to the new version and portions of the new version that are common to the new version and a previous version of the application, such that a client computing device may efficiently update from the previous version to the new version.
H04L 69/324 - Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions in the data link layer [OSI layer 2], e.g. HDLC
50.
Delivery of digital information to a remote device
Methods and systems relating to a file distribution scheme in a computer network are disclosed that distributes files in an efficient manner that reduces, among other things, network traffic. In an embodiment of the invention, a method for updating a file is disclosed. In such a method, unique chunks in a first version of a digital file are identified. For a second version of the digital file, chunks that are the same as in the first version are identified. Recompilation information is generated and stored for these identified chunks. Also, for the second version of the digital file, chunks in the second version that are different from chunks in the first version are identified. Recompilation information is generated and stored for these identified chunks. With this information, the second version of the digital file is completely defined and can be efficiently stored.
The application is directed to techniques, devices, and systems for updating files. For example, a remote system may store first data representing a first version of a file and second data representing a second version of the file. The remote system may then determine that a first portion of the first data corresponds to a first portion of the second data. Based at least in part on the determination, the remote system may identify a second portion of the first data using the first portion of the first data and identify a second portion of the second data using the first portion of the second data. The remote system may then generate third data representing a difference between the second portion of the second data and the second portion of the first data. Additionally, the remote system may store the third data in association with the file.
The present disclosure is directed to systems and methods of eye tracking for use in various applications, such as virtual reality or augmented reality applications that include head-mounted display devices. An eye tracking subsystem may be provided that includes a plurality of assemblies that each include a light source, such as an LED, a light detector, such as a silicon photodiode, and a polarizer that is configured to prevent light reflected via specular reflection from reaching the light detectors so that only scattered light is detected by the light detectors. Machine learning or other techniques may be used to track or otherwise determine a user's gaze direction, which may be used by one or more components of an HMD device to improve its functionality in various ways.
A calibration system for calibrating tracking equipment includes a segmented dish formed from a plurality of individual panels, a support frame formed from a plurality of individual structural shafts to support the segmented dish, and a rotatable platform to hold the tracking equipment to be calibrated. The segmented dish includes a plurality of sensor assemblies rotatably coupled to its individual panels and a plurality of motor assemblies to control operation of the sensor assemblies.
The logic of a handheld controller system may use a clustering algorithm to determine which sensors of a touch sensor array, such as capacitive pads, to assign to individual fingers of a user's hand. The clustering algorithm disclosed herein allows for dynamically determining the controller configuration on-the-fly for a given user. An example process includes receiving data generated by a plurality of sensors of a touch sensor array of the handheld controller, generating a covariance matrix that indicates correlations between pairs of sensors, determining a plurality of feature vectors based at least in part on the covariance matrix, each feature vector corresponding to an individual sensor and describing that sensor's correlation(s) with one or more other sensors, clustering the feature vectors using a clustering algorithm, and configuring the touch sensor array according to a controller configuration that assigns sensors to respective fingers of a hand.
G06F 3/044 - Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
A63F 13/214 - Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
G06F 18/23213 - Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions with fixed number of clusters, e.g. K-means clustering
Described herein are, among other things, techniques, devices, and systems for generating personalized game-notification feeds for users. In some instances, a remote computing system that offers one or more games for acquisition may determine which notifications generated by respective game publishers are likely to be of interest to different users and, after doing so, may generate personalized game-notification feeds comprising the selected notifications. Further, each of the users may provide feedback regarding one or more of the notifications in the notification feed, which the system may use to re-select notifications and re-generating personalized game-notification feeds.
A63F 13/79 - Game security or game management aspects involving player-related data, e.g. identities, accounts, preferences or play histories
A63F 13/533 - Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game for prompting the player, e.g. by displaying a game menu
56.
Tracking file system read operations for instant play of video games, and for client-side discarding and prefetching of game data
Client machines running game executables of a video game(s) may utilize a file system proxy component that is configured to track read operations made by the game executable during a game session, to generate access data based on the tracked read operations, and to report the access data to a remote system. This telemetry approach allows the remote system to collect access data reported by multiple client machines, to catalogue the access data according to client system configuration, and to analyze the access data to generate data that is usable by client machines to implement various game-related features including, without limitation, “instant play” of video games, discarding of unused blocks of game data to free up local memory resources, and/or local prefetching of game data for reducing latency during gameplay.
A63F 13/352 - Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers - Details of game servers involving special game server arrangements, e.g. regional servers connected to a national server or a plurality of servers managing partitions of the game world
A63F 13/335 - Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections using Internet
57.
Using finger presence to activate a motion control feature for a handheld controller
A handheld controller may include a movable control that is usable for activating and deactivating a motion control feature of the handheld controller based on a detection of, or a failure to detect, a finger contacting a surface of the movable control. For example, a touch sensor associated with the movable control may provide touch sensor data indicative of a proximity of a finger relative to the movable control, and based on this touch sensor data, the motion control feature of the handheld controller can be toggled on and off, depending on whether the finger is contacting the movable control or not. When the motion control feature is activated, motion sensor data from a motion sensor(s) is sent to an application (e.g., a video game) as application input. When the motion control feature is deactivated, the motion sensor data is not used as application input.
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
G06F 3/044 - Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
A63F 13/2145 - Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads the surface being also a display device, e.g. touch screens
A63F 13/24 - Constructional details thereof, e.g. game controllers with detachable joystick handles
G06F 3/0338 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of limited linear or angular displacement of an operating part of the device from a neutral position, e.g. isotonic or isometric joysticks
Described herein are controllers with sensor-rich controls for enhanced controller functionality. An example control may include a pressure sensor that is configured to detect an amount of a force of a press on a cover of the control based at least in part on a proximity of a metal layer to the pressure sensor. This control may further include a touch sensor for detecting an object contacting the cover of the control. Additional embodiments disclose, among other things, integrated trackpads and D-pads, as well as backlighting features that indicate a functional state of the controller.
A63F 13/24 - Constructional details thereof, e.g. game controllers with detachable joystick handles
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0338 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of limited linear or angular displacement of an operating part of the device from a neutral position, e.g. isotonic or isometric joysticks
A63F 13/214 - Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
A63F 13/285 - Generating tactile feedback signals via the game input device, e.g. force feedback
A63F 13/218 - Input arrangements for video game devices characterised by their sensors, purposes or types using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
59.
Dynamically enabling or disabling controls of a controller
A handheld controller may include controls that are actuatable by a user. The handheld controller may further include one or more sensors that are configured to detect an object in proximity to certain controls, and/or that sense a grip or position of a hand on a handle portion of the controller. Based on data from a sensor(s), certain controls may be enabled and/or disabled. The sensors may therefore be used to determine which controls are being used or are intended to be used, and/or which controls are likely accessible or inaccessible to the user based on sensor data, and to cause one or more controls of the handheld controller to be enabled and/or disabled accordingly.
A63F 13/218 - Input arrangements for video game devices characterised by their sensors, purposes or types using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
A63F 13/98 - Accessories, i.e. detachable arrangements optional for the use of the video game device, e.g. grip supports of game controllers
A63F 13/214 - Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
A63F 13/24 - Constructional details thereof, e.g. game controllers with detachable joystick handles
A controller system for surfacing selectable elements on a display of the controller along with game content associated with a video game is described. In an example, a user may provide touch input on the display, and, in response, a game content window that is presenting the game content may scale and/or move to a new position on the display in order to create space on the display for presenting one or more selectable elements outside of the scaled and/or repositioned game content window. The surfaced element(s) may be selectable to cause performance of a game-related action. In this manner, the selectable element(s) do(es) not occlude the game content, and the user may interact with both the game content and the selectable element(s) presented on the display.
A63F 13/2145 - Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads the surface being also a display device, e.g. touch screens
A63F 13/218 - Input arrangements for video game devices characterised by their sensors, purposes or types using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
G06F 3/04842 - Selection of displayed objects or displayed text elements
A63F 13/98 - Accessories, i.e. detachable arrangements optional for the use of the video game device, e.g. grip supports of game controllers
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
A63F 13/24 - Constructional details thereof, e.g. game controllers with detachable joystick handles
A63F 13/25 - Output arrangements for video game devices
Described herein are motion smoothing techniques for a display, or display system, such as a head-mounted display (HMD), to account for motion of moving or animating objects in a way that mitigates judder. The display system may be separate from, yet communicatively coupled to, a host computer where a graphics-based application, such as a video game, is outputting frames for rendering on the display system. The host computer may generate motion vectors representing compressed pixel data for transmission to the display system. The motion vectors can be used by the display system to modify pixel data of a frame. The modified pixel data for the frame is “motion-smoothed” for rendering on the display system in a manner that mitigates judder of moving or animating objects.
H04N 13/139 - Format conversion, e.g. of frame-rate or size
H04N 13/161 - Encoding, multiplexing or demultiplexing different image signal components
H04N 19/182 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
H04N 19/517 - Processing of motion vectors by encoding
Controllers that allow for adjusting various features of the controller are disclosed. The controller may include may include one or more speakers for outputting sound or audio content. A user may contact one or more of the speakers with a finger(s) to adjust a characteristic of the audio content and/or to adjust audio settings. For example, a user may touch a speaker with his/her finger to change (e.g., increase or decrease) the volume or to mute the sound. In some instances, the speakers may be located on the controller body of the handheld controller for convenient and quick access by the user.
A63F 13/214 - Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
A63F 13/215 - Input arrangements for video game devices characterised by their sensors, purposes or types comprising means for detecting acoustic signals, e.g. using a microphone
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
A63F 13/24 - Constructional details thereof, e.g. game controllers with detachable joystick handles
A63F 13/218 - Input arrangements for video game devices characterised by their sensors, purposes or types using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
63.
Polarization-multiplexed optics for head-mounted display systems
The present disclosure is related generally to techniques for improving the performance and efficiency of display systems, such as laser scan beam display systems or other types of display systems (e.g., micro-displays) of an HMD system or other device. Display systems of the present disclosure may utilize polarization multiplexing that allow for improved optimization of diffraction optics. In at least some implementations, a display system may selectively polarize light dependent on wavelength (e.g., color) or field of view. An optical combiner may include polarization sensitive diffractive optical elements that are each optimized for a subset of colors or portions of an overall field of view, thereby providing improved correction optics for a display system.
G02B 6/293 - Optical coupling means having data bus means, i.e. plural waveguides interconnected and providing an inherently bidirectional system by mixing and splitting signals with wavelength selective means
G02B 6/27 - Optical coupling means with polarisation selective and adjusting means
64.
Variable optical correction using spatially varying polarizers
An optical system is provided that includes a correction portion including one or more spatially varying polarizers. A first spatially varying polarizer of the one or more spatially varying polarizers has a first control input configured to receive a first control signal indicating whether the first spatially varying polarizer is to be active or inactive. When active, the first spatially varying polarizer is operative to provide a first optical correction on light passing through the correction portion. The optical system includes a controller configured to determine whether to implement the first optical correction on the light passing through the correction portion and in response to determining to implement the first optical correction on the light passing through the correction portion, output the first control signal indicating the first spatially varying polarizer is to be active. Additional spatially varying polarizers may be controlled to provide additional or alternative optical corrections.
G02F 1/01 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
G02F 1/139 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells characterised by the electro-optical or magneto-optical effect, e.g. field-induced phase transition, orientation effect, guest-host interaction or dynamic scattering based on orientation effects in which the liquid crystal remains transparent
The present disclosure related generally to techniques for improving the performance and efficiency of display systems, such as laser scan beam display systems or other types of display systems (e.g., micro-displays). Display systems of the present disclosure may include a polarization compensation optic, such as a spatially varying polarizer, that provides phase retardation that varies as a function of position, which provides polarization compensation to provide light that is well suited for a polarization sensitive optic of the display system, such as a waveguide-based optical system, a pancake optical system, a birdbath optical system, a coating-based optical system, etc. The display systems of the present disclosure may be components of head-mounted display systems, or other types of display systems.
Systems and methods for providing a polarization recycling structure for use in applications, such as display systems that include a liquid crystal display assembly. The polarization recycling structure may include a first spatially varying polarizer spaced apart from a second spatially varying polarizer. The first spatially varying polarizer may include a lens array that receives light from a light source and focuses light of a first polarization state and passes light of a second polarization state. The second spatially varying polarizer receive light from the first spatially varying polarizer, passes the focused light of the first polarization state, and transforms the light of the second polarization state into the first polarization state, thereby providing only light of the first polarization state at the output of the polarization recycling structure. The polarization recycling structures improve the efficiency of lighting subsystems, thereby reducing power consumption, cost, space requirements, and providing other advantages.
Systems and methods of the present disclosure provide a compact camera device that utilizes one or more spatially varying polarizers, such as one or more multi-twist retarders, to provide compact designs with improved performance. The spatially varying polarizers may be used to multiplex light received by a camera, which allows optics to modify (e.g., focus) incident light in a polarization specific manner to provide better resolution, reduced form factor, or other advantages.
Systems and methods for providing a polarimetry camera operative to obtain high fidelity surface characterization measurements. A polarimetry camera may include an multi-twist retarder component that is operative selectively switch between two or more polarization filtering states, wherein in each polarization filtering state, the multi-twist retarder component only passes light having a particular polarization state or orientation (e.g., horizontal linear polarization, vertical linear polarization, 45 degree linear polarization, circular polarization) and reflects or absorbs light having other polarization states. The multi-twist retarder may also include one or more diffraction patterns that focus light. The polarimetry camera may capture images using a sensor array as the multi-twist retarder is switched between the at least two polarization filtering states, thereby capturing a sequence of polarization specific images that may be displayed or used to determine one or more Stokes parameters for a scene in real-time.
The present disclosure relates generally to techniques for improving the performance and efficiency of optical systems, such as optical systems for using head-mounted display system. The optical systems of the present disclosure may include polarized catadioptric optics, or “pancake optics,” which utilize a wire grid polarizer as a reflective polarizer. Wire grid polarizers may not perform uniformly over wavelength or over varying angles of incidence. To improve performance, a spatially varying polarizer is provided in the optical system that operates to provide polarization compensation for the wire grid polarizer so that the wire grid polarizer performs more uniformly over wavelength and/or over incidence angles (e.g., on-axis and off-axis). The spatially varying polarizer may be formed of a liquid crystal material, such as a multi-twist retarder.
The present disclosure related generally to techniques for improving the performance and efficiency of display systems, such as laser scan beam display systems or other types of display systems (e.g., micro-displays) of an HMD or other device. Display systems of the present disclosure may include a polarization compensation optic, such as a spatially varying polarizer, that provides phase retardation that varies as a function of position, which provides polarization compensation to provide light that is well suited for a polarization sensitive optic of the display system, such as a waveguide-based optical system, a pancake optical system, a birdbath optical system, a coating-based optical system, etc. The spatially varying polarizer may be varied spatially in real-time based on a user's gaze location to provide an optimized field of view in a region where the user is known or inferred to be gazing, thereby providing improved optical performance.
An optical system is provided. The optical system includes a gaze tracker operative to track a gaze of a user and output data representative of the gaze and a correction portion including multiple spatially varying polarizers. A first polarizer of the spatially varying polarizers has a first control input configured to receive a first control signal indicating whether the first polarizer is to be active or inactive. The first polarizer, when active, provides a first optical correction on light passing through at a location corresponding to a first region of a virtual image. The optical system includes a controller configured to receive the data representative of the gaze, determine, based on the gaze, whether to implement the first optical correction on the light and in response to determining to implement the first optical correction on the light, output the first control signal indicating the first polarizer is to be active.
Systems and methods for tracking the position of a head-mounted display (HMD) system component. The HMD component may carry a plurality of angle sensitive detectors that are able to detect the angle of light emitted from a light source. The HMD component may include one or more scatter detectors that detect whether light has been scattered or reflected, so such light can be ignored. Control circuitry causes light sources to emit light according a specified pattern, and receives sensor data from the plurality of angle sensitive detectors. The processor may process the sensor data and scatter detector data, for example using machine learning or other techniques, to track a position of the HMD component. An angle sensitive detector may include a spatially-varying polarizer having a position-varying polarizing pattern and one or more polarizer layers that together are operative to detect the angle of impinging light.
G02F 1/139 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells characterised by the electro-optical or magneto-optical effect, e.g. field-induced phase transition, orientation effect, guest-host interaction or dynamic scattering based on orientation effects in which the liquid crystal remains transparent
G02F 1/01 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
73.
Polarization-based multiplexing of diffractive elements for illumination optics
Improved illumination optics for various applications. The illumination optics may include an optical beam spreading structure that provides a large spread angle for an incident collimated beam or provides finer detail or resolution compared to convention diffractive optical elements. The optical beam spreading structure may include first and second spatially varying polarizers that are optically aligned with each other. The first and second spatially varying polarizers may be formed of a liquid crystal material, such as a multi-twist retarder (MTR). The first and second spatially varying polarizers may diffract light of orthogonal polarization states, which allows for different diffraction patterns to be used in a single optical structure. The two patterns may provide a combined field of view that is larger than either of the first and second fields of view or may provide finer detail or resolution than the first or second fields of view can provide alone.
A handheld video game controller is operable in Bluetooth Low Energy (BLE) mode to allow for sending controller input data to a target BLE device in a manner that bypasses any operating system (OS) restrictions that might otherwise be imposed on game controller input. When operating in the BLE mode, the handheld video game controller pairs (establishes a radio link) with a BLE device executing a client application used for video game streaming. During gameplay, the video game executes on a host computer and the player provides user input to the game controller to control an aspect of the video game. In response to such user input, the game controller sends controller input data to the BLE device via a radio of the game controller. The player may switch between operating the game controller in BLE mode and receiver mode using input gestures on the game controller.
A63F 13/235 - Input arrangements for video game devices for interfacing with the game device, e.g. specific interfaces between game controller and console using a wireless connection, e.g. infrared or piconet
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
H04W 4/80 - Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
H04W 76/20 - Manipulation of established connections
Systems and methods for providing a display for an electronic device that includes a liquid crystal display panel assembly, a backlight assembly that includes a light source, and a spatially varying polarizer that provides phase retardation that varies as a function of propagation length away from the light source. The display may also include a linear polarizer and other optical components that improve the efficiency of the backlight assembly, thereby reducing power consumption, cost, space requirements, and provide other advantages.
A method including receiving at least one of touch data or force data representing a touch input received at the controller, determining one or more model(s), generating image data using the one or more models, the image data representing at least a hand gesture corresponding to the touch input received at the controller, and transmitting the image data to a virtual reality (VR) environment for display.
A63F 13/213 - Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06T 19/00 - Manipulating 3D models or images for computer graphics
A63F 13/218 - Input arrangements for video game devices characterised by their sensors, purposes or types using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
A63F 13/24 - Constructional details thereof, e.g. game controllers with detachable joystick handles
A63F 13/428 - Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
G06F 3/038 - Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
A63F 13/67 - Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor adaptively or by learning from player actions, e.g. skill level adjustment or by storing successful combat sequences for re-use
G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
77.
Position tracking system for head-mounted display systems that includes angle sensitive detectors
Systems and methods for tracking the position of a head-mounted display (HMD) system component, such as a wearable HMD device or a hand-held controller. The HMD component may include a support structure that carries a plurality of angle sensitive detectors that are able to detect the angle of arrival of light emitted from a light source. A processor causes light sources to emit light according a specified pattern, and receive sensor data from the plurality of angle sensitive detectors. The processor may process the received sensor data using machine learning or other techniques to track a position of the head-mounted display component based on the processing of the received sensor data.
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
The present disclosure is directed to systems and methods of eye tracking for use in various applications, such as virtual reality or augmented reality applications that include head-mounted display devices. An eye tracking subsystem may be provided that includes a plurality of assemblies that each include a light source, such as an LED, a light detector, such as a silicon photodiode, and a polarizer that is configured to prevent light reflected via specular reflection from reaching the light detectors so that only scattered light is detected by the light detectors. Machine learning or other techniques may be used to track or otherwise determine a user's gaze direction, which may be used by one or more components of an HMD device to improve its functionality in various ways.
Systems and methods for providing display panels with reduced visual artifacts. A display system is provided that includes a pixel array having a plurality of pixels arranged in rows and columns. The display system receives an image stream that includes a plurality of sets of image data that each represent an image to be sequentially presented by the display system. The data for each frame or set of image data is loaded into the pixel array according to a loading sequence with reduces the visual artifacts perceived by a viewer of the display system. The loading sequence may include an inside-out loading sequence which gives preference to a central region of the pixel array, a speculative preloading sequence which first loads portions of the pixel array with speculative data, or various combinations thereof.
G09G 3/20 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix
G09G 3/3225 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED] organic, e.g. using organic light-emitting diodes [OLED] using an active matrix
G09G 3/36 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix by control of light from an independent source using liquid crystals
80.
Controller visualization in virtual and augmented reality environments
Controller visualization systems and methods for use in virtual/augmented reality environments such as walk-around virtual reality environments are described. The virtual representation of a physical control device may be altered based on the context of the virtual environment. Certain embodiments combine the virtual rendering of the tracked control device with a real-time video representation of part of the operating space. In certain embodiments, the display of additional information relating to the function of interactive elements may be displayed based on context, such as when a specific action is required from a user in the virtual space.
A63F 13/26 - Output arrangements for video game devices having at least one additional display device, e.g. on the game controller or outside a game booth
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
A63F 13/537 - Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game using indicators, e.g. showing the condition of a game character on screen
G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form
81.
Power management for optical position tracking devices
Devices and techniques for managing power consumption of a position tracking device. The position tracking device may be a virtual reality (VR) controller having multiple optical sensors oriented to receive optical signals from different directions. A stationary optical emitter projects a laser line into a space and repeatedly scans the laser line through the space. For a given scan, some of the sensors may detect the laser line and some of the sensors may not detect the laser line. When an individual sensor fails to detect a laser scan, that sensor is disabled for at least a portion of one or more subsequent laser scans in order to reduce power consumption of the VR controller.
A method including determining a range of values for a proximity sensor, receiving proximity data from the proximity sensor, decaying a limit associated with a maximum value, decaying a limit associated with a minimum value, determining a range of values detected by the proximity sensor, and determining an updated scale factor for the proximity sensor.
A63F 13/24 - Constructional details thereof, e.g. game controllers with detachable joystick handles
G06F 3/038 - Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
A63F 13/218 - Input arrangements for video game devices characterised by their sensors, purposes or types using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
A63F 13/214 - Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
A63F 13/44 - Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment involving timing of operations, e.g. performing an action within a time slot
83.
Split rendering between a head-mounted display (HMD) and a host computer
A rendering workload for an individual frame can be split between a head-mounted display (HMD) and a host computer that is executing an application. To split a rendering workload for a frame, the HMD may send head tracking data to the host computer, and the head tracking data may be used by the host computer to generate pixel data associated with the frame and extra data in addition to the pixel data. The extra data can include, without limitation, pose data, depth data, motion vector data, and/or extra pixel data. The HMD may receive the pixel data and at least some of the extra data, determine an updated pose for the HMD, and apply re-projection adjustments to the pixel data based on the updated pose and the received extra data to obtain modified pixel data, which is used to present an image on the display panel(s) of the HMD.
A trained machine learning model(s) is used to determine scores (e.g., trust scores) for user accounts registered with a video game service, and the scores are used to match players together in multiplayer video game settings. In an example process, a computing system may access data associated with registered user accounts, provide the data as input to the trained machine learning model(s), and the trained machine learning model(s) generates the scores as output, which relate to probabilities of players behaving, or not behaving, in accordance with a particular behavior while playing a video game in multiplayer mode. Thereafter, subsets of logged-in user accounts executing a video game can be assigned to different matches based at least in part on the scores determined for those logged-in user accounts, and the video game is executed in the assigned match for each logged-in user account.
A63F 13/798 - Game security or game management aspects involving player-related data, e.g. identities, accounts, preferences or play histories for assessing skills or for ranking players, e.g. for generating a hall of fame
A63F 13/795 - Game security or game management aspects involving player-related data, e.g. identities, accounts, preferences or play histories for providing a buddy list
A63F 13/75 - Enforcing rules, e.g. detecting foul play or generating lists of cheating players
A63F 13/335 - Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections using Internet
Systems and methods for tracking the position of a head-mounted display (HMD). The HMD may include a support structure that carries a forward facing camera and a plurality of optical flow sensor integrated circuits (ICs). The forward camera captures image sensor data in a forward camera field of view (FOV) at a first frame rate, and each of the plurality of sensor ICs captures image sensor data in a respective plurality of sensor IC FOVs at a second frame rate. The sensor IC FOVs may collectively cover at least a substantial portion of the forward camera FOV. A processor may receive the image sensor data from the camera and the plurality of sensor ICs. The processor may process the received image sensor data and/or other sensor data (e.g., IMU data) to track a position of the head-mounted display based on the processing of the received sensor data.
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
86.
Latency compensation using machine-learned prediction of user input
A trained machine learning model(s) is used to determine scores indicative of probabilities that certain types of user input will be provided to a player's game controller while playing a video game in order to compensate for latency between player action and player perception of video game content relating to the player action. In an example process, sensor data received from a client machine and/or game state data received from a video game is provided as input to a trained machine learning model(s), and a score as output therefrom, the score relating to a probability that a type of user input will be provided to a player's game controller. In this manner, game control data corresponding to the type of user input can be generated based on the score and provided to the video game as input before actual game control data is even received, thereby compensating for latency.
A63F 13/358 - Adapting the game course according to the network or server load, e.g. for reducing latency due to different connection speeds between clients
A63F 13/355 - Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an MPEG-stream for transmitting to a mobile phone or a thin client
A63F 13/86 - Watching games played by other players
H04N 21/478 - Supplemental services, e.g. displaying phone caller identification or shopping application
A63F 13/332 - Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections using wireless networks, e.g. cellular phone networks
H04L 67/131 - Protocols for games, networked simulations or virtual reality
A63F 13/335 - Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections using Internet
87.
Counterrotation of display panels and/or virtual cameras in a HMD
A head-mounted display (HMD) system may include a HMD with a housing and a pair of display panels, mounted within the housing, that are counterrotated in orientation. A compositor of the HMD system may also be configured to provide camera pose data with counterrotated camera orientations to an executing application (e.g., a video game application), and to resample the frames received from the application, with or without rotational adjustments in the clockwise and counterclockwise directions depending on whether the display panels of the HMD are upright-oriented or counterrotated in orientation. A combined approach may use the counterrotated camera orientations in combination with counterrotated display panels to provide a HMD with optimized display performance.
Systems and methods for providing an optical system in a head-mounted display (HMD) that is operable to modify virtual image light to correct for one or more vision conditions of a user's eyes. The optical system includes a left optical subsystem for the left eye and a right optical system for the right eye. Each optical subsystem includes a first correction portion and a second correction portion each having a lens assembly. A first lens assembly includes a first set of lenses having a first lens selectively adjustable along a first axis transverse to an optical path of the virtual image light. A second lens assembly includes a second set of lenses having a second lens selectively rotatable around a second axis transverse to the first axis. Selective adjustment of the first lens and the second lens helps to correct for the vision conditions in the user's eyes.
A controller for an electronic system includes a tracking member fixed to a controller body. The controller body has a head that adjoins a handle at a neck region, and that includes at least one thumb-operated control. The controller includes a hand retainer that in a closed position is configured to physically bias the user's palm against an outer surface of the handle. The hand retainer includes a resilient member that biases the hand retainer towards an open position. The resilient member is attached to an anchor that is attached to the head by an adjustment mechanism that permits the resilient member to be moved towards or away from the user's purlicue. The tracking member includes transducers that are coupled to the electronic system by electromagnetic radiation. Proximity sensors, spatially distributed on the handle, are responsive to a proximity of the user's fingers to the outer surface of the handle.
A63F 13/24 - Constructional details thereof, e.g. game controllers with detachable joystick handles
A63F 13/218 - Input arrangements for video game devices characterised by their sensors, purposes or types using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
A63F 13/213 - Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
A63F 13/428 - Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
A head-mounted display including a front, a back, a first actuator, a second actuator, a first adjustable member extending between the front and the back and operably engaging the first actuator, and a second adjustable member extending between the front and the back and operably engaging the second actuator. The first adjustable member and the second adjustable member may be adjustable in length via the second actuator to vary a gap distance between the front and the back. In some embodiments, the head-mounted display may include a wire routing assembly for routing wire(s) between the front and the back of the head-mounted display. Additionally, in some embodiments, the head-mounted display may include a harness for engaging a user.
Light output of a display can be dynamically adjusted on-the-fly. When implemented on a low-persistence display that supports a variable refresh rate, this dynamic light output adjustment maintains a constant brightness over a series of frames to eliminate flickering of the display. When pixel data of a given frame is output to a frame buffer for presenting an image on the display, a time difference between an illumination of the display's light emitting elements for a preceding frame and an upcoming illumination of the light emitting elements for the given frame may be determined, and this time difference is used to determine a value of a light output parameter. During presentation of the image on the display, the light emitting elements can be illuminated in accordance with the value of the light output parameter. This determination iterates over a series of frames to dynamically adjust the display's light output.
A force sensing resistor (FSR) that is constructed with a first substrate made of polyimide disposed underneath a second substrate that is resistive and flexible. A handheld controller for an electronic system may include the FSR having a first substrate made of polyimide. The FSR may be mounted on a planar surface of a structure within the controller body, such as a structure mounted within a handle of the controller body, and/or a structure that is mounted underneath at least one thumb-operated control that is included on a head of the controller body. The FSR may be configured to measure a resistance value that corresponds to an amount of force applied to an outer surface of the handle and/or an amount of force applied to the at least one thumb-operated control.
A63F 13/218 - Input arrangements for video game devices characterised by their sensors, purposes or types using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
A63F 13/24 - Constructional details thereof, e.g. game controllers with detachable joystick handles
G06F 3/045 - Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact
G06F 3/0338 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of limited linear or angular displacement of an operating part of the device from a neutral position, e.g. isotonic or isometric joysticks
G06F 3/038 - Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
G06F 3/0484 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
G06F 3/041 - Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
94.
Head-mounted display (HMD) with spatially-varying retarder optics
A head-mounted display, or other near-to-eye display, incorporates optics that include a spatially-varying retarder (SVR). The SVR may be manufactured with a correction factor applied thereto in order to compensate for one or more manufacturing errors that are exhibited in a molded lens and/or a polarizing beam splitter included in the optics of the system.
A trained machine learning model(s) is used to determine scores (e.g., trust scores) for user accounts registered with a video game service, and the scores are used to match players together in multiplayer video game settings. For example, sensor data received from client machines can be provided as input to the trained machine learning model(s), and the trained machine learning model(s) generates scores as output, which relate to probabilities that the game control data received from those client machines was generated by handheld devices, as opposed to having been synthesized and/or modified using software. In this manner, subsets of logged-in user accounts executing a video game can be assigned to different matches (e.g., by isolating non-human players from human players) based at least in part on the scores determined for those logged-in user accounts, and the video game is executed in the assigned match for each logged-in user account.
A63F 13/30 - Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
A63F 13/79 - Game security or game management aspects involving player-related data, e.g. identities, accounts, preferences or play histories
A63F 13/85 - Providing additional services to players
G07F 17/32 - Coin-freed apparatus for hiring articles; Coin-freed facilities or services for games, toys, sports, or amusements
Described herein are, among other things, techniques, devices, and systems for generating one or more trained machine-learning models used for generating content-item recommendations. Also described herein are techniques, devices, and systems for applying a consumption history of a particular user to the trained model(s) to generate score data indicating a correlation between each content-item title and the consumption history, as well as modifying this score data using one or more biasing factors for generating result data. In addition, the techniques, devices, and systems may use this result data, along with received user input, for determining an order in which to present one or more content items to the user. For example, this may include determining which content items to recommend to a user and in which order to do so.
Described herein are, among other things, techniques, devices, and systems for generating one or more trained machine-learning models. Also described herein are techniques, devices, and systems for applying a consumption history of a particular user to the trained model(s) to generate score data indicating a correlation between each content-item title and the consumption history. The techniques then determine a ranked list of content items having a highest correlation to the consumption history, which may be used to retrieve videos associated with the most-correlated content items for generating a compilation video composed of these retrieved videos.
The logic of a handheld controller system may use a clustering algorithm to determine which sensors of a touch sensor array, such as capacitive pads, to assign to individual fingers of a user's hand. The clustering algorithm disclosed herein allows for dynamically determining the controller configuration on-the-fly for a given user. An example process includes receiving data generated by a plurality of sensors of a touch sensor array of the handheld controller, generating a covariance matrix that indicates correlations between pairs of sensors, determining a plurality of feature vectors based at least in part on the covariance matrix, each feature vector corresponding to an individual sensor and describing that sensor's correlation(s) with one or more other sensors, clustering the feature vectors using a clustering algorithm, and configuring the touch sensor array according to a controller configuration that assigns sensors to respective fingers of a hand.
G06F 3/044 - Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06K 9/62 - Methods or arrangements for recognition using electronic means
A63F 13/214 - Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
Described herein are, among other things, techniques to enable a user to navigate a color picker or other graphical-user-interface (GUI) tool using an input device of a handheld controller. For example, a user may operate a color picker presented on a display by pressing upwards on a joystick to activate selection of hue. In some instances, the user may also operate the joystick to alter a tint, tone, shade, or brightness.
G06F 3/0487 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
A63F 13/42 - Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
A63F 13/533 - Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game for prompting the player, e.g. by displaying a game menu
G06F 3/0338 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of limited linear or angular displacement of an operating part of the device from a neutral position, e.g. isotonic or isometric joysticks
A63F 13/40 - Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
G06F 3/0482 - Interaction with lists of selectable items, e.g. menus
G06F 3/0484 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
patents
