Magic Leap, Inc.

United States of America

Back to Profile

Receive daily alerts for new
USPTO trademarks filed by this owner
1-100 of 1,647 for Magic Leap, Inc. Sort by
Query
Aggregations
IP Type
        Patent 1,455
        Trademark 192
Jurisdiction
        United States 834
        World 475
        Canada 321
        Europe 17
Date
New (last 4 weeks) 43
2020 September (MTD) 23
2020 August 39
2020 July 34
2020 June 28
See more
IPC Class
G02B 27/01 - Head-up displays 651
G06T 19/00 - Manipulating 3D models or images for computer graphics 357
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer 350
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups , 214
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints 176
See more
NICE Class
09 - Scientific and electric apparatus and instruments 161
42 - Scientific and technological services and research and design relating thereto; industrial analysis and research services; design and development of computer hardware and software. 86
41 - Education; entertainment 73
35 - Advertising; business 53
38 - Telecommunications 50
See more
Status
Pending 630
Registered / In Force 1,017
  1     2     3     ...     17        Next Page

1.

EYELID SHAPE ESTIMATION USING EYE POSE MEASUREMENT

      
Application Number 16889536
Status Pending
Filing Date 2020-06-01
First Publication Date 2020-09-17
Owner Magic Leap, Inc. (USA)
Inventor Kaehler, Adrian

Abstract

Systems and methods for eyelid shape estimation are disclosed. In one aspect, after receiving an eye image of an eye (e.g., from an image capture device), an eye pose of the eye in the eye image is determined. From the eye pose, an eyelid shape (of an upper eyelid or a lower eyelid) can be estimated using an eyelid shape mapping model. The eyelid shape mapping model relates the eye pose and the eyelid shape. In another aspect, the eyelid shape mapping model is learned (e.g., using a neural network).

IPC Classes  ?

  • G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
  • G02B 27/01 - Head-up displays

2.

METHOD OF FABRICATING DISPLAY DEVICE HAVING PATTERNED LITHIUM-BASED TRANSITION METAL OXIDE

      
Application Number US2020021987
Publication Number 2020/185832
Status In Force
Filing Date 2020-03-11
Publication Date 2020-09-17
Owner MAGIC LEAP, INC. (USA)
Inventor
  • Melli, Mauro
  • Peroz, Christophe
  • West, Melanie Maputol

Abstract

The present disclosure generally relates to display systems, and more particularly to augmented reality display systems and methods of fabricating the same. A method of fabricating a display device includes providing a substrate comprising a lithium (Li)-based oxide and forming an etch mask pattern exposing regions of the substrate. The method additionally includes plasma etching the exposed regions of the substrate using a gas mixture comprising CHF3 to form a diffractive optical element, wherein the diffractive optical element comprises Li-based oxide features configured to diffract visible light incident thereon.

IPC Classes  ?

  • G02B 5/18 - Diffracting gratings
  • G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
  • G02B 30/00 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images

3.

REGISTRATION OF LOCAL CONTENT BETWEEN FIRST AND SECOND AUGMENTED REALITY VIEWERS

      
Application Number US2020019871
Publication Number 2020/185405
Status In Force
Filing Date 2020-02-26
Publication Date 2020-09-17
Owner MAGIC LEAP, INC. (USA)
Inventor Mccall, Marc Alan

Abstract

A method of viewing image data of local content is disclosed. An augmented reality view is created by storing a first device coordinate frame (DCF), moving a first registration marker to select a first feature point (FP1) and a second feature point (FP2) on at least one real-word object viewable by the user through a display. A uniform coordinate system (UCS) alignment module stores locations of the registration marker when selecting the FP1 and the FP2, determines a user coordinate frame (UCF) based on the locations of the first registration marker when selecting the FP1 and the FP2, transforms the DCF to the UCF and displays image data of local content received on a first data source with a projector through the display to the user based on the transformation from the first DCF to the first UCF.

IPC Classes  ?

  • G09G 5/00 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
  • G06K 9/62 - Methods or arrangements for recognition using electronic means
  • G06T 15/00 - 3D [Three Dimensional] image rendering

4.

WAVEGUIDES WITH HIGH INDEX MATERIALS AND METHODS OF FABRICATION THEREOF

      
Application Number US2020022175
Publication Number 2020/185954
Status In Force
Filing Date 2020-03-11
Publication Date 2020-09-17
Owner MAGIC LEAP, INC. (USA)
Inventor
  • Singh, Vikramjit
  • Luo, Kang
  • Vaughn, Michal Beau Dennison
  • Bhargava, Samarth
  • Yang, Shuqiang
  • Miller, Michael Nevin
  • Xu, Frank Y.
  • Klug, Michael Anthony
  • Messer, Kevin
  • Tekolste, Robert D.
  • Deng, Xiaopei
  • Li, Xiao

Abstract

Waveguides comprising materials with refractive index greater than or equal to 1.8 and methods of patterning waveguides are disclosed. Patterned waveguides comprising materials with refractive index greater than or equal to 1.8 can be incorporated in display devices, such as, for example wearable display devices to project virtual images to a viewer.

IPC Classes  ?

  • G02B 6/34 - Optical coupling means utilising prism or grating
  • G02B 5/18 - Diffracting gratings
  • G02B 5/32 - Holograms used as optical elements

5.

Display panel or portion thereof with a transitional mixed reality graphical user interface

      
Application Number 29640866
Grant Number D0896236
Status In Force
Filing Date 2018-03-16
First Publication Date 2020-09-15
Grant Date 2020-09-15
Owner Magic Leap, Inc. (USA)
Inventor
  • Hoover, Paul Armistead
  • Powderly, James M.
  • Pazmino, Lorena
  • Tran, Gregory Minh
  • Mann, Jonathan Lawrence
  • Erickson, Craig
  • Niles, Savannah
  • Naples, Alysha
  • Azu, Isioma Osagbemwenorue
  • Heiner, Cole Parker

6.

Display panel or portion thereof with a graphical user interface

      
Application Number 29724774
Grant Number D0896270
Status In Force
Filing Date 2020-02-19
First Publication Date 2020-09-15
Grant Date 2020-09-15
Owner Magic Leap, Inc. (USA)
Inventor
  • Zurmoehle, Tim
  • Montoya, Andrea Isabel
  • Adams, William
  • Tran, Gregory Minh
  • Pazmino, Lorena
  • Macdonald, Robert John Cummings
  • Powderly, James M.

7.

PATTERNING OF LIQUID CRYSTALS USING SOFT-IMPRINT REPLICATION OF SURFACE ALIGNMENT PATTERNS

      
Application Number 16825913
Status Pending
Filing Date 2020-03-20
First Publication Date 2020-09-10
Owner Magic Leap, Inc. (USA)
Inventor
  • Oh, Chulwoo
  • Chang, Chieh
  • Bhagat, Sharad D.
  • Klug, Michael Anthony

Abstract

Soft-imprint alignment processes for patterning liquid crystal polymer layers via contact with a reusable alignment template are described herein. An example soft-imprint alignment process includes contacting a liquid crystal polymer layer with a reusable alignment template that has a desired surface alignment pattern such that the liquid crystal molecules of the liquid crystal polymer are aligned to the surface alignment pattern via chemical, steric, or other intermolecular interaction. The patterned liquid crystal polymer layer may then be polymerized and separated from the reusable alignment template. The process can be repeated many times. The reusable alignment template may include a photo-alignment layer that does not comprise surface relief structures that correspond to the surface alignment pattern and a release layer above this photo-alignment layer. A reusable alignment template and methods of fabricating the same are also disclosed.

IPC Classes  ?

  • G02F 1/1337 - Surface-induced orientation of the liquid crystal molecules, e.g. by alignment layers
  • G02B 27/01 - Head-up displays
  • C09K 19/00 - Liquid crystal materials
  • G02F 1/1333 - Constructional arrangements

8.

MULTI-LAYER DIFFRACTIVE EYEPIECE

      
Application Number 16879458
Status Pending
Filing Date 2020-05-20
First Publication Date 2020-09-10
Owner Magic Leap, Inc. (USA)
Inventor
  • Schowengerdt, Brian T.
  • Lin, Dianmin
  • St. Hilaire, Pierre

Abstract

An eyepiece for projecting an image to an eye of a viewer includes a waveguide configured to propagate light in a first wavelength range, and a grating coupled to a back surface of the waveguide. The grating is configured to diffract a first portion of the light propagating in the waveguide out of a plane of the waveguide toward a first direction, and to diffract a second portion of the light propagating in the waveguide out of the plane of the waveguide toward a second direction opposite to the first direction. The eyepiece furthers include a wavelength-selective reflector coupled to a front surface of the waveguide. The wavelength selective reflector is configured to reflect light in the first wavelength range and transmit light outside the first wavelength range, such that the wavelength-selective reflector reflects at least part of the second portion of the light back toward the first direction.

IPC Classes  ?

  • F21V 8/00 - Use of light guides, e.g. fibre optic devices, in lighting devices or systems
  • G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F 3/147 - Digital output to display device using display panels
  • G09G 3/00 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
  • G09G 3/20 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix
  • G02B 27/01 - Head-up displays
  • G02B 7/00 - Mountings, adjusting means, or light-tight connections, for optical elements
  • G02B 5/30 - Polarising elements
  • G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
  • G02B 27/28 - Optical systems or apparatus not provided for by any of the groups , for polarising
  • G02B 27/10 - Beam splitting or combining systems
  • H04N 9/31 - Projection devices for colour picture display
  • G02C 5/16 - Side-members resilient or with resilient parts
  • G02C 11/00 - Non-optical adjuncts; Attachment thereof
  • G06F 1/16 - Constructional details or arrangements
  • G06F 1/20 - Cooling means
  • H05K 7/20 - Modifications to facilitate cooling, ventilating, or heating
  • G02B 5/18 - Diffracting gratings

9.

PERSONALIZED NEURAL NETWORK FOR EYE TRACKING

      
Application Number 16880752
Status Pending
Filing Date 2020-05-21
First Publication Date 2020-09-10
Owner Magic Leap, Inc. (USA)
Inventor
  • Kaehler, Adrian
  • Lee, Douglas Bertram
  • Badrinarayanan, Vijay

Abstract

Disclosed herein is a wearable display system for capturing retraining eye images of an eye of a user for retraining a neural network for eye tracking. The system captures retraining eye images using an image capture device when user interface (UI) events occur with respect to UI devices displayed at display locations of a display. The system can generate a retraining set comprising the retraining eye images and eye poses of the eye of the user in the retraining eye images (e.g., related to the display locations of the UI devices) and obtain a retrained neural network that is retrained using the retraining set.

IPC Classes  ?

  • G06T 7/70 - Determining position or orientation of objects or cameras
  • G06T 7/20 - Analysis of motion
  • G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F 3/0481 - Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
  • G06N 3/02 - Computer systems based on biological models using neural network models
  • G02B 27/01 - Head-up displays
  • G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
  • G06T 7/246 - Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
  • G06F 1/16 - Constructional details or arrangements
  • G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,

10.

DETERMINING INPUT FOR SPEECH PROCESSING ENGINE

      
Application Number US2020020469
Publication Number 2020/180719
Status In Force
Filing Date 2020-02-28
Publication Date 2020-09-10
Owner MAGIC LEAP, INC. (USA)
Inventor
  • Sheeder, Anthony Robert
  • Leider, Colby Nelson

Abstract

A method of presenting a signal to a speech processing engine is disclosed. According to an example of the method, an audio signal is received via a microphone. A portion of the audio signal is identified, and a probability is determined that the portion comprises speech directed by a user of the speech processing engine as input to the speech processing engine. In accordance with a determination that the probability exceeds a threshold, the portion of the audio signal is presented as input to the speech processing engine. In accordance with a determination that the probability does not exceed the threshold, the portion of the audio signal is not presented as input to the speech processing engine.

IPC Classes  ?

  • G10L 25/78 - Detection of presence or absence of voice signals
  • G10L 15/20 - Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise or of stress induced speech
  • G10L 15/08 - Speech classification or search

11.

Display panel or portion thereof with a transitional mixed reality graphical user interface

      
Application Number 29722975
Grant Number D0895671
Status In Force
Filing Date 2020-02-03
First Publication Date 2020-09-08
Grant Date 2020-09-08
Owner Magic Leap, Inc. (USA)
Inventor Williams, Anthony

12.

Display panel or portion thereof with a graphical user interface

      
Application Number 29722967
Grant Number D0895670
Status In Force
Filing Date 2020-02-03
First Publication Date 2020-09-08
Grant Date 2020-09-08
Owner Magic Leap, Inc. (USA)
Inventor Williams, Anthony

13.

Display panel or portion thereof with a transitional mixed reality graphical user interface

      
Application Number 29722906
Grant Number D0895674
Status In Force
Filing Date 2020-02-03
First Publication Date 2020-09-08
Grant Date 2020-09-08
Owner Magic Leap, Inc. (USA)
Inventor
  • Zurmoehle, Tim
  • Montoya, Andrea Isabel
  • Pazmino, Lorena

14.

Display panel or portion thereof with a transitional graphical user interface

      
Application Number 29724702
Grant Number D0895675
Status In Force
Filing Date 2020-02-18
First Publication Date 2020-09-08
Grant Date 2020-09-08
Owner Magic Leap, Inc. (USA)
Inventor
  • Zurmoehle, Tim
  • Montoya, Andrea Isabel
  • Adams, William
  • Tran, Gregory Minh
  • Pazmino, Lorena
  • Macdonald, Robert John Cummings
  • Powderly, James M.

15.

BUCKLING MODE ACTUATION OF FIBER SCANNER TO INCREASE FIELD OF VIEW

      
Application Number 16878525
Status Pending
Filing Date 2020-05-19
First Publication Date 2020-09-03
Owner Magic Leap, Inc. (USA)
Inventor
  • Dalrymple, Timothy Mark
  • Duenner, Andrew C.
  • Carlomagno, Albert Daniel
  • Zhang, Xiaoyang
  • Johnson, Michael Robert
  • Jones, Jr., William K.
  • Melville, Charles David

Abstract

Described herein are embodiments of fiber scanning systems and methods of scanning optical fibers. The disclosed systems and methods advantageously provide an improvement to the scanning range, the oscillation amplitude, and/or the maximum pointing angle for an optical fiber in a fiber scanning system by inducing a buckling of a portion of the optical fiber.

IPC Classes  ?

  • G02B 26/10 - Scanning systems
  • H04N 9/14 - Picture reproducers using optical-mechanical scanning means only
  • H01L 41/04 - SEMICONDUCTOR DEVICES; ELECTRIC SOLID STATE DEVICES NOT OTHERWISE PROVIDED FOR - Details thereof - Details of piezo-electric or electrostrictive elements
  • H01L 41/09 - Piezo-electric or electrostrictive elements with electrical input and mechanical output
  • H01L 41/047 - Electrodes

16.

METHOD AND SYSTEM UTILIZING PHASED ARRAY BEAMFORMING FOR SIX DEGREE OF FREEDOM TRACKING FOR AN EMITTER IN AUGMENTED REALITY SYSTEMS

      
Application Number US2020020178
Publication Number 2020/176779
Status In Force
Filing Date 2020-02-27
Publication Date 2020-09-03
Owner MAGIC LEAP, INC. (USA)
Inventor Woods, Michael Janusz

Abstract

An electromagnetic tracking system includes a handheld controller including a first phased array element characterized by a first phase and a second phased array element characterized by a second phase different than the first phase. The first phased array element and the second phased array element are configured to generate a steerable electromagnetic beam characterized by an electromagnetic field pattern. The electromagnetic tracking system also includes a head mounted augmented reality display including an electromagnetic sensor configured to sense the electromagnetic field pattern.

IPC Classes  ?

  • A63F 13/92 - Video game devices specially adapted to be hand-held while playing
  • G02B 27/01 - Head-up displays
  • A63F 13/212 - Input arrangements for video game devices characterised by their sensors, purposes or types using sensors worn by the player, e.g. for measuring heart beat or leg activity
  • A63F 13/235 - Input arrangements for video game devices for interfacing with the game device, e.g. specific interfaces between game controller and console using a wireless connection, e.g. infrared or piconet
  • G06T 19/00 - Manipulating 3D models or images for computer graphics
  • H01Q 3/26 - Arrangements for changing or varying the orientation or the shape of the directional pattern of the waves radiated from an antenna or antenna system varying the distribution of energy across a radiating aperture
  • G01S 13/06 - Systems determining position data of a target

17.

DETERMINING INPUT FOR SPEECH PROCESSING ENGINE

      
Application Number 16805337
Status Pending
Filing Date 2020-02-28
First Publication Date 2020-09-03
Owner Magic Leap, Inc. (USA)
Inventor
  • Sheeder, Anthony Robert
  • Leider, Colby Nelson

Abstract

A method of presenting a signal to a speech processing engine is disclosed. According to an example of the method, an audio signal is received via a microphone. A portion of the audio signal is identified, and a probability is determined that the portion comprises speech directed by a user of the speech processing engine as input to the speech processing engine. In accordance with a determination that the probability exceeds a threshold, the portion of the audio signal is presented as input to the speech processing engine. In accordance with a determination that the probability does not exceed the threshold, the portion of the audio signal is not presented as input to the speech processing engine.

IPC Classes  ?

  • G10L 15/22 - Procedures used during a speech recognition process, e.g. man-machine dialog
  • G10L 15/30 - Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
  • G10L 15/14 - Speech classification or search using statistical models, e.g. Hidden Markov Models [HMM]
  • G10L 15/25 - Speech recognition using non-acoustical features using position of the lips, movement of the lips or face analysis
  • G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer

18.

CONTINUOUS TIME WARP FOR VIRTUAL AND AUGMENTED REALITY DISPLAY SYSTEMS AND METHODS

      
Application Number 16877413
Status Pending
Filing Date 2020-05-18
First Publication Date 2020-09-03
Owner Magic Leap, Inc. (USA)
Inventor
  • Yeoh, Ivan Li Chuen
  • Edwin, Lionel Ernest
  • Miller, Samuel A.

Abstract

Embodiments of the present disclosure relate to continuous and/or binocular time warping methods to account for head movement of the user without having to re-render a displayed image. Continuous time warping allows for transformation of an image from a first perspective to a second perspective of the viewer without having to re-render the image from the second perspective. Binocular time warp refers to the late-frame time warp used in connection with a display device including a left display unit for the left eye and a right display unit for the right eye where the late-frame time warp is performed separately for the left display unit and the right display unit. Warped images are sent to the left and the right display units where photons are generated and emitted toward respective eyes of the viewer, thereby displaying an image on the left and the right display units at the same time.

IPC Classes  ?

  • G06T 15/20 - Perspective computation
  • G06F 3/0481 - Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
  • H04N 13/344 - Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
  • H04N 13/117 - Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
  • H04N 13/383 - Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
  • G06T 1/60 - Memory management
  • G06T 15/00 - 3D [Three Dimensional] image rendering
  • G06T 19/00 - Manipulating 3D models or images for computer graphics
  • A63F 13/00 - Video games, i.e. games using an electronically generated display having two or more dimensions
  • G06T 13/00 - Animation
  • G02B 27/01 - Head-up displays

19.

DISPLAY SYSTEM AND METHOD FOR PROVIDING VARIABLE ACCOMMODATION CUES USING MULTIPLE INTRA-PUPIL PARALLAX VIEWS FORMED BY LIGHT EMITTER ARRAYS

      
Application Number US2020020183
Publication Number 2020/176783
Status In Force
Filing Date 2020-02-27
Publication Date 2020-09-03
Owner MAGIC LEAP, INC. (USA)
Inventor Klug, Michael Anthony

Abstract

A display system is configured to direct a plurality of parallactically-disparate intra-pupil images into a viewer's eye. The parallactically-disparate intra-pupil images provide different parallax views of a virtual object, and impinge on the pupil from different angles. In the aggregate, the wavefronts of light forming the images approximate a continuous divergent wavefront and provide selectable accommodation cues for the user, depending on the amount of parallax disparity between the intra-pupil images. The amount of parallax disparity may be selected using an array of shutters that selectively regulate the entry of image light into an eye. Each opened shutter in the array provides a different intra-pupil image, and the locations of the open shutters provide the desired amount of parallax disparity between the images. In some other embodiments, the images may be formed by an emissive micro-display. Each pixel formed by the micro-display may be formed by one of a group of light emitters, which are at different locations such that the emitted light takes different paths to the eye, the different paths providing different amounts of parallax disparity.

IPC Classes  ?

  • G02B 30/52 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images the image being built up from image elements distributed over a 3D volume, e.g. voxels the 3D volume being constructed from a stack or sequence of 2D planes, e.g. depth sampling systems
  • G02B 26/08 - Optical devices or arrangements using movable or deformable optical elements for controlling the intensity, colour, phase, polarisation or direction of light, e.g. switching, gating or modulating for controlling the direction of light
  • G02B 27/01 - Head-up displays

20.

Display panel or portion thereof with a graphical user interface

      
Application Number 29724654
Grant Number D0894915
Status In Force
Filing Date 2020-02-18
First Publication Date 2020-09-01
Grant Date 2020-09-01
Owner Magic Leap, Inc. (USA)
Inventor
  • Pazmino, Lorena
  • Stolzenberg, Karen

21.

Display panel or portion thereof with a graphical user interface

      
Application Number 29733008
Grant Number D0894945
Status In Force
Filing Date 2020-04-29
First Publication Date 2020-09-01
Grant Date 2020-09-01
Owner Magic Leap, Inc. (USA)
Inventor
  • Nesladek, Christopher David
  • Powderly, James M.
  • Heiner, Cole Parker

22.

Display panel or portion thereof with a transitional mixed reality graphical user interface

      
Application Number 29640707
Grant Number D0894955
Status In Force
Filing Date 2018-03-16
First Publication Date 2020-09-01
Grant Date 2020-09-01
Owner Magin Leap, Inc. (USA)
Inventor Cazamias, Jordan Alexander

23.

Display panel or portion thereof with graphical user interface

      
Application Number 29640743
Grant Number D0894910
Status In Force
Filing Date 2018-03-16
First Publication Date 2020-09-01
Grant Date 2020-09-01
Owner Magic Leap, Inc. (USA)
Inventor
  • Pazmino, Lorena
  • Stolzenberg, Karen
  • Heiner, Cole Parker
  • Peng, Rose Mei

24.

VIRTUAL AND AUGMENTED REALITY SYSTEMS AND METHODS

      
Application Number 15931481
Status Pending
Filing Date 2020-05-13
First Publication Date 2020-08-27
Owner Magic Leap, Inc. (USA)
Inventor
  • Klug, Michael Anthony
  • Schowengerdt, Brian T.
  • Miller, Michael Nevin
  • Singh, Vikramjit
  • Peroz, Christophe
  • St. Hilaire, Pierre
  • Sun, Jie

Abstract

Methods of manufacturing a liquid crystal device including depositing a layer of liquid crystal material on a substrate and imprinting a pattern on the layer of liquid crystal material using an imprint template are disclosed. The liquid crystal material can be jet deposited. The imprint template can include surface relief features, Pancharatnam-Berry Phase Effect (PBPE) structures or diffractive structures. The liquid crystal device manufactured by the methods described herein can be used to manipulate light, such as for beam steering, wavefront shaping, separating wavelengths and/or polarizations, and combining different wavelengths and/or polarizations.

IPC Classes  ?

  • G02B 5/30 - Polarising elements
  • G02B 27/01 - Head-up displays
  • F21V 8/00 - Use of light guides, e.g. fibre optic devices, in lighting devices or systems
  • G02B 5/18 - Diffracting gratings
  • G02B 26/10 - Scanning systems
  • G02B 27/42 - Diffraction optics
  • G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
  • G02B 27/10 - Beam splitting or combining systems
  • G02B 1/00 - Optical elements characterised by the material of which they are made; Optical coatings for optical elements
  • G02B 27/28 - Optical systems or apparatus not provided for by any of the groups , for polarising

25.

BLUE LIGHT ADJUSTMENT FOR BIOMETRIC SECURITY

      
Application Number 16870737
Status Pending
Filing Date 2020-05-08
First Publication Date 2020-08-27
Owner Magic Leap, Inc. (USA)
Inventor Kaehler, Adrian

Abstract

Systems and methods for blue light adjustment with a wearable display system are provided. Embodiments of the systems and methods for blue light adjustment can include receiving an eye image of an eye exposed to an adjusted level of blue light; detecting a change in a pupillary response by comparison of the received eye image to a first image; determining that the pupillary response corresponds to a biometric characteristic of a human individual; and allowing access to a biometric application based on the pupillary response determination.

IPC Classes  ?

  • G06F 21/32 - User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
  • G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
  • G06K 9/20 - Image acquisition

26.

Display panel or portion thereof with a graphical user interface

      
Application Number 29732558
Grant Number D0894219
Status In Force
Filing Date 2020-04-24
First Publication Date 2020-08-25
Grant Date 2020-08-25
Owner Magic Leap, Inc. (USA)
Inventor
  • Nesladek, Christopher David
  • Powderly, James M.
  • Heiner, Cole Parker

27.

Display panel or portion thereof with a graphical user interface

      
Application Number 29732884
Grant Number D0894220
Status In Force
Filing Date 2020-04-28
First Publication Date 2020-08-25
Grant Date 2020-08-25
Owner Magic Leap, Inc. (USA)
Inventor
  • Nesladek, Christopher David
  • Powderly, James M.
  • Heiner, Cole Parker

28.

Display panel or portion thereof with a graphical user interface

      
Application Number 29733013
Grant Number D0894222
Status In Force
Filing Date 2020-04-29
First Publication Date 2020-08-25
Grant Date 2020-08-25
Owner Magic Leap, Inc. (USA)
Inventor
  • Nesladek, Christopher David
  • Powderly, James M.
  • Heiner, Cole Parker

29.

Display panel or portion thereof with a transitional mixed reality graphical user interface

      
Application Number 29723223
Grant Number D0894238
Status In Force
Filing Date 2020-02-05
First Publication Date 2020-08-25
Grant Date 2020-08-25
Owner Magic Leap, Inc. (USA)
Inventor
  • Dedonato, Amy
  • Pazmino, Lorena
  • Xu, Yan
  • Shelton, Marc Coleman
  • Powderly, James M.
  • Nathan, Dylan
  • Lin, Li Chin

30.

Display panel or portion thereof with a graphical user interface

      
Application Number 29732548
Grant Number D0894217
Status In Force
Filing Date 2020-04-24
First Publication Date 2020-08-25
Grant Date 2020-08-25
Owner Magic Leap, Inc. (USA)
Inventor
  • Nesladek, Christopher David
  • Powderly, James M.
  • Heiner, Cole Parker

31.

Display panel or portion thereof with a graphical user interface

      
Application Number 29732556
Grant Number D0894218
Status In Force
Filing Date 2020-04-24
First Publication Date 2020-08-25
Grant Date 2020-08-25
Owner Magic Leap, Inc. (USA)
Inventor
  • Nesladek, Christopher David
  • Powderly, James M.
  • Heiner, Cole Parker

32.

Display panel or portion thereof with a graphical user interface

      
Application Number 29732893
Grant Number D0894221
Status In Force
Filing Date 2020-04-28
First Publication Date 2020-08-25
Grant Date 2020-08-25
Owner Magic Leap, Inc. (USA)
Inventor
  • Nesladek, Christopher David
  • Powderly, James M.
  • Heiner, Cole Parker

33.

Viewing device

      
Application Number 29636492
Grant Number D0894258
Status In Force
Filing Date 2018-02-08
First Publication Date 2020-08-25
Grant Date 2020-08-25
Owner Magic Leap, Inc. (USA)
Inventor
  • Dominguez, Daniel Roger
  • Gamble, Samantha Jo
  • Skelton, Robert Coleman
  • Fraser, Bradley
  • Kaji, Masamune

34.

BIASED TOTAL THICKNESS VARIATIONS IN WAVEGUIDE DISPLAY SUBSTRATES

      
Application Number 16792083
Status Pending
Filing Date 2020-02-14
First Publication Date 2020-08-20
Owner Magic Leap, Inc. (USA)
Inventor
  • Bhargava, Samarth
  • Peroz, Christophe
  • Liu, Victor Kai

Abstract

A plurality of waveguide display substrates, each waveguide display substrate having a cylindrical portion having a diameter and a planar surface, a curved portion opposite the planar surface defining a nonlinear change in thickness across the substrate and having a maximum height D with respect to the cylindrical portion, and a wedge portion between the cylindrical portion and the curved portion defining a linear change in thickness across the substrate and having a maximum height W with respect to the cylindrical portion. A target maximum height Dt of the curved portion is 10−7 to 10−6 times the diameter, D is between about 70% and about 130% of Dt, and W is less than about 30% of Dt.

IPC Classes  ?

  • G02B 6/13 - Integrated optical circuits characterised by the manufacturing method
  • G02B 6/122 - Basic optical elements, e.g. light-guiding paths

35.

VIRTUAL AND AUGMENTED REALITY SYSTEMS AND METHODS

      
Application Number 16814975
Status Pending
Filing Date 2020-03-10
First Publication Date 2020-08-20
Owner MAGIC LEAP, INC. (USA)
Inventor Schowengerdt, Brian T.

Abstract

A method for displaying virtual content to a user, the method includes determining an accommodation of the user's eyes. The method also includes delivering, through a first waveguide of a stack of waveguides, light rays having a first wavefront curvature based at least in part on the determined accommodation, wherein the first wavefront curvature corresponds to a focal distance of the determined accommodation. The method further includes delivering, through a second waveguide of the stack of waveguides, light rays having a second wavefront curvature, the second wavefront curvature associated with a predetermined margin of the focal distance of the determined accommodation.

IPC Classes  ?

  • G06T 19/00 - Manipulating 3D models or images for computer graphics
  • H04N 5/21 - Circuitry for suppressing or minimising disturbance, e.g. moire or halo
  • G06T 15/50 - Lighting effects
  • G06T 5/00 - Image enhancement or restoration
  • H04N 13/117 - Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
  • H04N 13/286 - Image signal generators having separate monoscopic and stereoscopic modes
  • H04N 13/341 - Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using temporal multiplexing
  • H04N 13/344 - Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
  • H04N 13/361 - Reproducing mixed stereoscopic images; Reproducing mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
  • H04N 13/366 - Image reproducers using viewer tracking
  • H04N 13/383 - Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
  • G02B 27/01 - Head-up displays
  • G06T 7/73 - Determining position or orientation of objects or cameras using feature-based methods
  • H04N 13/363 - Image reproducers using image projection screens
  • H04N 13/239 - Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
  • G06T 7/50 - Depth or shape recovery
  • G02B 30/24 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer’s left and right eyes of the stereoscopic type involving temporal multiplexing, e.g. using sequentially activated left and right shutters
  • G02B 6/00 - Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
  • G02B 5/00 - Optical elements other than lenses
  • G02F 1/01 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
  • G02F 1/17 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on variable-absorption elements not provided for in groups
  • G02B 3/00 - Simple or compound lenses
  • G06K 9/52 - Extraction of features or characteristics of the image by deriving mathematical or geometrical properties from the whole image
  • G06T 19/20 - Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
  • G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
  • G09G 5/00 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
  • H04N 5/74 - Projection arrangements for image reproduction, e.g. using eidophor
  • G09G 5/10 - Intensity circuits
  • G09G 5/02 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the way in which colour is displayed
  • G02B 5/18 - Diffracting gratings
  • G02B 26/08 - Optical devices or arrangements using movable or deformable optical elements for controlling the intensity, colour, phase, polarisation or direction of light, e.g. switching, gating or modulating for controlling the direction of light
  • G02B 6/02 - Optical fibre with cladding
  • G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
  • G02B 6/06 - Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings formed by bundles of fibres the relative position of the fibres being the same at both ends, e.g. for transporting images
  • G02B 5/20 - Filters
  • G02F 1/1334 - Constructional arrangements based on polymer-dispersed liquid crystals, e.g. microencapsulated liquid crystals
  • G02F 1/29 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the position or the direction of light beams, i.e. deflection
  • G06T 13/40 - 3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
  • G02B 6/34 - Optical coupling means utilising prism or grating
  • G02B 6/40 - Mechanical coupling means having fibre bundle mating means
  • H04N 5/225 - Television cameras
  • G02B 6/32 - Optical coupling means having lens focusing means
  • G02B 17/08 - Catadioptric systems
  • G06T 15/10 - Geometric effects
  • G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
  • G06T 17/10 - Volume description, e.g. cylinders, cubes or using CSG [Constructive Solid Geometry]
  • G09G 5/18 - Timing circuits for raster scan displays
  • G06F 3/14 - Digital output to display device
  • G06T 15/00 - 3D [Three Dimensional] image rendering
  • G02C 7/04 - Contact lenses for the eyes
  • G02C 7/10 - Filters, e.g. for facilitating adaptation of the eyes to the dark; Sunglasses
  • G06T 5/50 - Image enhancement or restoration by the use of more than one image, e.g. averaging, subtraction
  • G02B 27/42 - Diffraction optics
  • G02F 1/31 - Digital deflection devices

36.

VIRTUAL OR AUGMENTED REALITY HEADSETS HAVING ADJUSTABLE INTERPUPILLARY DISTANCE

      
Application Number 16863485
Status Pending
Filing Date 2020-04-30
First Publication Date 2020-08-20
Owner Magic Leap, Inc. (USA)
Inventor
  • Kaji, Masamune
  • Slipy, Michael John
  • Natsume, Shigeru

Abstract

A virtual or augmented reality headset is provided having a frame, a pair of virtual or augmented reality eyepieces, and an interpupillary distance adjustment mechanism. The frame includes opposing arm members and a bridge positioned intermediate the opposing arm members. The adjustment mechanism is coupled to the virtual or augmented reality eyepieces and operable to simultaneously move the eyepieces to adjust the interpupillary distance of the eyepieces.

IPC Classes  ?

  • G02B 27/01 - Head-up displays
  • G02C 5/08 - Bridges; Browbars; Intermediate bars foldable
  • G06T 19/00 - Manipulating 3D models or images for computer graphics
  • G02C 5/04 - Bridges; Browbars; Intermediate bars with adjustable means
  • G02B 7/12 - Adjusting pupillary distance of binocular pairs

37.

Display panel or portion thereof with graphical user interface

      
Application Number 29723065
Grant Number D0893521
Status In Force
Filing Date 2020-02-04
First Publication Date 2020-08-18
Grant Date 2020-08-18
Owner Magic Leap, Inc. (USA)
Inventor
  • Pazmino, Lorena
  • Stolzenberg, Karen
  • Zurmoehle, Tim
  • Stutts, Timothy Michael

38.

Display panel or portion thereof with graphical user interface

      
Application Number 29723047
Grant Number D0893520
Status In Force
Filing Date 2020-02-04
First Publication Date 2020-08-18
Grant Date 2020-08-18
Owner Magic Leap, Inc. (USA)
Inventor
  • Pazmino, Lorena
  • Stolzenberg, Karen
  • Zurmoehle, Tim
  • Stutts, Timothy Michael

39.

Display panel or portion thereof with graphical user interface

      
Application Number 29723085
Grant Number D0893522
Status In Force
Filing Date 2020-02-04
First Publication Date 2020-08-18
Grant Date 2020-08-18
Owner Magic Leap, Inc. (USA)
Inventor
  • Pazmino, Lorena
  • Stolzenberg, Karen
  • Zurmoehle, Tim
  • Stutts, Timothy Michael

40.

Display panel or portion thereof with a transitional mixed reality graphical user interface

      
Application Number 29724604
Grant Number D0893523
Status In Force
Filing Date 2020-02-18
First Publication Date 2020-08-18
Grant Date 2020-08-18
Owner Magic Leap, Inc. (USA)
Inventor
  • Pazmino, Lorena
  • Stolzenberg, Karen

41.

Display panel or portion thereof with a transitional mixed reality graphical user interface

      
Application Number 29721915
Grant Number D0893544
Status In Force
Filing Date 2020-01-24
First Publication Date 2020-08-18
Grant Date 2020-08-18
Owner Magic Leap, Inc. (USA)
Inventor
  • Pazmino, Lorena
  • Tran, Gregory Minh

42.

Display panel or portion thereof with a transitional mixed reality graphical user interface

      
Application Number 29723219
Grant Number D0893549
Status In Force
Filing Date 2020-02-05
First Publication Date 2020-08-18
Grant Date 2020-08-18
Owner Magic Leap, Inc. (USA)
Inventor
  • Dedonato, Amy
  • Pazmino, Lorena
  • Xu, Yan
  • Shelton, Marc Coleman
  • Powderly, James M.
  • Nathan, Dylan
  • Lin, Li Chin

43.

Display panel or portion thereof with a transitional mixed reality graphical user interface

      
Application Number 29723230
Grant Number D0893550
Status In Force
Filing Date 2020-02-05
First Publication Date 2020-08-18
Grant Date 2020-08-18
Owner Magic Leap, Inc. (USA)
Inventor
  • Dedonato, Amy
  • Pazmino, Lorena
  • Xu, Yan
  • Shelton, Marc Coleman
  • Powderly, James M.
  • Nathan, Dylan
  • Lin, Li Chin

44.

HEAD POSE MIXING OF AUDIO FILES

      
Application Number 16861057
Status Pending
Filing Date 2020-04-28
First Publication Date 2020-08-13
Owner Magic Leap, Inc. (USA)
Inventor
  • Mangiat, Stephen Vincent
  • Tucker, Michael Benson
  • Tajik, Anastasia Andreyevna

Abstract

Examples of wearable devices that can present to a user of the display device an audible or visual representation of an audio file comprising a plurality of stem tracks that represent different audio content of the audio file are described. Systems and methods are described that determine the pose of the user; generate, based on the pose of the user, an audio mix of at least one of the plurality of stem tracks of the audio file; generate, based on the pose of the user and the audio mix, a visualization of the audio mix; communicate an audio signal representative of the audio mix to the speaker; and communicate a visual signal representative of the visualization of the audio mix to the display.

IPC Classes  ?

  • H04S 7/00 - Indicating arrangements; Control arrangements, e.g. balance control
  • G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F 1/16 - Constructional details or arrangements
  • G06F 3/16 - Sound input; Sound output

45.

MANUFACTURING FOR VIRTUAL AND AUGMENTED REALITY SYSTEMS AND COMPONENTS

      
Application Number 16862251
Status Pending
Filing Date 2020-04-29
First Publication Date 2020-08-13
Owner Magic Leap, Inc. (USA)
Inventor
  • Tekolste, Robert D.
  • Klug, Michael Anthony
  • Greco, Paul M.
  • Schowengerdt, Brian T.

Abstract

Disclosed is an improved diffraction structure for 3D display systems. The improved diffraction structure includes an intermediate layer that resides between a waveguide substrate and a top grating surface. The top grating surface comprises a first material that corresponds to a first refractive index value, the underlayer comprises a second material that corresponds to a second refractive index value, and the substrate comprises a third material that corresponds to a third refractive index value. According to additional embodiments, improved approaches are provided to implement deposition of imprint materials onto a substrate, which allow for very precise distribution and deposition of different imprint patterns onto any number of substrate surfaces.

IPC Classes  ?

46.

LIGHTWEIGHT CROSS REALITY DEVICE WITH PASSIVE DEPTH EXTRACTION

      
Application Number US2020017119
Publication Number 2020/163662
Status In Force
Filing Date 2020-02-07
Publication Date 2020-08-13
Owner MAGIC LEAP, INC. (USA)
Inventor
  • Zahnert, Martin, Georg
  • Ilic, Alexander
  • Granados Velasquez, Miguel, Andres
  • Gomez Gonzalez, Javier, Victorio

Abstract

A wearable display system including multiple cameras and a processor is disclosed. A greyscale camera and a color camera can be arranged to provide a central view field associated with both cameras and a peripheral view field associated with one of the two cameras. One or more of the two cameras may be a plenoptic camera. The wearable display system may acquire light field information using the at least one plenoptic camera and create a world model using the first light field information and first depth information stereoscopically determined from images acquired by the greyscale camera and the color camera. The wearable display system can track head pose using the at least one plenoptic camera and the world model. The wearable display system can track objects in the central view field and the peripheral view fields using the one or two plenoptic cameras, when the objects satisfy a depth criterion.

IPC Classes  ?

  • H04N 13/204 - Image signal generators using stereoscopic image cameras
  • H04N 13/239 - Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
  • H04N 13/271 - Image signal generators wherein the generated image signals comprise depth maps or disparity maps
  • H04N 13/275 - Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
  • H04N 13/344 - Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
  • G02B 27/01 - Head-up displays

47.

CONFIGURING OPTICAL LAYERS IN IMPRINT LITHOGRAPHY PROCESSES

      
Application Number 16859584
Status Pending
Filing Date 2020-04-27
First Publication Date 2020-08-13
Owner Magic Leap, Inc. (USA)
Inventor
  • Singh, Vikramjit
  • Miller, Michael Nevin
  • Xu, Frank Y.
  • Yang, Shuqiang

Abstract

An imprint lithography method of configuring an optical layer includes selecting one or more parameters of a nanolayer to be applied to a substrate for changing an effective refractive index of the substrate and imprinting the nanolayer on the substrate to change the effective refractive index of the substrate such that a relative amount of light transmittable through the substrate is changed by a selected amount.

IPC Classes  ?

  • G03F 7/20 - Exposure; Apparatus therefor
  • G02B 1/118 - Anti-reflection coatings having sub-optical wavelength surface structures designed to provide an enhanced transmittance, e.g. moth-eye structures
  • G03F 7/00 - Photomechanical, e.g. photolithographic, production of textured or patterned surfaces, e.g. printed surfaces; Materials therefor, e.g. comprising photoresists; Apparatus specially adapted therefor

48.

EFFICIENT RENDERING OF VIRTUAL SOUNDFIELDS

      
Application Number 16861111
Status Pending
Filing Date 2020-04-28
First Publication Date 2020-08-13
Owner Magic Leap, Inc. (USA)
Inventor
  • Schmidt, Brian Lloyd
  • Dicker, Samuel Charles

Abstract

An audio system and method of spatially rendering audio signals that uses modified virtual speaker panning is disclosed. The audio system may include a fixed number F of virtual speakers, and the modified virtual speaker panning may dynamically select and use a subset P of the fixed virtual speakers. The subset P of virtual speakers may be selected using a low energy speaker detection and culling method, a source geometry-based culling method, or both. One or more processing blocks in the decoder/virtualizer may be bypassed based on the energy level of the associated audio signal or the location of the sound source relative to the user/listener, respectively. In some embodiments, a virtual speaker that is designated as an active virtual speaker at a first time, may also be designated as an active virtual speaker at a second time to ensure the processing completes.

IPC Classes  ?

  • H04S 7/00 - Indicating arrangements; Control arrangements, e.g. balance control
  • H04S 3/00 - Systems employing more than two channels, e.g. quadraphonic
  • G10L 25/21 - Speech or voice analysis techniques not restricted to a single one of groups characterised by the type of extracted parameters the extracted parameters being power information
  • G10L 19/008 - Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing

49.

MODE ARCHITECTURE FOR GENERAL PURPOSE ROBOTICS

      
Application Number 16865225
Status Pending
Filing Date 2020-05-01
First Publication Date 2020-08-13
Owner MAGIC LEAP, INC. (USA)
Inventor
  • Zyda, Frederick Dennis
  • Kranski, Jeffrey Steven
  • Chauhan, Vikram

Abstract

An improved method, system, and apparatus is provided to implement a general architecture for robot systems. A mode execution module is provided to universally execute execution modes on different robotic system. A system includes an execution module that receives software instructions in a normalized programming language. The system also includes an interface having a translation layer that converts the software instructions from the normalized language into robot-specific instructions that operate in a particular robotic system. The system further includes a controller that is communicatively coupled to the interface, wherein the controller receives the robot-specific instructions. Moreover, the system includes a robotic device that is operatively controlled by the controller by execution of the robot-specific instructions.

IPC Classes  ?

  • B25J 9/16 - Programme controls
  • G05B 19/042 - Programme control other than numerical control, i.e. in sequence controllers or logic controllers using digital processors

50.

TARGET INTENT-BASED CLOCK SPEED DETERMINATION AND ADJUSTMENT TO LIMIT TOTAL HEAT GENERATED BY MULTIPLE PROCESSORS

      
Application Number US2020017023
Publication Number 2020/163603
Status In Force
Filing Date 2020-02-06
Publication Date 2020-08-13
Owner MAGIC LEAP, INC. (USA)
Inventor Link, Gregory Michael

Abstract

A power profile library includes a plurality of power profiles with each power profile having a plurality of maximum clock speeds for respective processors. The maximum clock speeds of each power profile are selected to limit a maximum amount of heat per unit time generated by the processors in combination. A developer computer system selects sections of an eventual application for a consumer device and a target intent for each section. A power profile lookup uses the target intents to determine a power profile for each section.

IPC Classes  ?

  • G06F 1/28 - Supervision thereof, e.g. detecting power-supply failure by out of limits supervision
  • G06F 1/32 - Means for saving power
  • H04B 1/707 - Spread spectrum techniques using direct sequence modulation

51.

LIGHTWEIGHT AND LOW POWER CROSS REALITY DEVICE WITH HIGH TEMPORAL RESOLUTION

      
Application Number US2020017121
Publication Number 2020/163663
Status In Force
Filing Date 2020-02-07
Publication Date 2020-08-13
Owner MAGIC LEAP, INC. (USA)
Inventor
  • Zahnert, Martin, Georg
  • Ilic, Alexander

Abstract

A wearable display system for a cross reality (XR) system may have a dynamic vision sensor (DVS) camera and a color camera. At least one of the cameras may be a plenoptic camera. The wearable display system may dynamically restrict processing of image data from either or both cameras based on detected conditions and XR function being performed. For tracking an object, image information may be processed for patches of a field of view of either or both cameras corresponding to the object. The object may be tracked based on asynchronously acquired events indicating changes within the patches. Stereoscopic or other types of image information may be used when event-based object tacking yields an inadequate quality metric. The tracked object may be a user's hand or a stationary object in the physical world, enabling calculation of the pose of the wearable display system and of the wearer's head.

IPC Classes  ?

  • H04N 13/239 - Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
  • H04N 13/271 - Image signal generators wherein the generated image signals comprise depth maps or disparity maps
  • H04N 13/275 - Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
  • H04N 13/344 - Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
  • G02B 27/01 - Head-up displays
  • G06T 7/70 - Determining position or orientation of objects or cameras
  • G06T 15/20 - Perspective computation
  • G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer

52.

Display panel, or portion thereof, with a graphical user interface

      
Application Number 29631985
Grant Number D0892828
Status In Force
Filing Date 2018-01-04
First Publication Date 2020-08-11
Grant Date 2020-08-11
Owner Magic Leap, Inc. (USA)
Inventor
  • Nesladek, Christopher David
  • Powderly, James M.
  • Heiner, Cole Parker

53.

EYE TRACKING CALIBRATION TECHNIQUES

      
Application Number 16855270
Status Pending
Filing Date 2020-04-22
First Publication Date 2020-08-06
Owner Magic Leap, Inc. (USA)
Inventor
  • Uscinski, Benjamin Joseph
  • Xu, Yan
  • Stuart, Bradley Vincent

Abstract

Systems and methods for eye tracking calibration in a wearable system are described. The wearable system can present three-dimensional (3D) virtual content and allow a user to interact with the 3D virtual content using eye gaze. During an eye tracking calibration, the wearable system can validate that a user is indeed looking at a calibration target while the eye tracking data is acquired. The validation may be performed based on data associated with the user's head pose and vestibulo-ocular reflex.

IPC Classes  ?

  • G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
  • A63F 13/212 - Input arrangements for video game devices characterised by their sensors, purposes or types using sensors worn by the player, e.g. for measuring heart beat or leg activity
  • A63F 13/22 - Setup operations, e.g. calibration, key configuration or button assignment
  • A63F 13/211 - Input arrangements for video game devices characterised by their sensors, purposes or types using inertial sensors, e.g. accelerometers or gyroscopes
  • A63F 13/213 - Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
  • G06T 15/06 - Ray-tracing
  • G06T 7/70 - Determining position or orientation of objects or cameras
  • G06T 19/00 - Manipulating 3D models or images for computer graphics
  • G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
  • G06F 1/16 - Constructional details or arrangements

54.

DISPLAY SYSTEM HAVING 1-DIMENSIONAL PIXEL ARRAY WITH SCANNING MIRROR

      
Application Number US2020015243
Publication Number 2020/159883
Status In Force
Filing Date 2020-01-27
Publication Date 2020-08-06
Owner MAGIC LEAP, INC. (USA)
Inventor Abele, Nicolas

Abstract

Display systems are described including augmented 1-dimensional pixel arrays and scanning mirrors. In one example, a pixel array includes first and second columns of pixels, relay optics configured to receive incident light and to output the incident light to a viewer, and a scanning mirror disposed to receive the light from the first and second columns of pixels and to reflect the received light toward the relay optics. The scanning mirror may move between a plurality of positions while the first and second columns emit light in temporally spaced pulses so as to form a perceived image at the relay optics having a higher resolution relative to the pixel pitch of the individual columns. Foveated rendering may provide for more efficient use of power and processing resources.

IPC Classes  ?

  • H04N 3/08 - Scanning details of television systems; Combination thereof with generation of supply voltages by optical-mechanical means only having a moving reflector

55.

INLINE IN-COUPLING OPTICAL ELEMENTS

      
Application Number US2020015735
Publication Number 2020/160188
Status In Force
Filing Date 2020-01-29
Publication Date 2020-08-06
Owner MAGIC LEAP, INC. (USA)
Inventor
  • Khorasaninejad, Mohammadreza
  • Liu, Victor Kai
  • Lin, Dianmin
  • Peroz, Christophe
  • St. Hilaire, Pierre

Abstract

A display system includes a waveguide assembly having a plurality of waveguides, each waveguide associated with an in-coupling optical element configured to in-couple light into the associated waveguide. A projector outputs light from one or more spatially- separated pupils, and at least one of the pupils outputs light of two different ranges of wavelengths. The in-coupling optical elements for two or more waveguides are inline, e.g. vertically aligned, with each other so that the in-coupling optical elements are in the path of light of the two different ranges of wavelengths. The in-coupling optical element of a first waveguide selectively in-couples light of one range of wavelengths into the waveguide, while the in-coupling optical element of a second waveguide selectively in-couples light of another range of wavelengths. Absorptive color filters are provided forward of an in-coupling optical element to limit the propagation of undesired wavelengths of light to that in-coupling optical element.

IPC Classes  ?

  • G02B 6/00 - Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
  • G02B 6/24 - Coupling light guides
  • G02B 6/26 - Optical coupling means
  • G02B 6/10 - Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings of the optical waveguide type
  • G02B 27/01 - Head-up displays
  • G02B 27/0101 -
  • G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
  • G02F 1/00 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
  • G02F 1/1343 - Electrodes
  • G02F 1/1333 - Constructional arrangements
  • G02F 1/133 - Constructional arrangements; Operation of liquid crystal cells; Circuit arrangements

56.

REFLECTIVE SWITCHING DEVICE FOR INPUTTING DIFFERENT WAVELENGTHS OF LIGHT INTO WAVEGUIDES

      
Application Number 16735306
Status Pending
Filing Date 2020-01-06
First Publication Date 2020-08-06
Owner Magic Leap, Inc. (USA)
Inventor
  • Tinch, David
  • Jones, William K.

Abstract

Systems and methods are provided for selectively incoupling light having different wavelengths into one of a plurality of waveguides. The systems and methods provided for selectively incoupling light having different wavelengths into one of a plurality of waveguides comprise a switching device comprising switchable reflective elements that can be configured to redirect incoming light towards an incoupling element associated with one of a plurality of waveguides.

IPC Classes  ?

57.

PERIOCULAR TEST FOR MIXED REALITY CALIBRATION

      
Application Number 16780698
Status Pending
Filing Date 2020-02-03
First Publication Date 2020-08-06
Owner Magic Leap, Inc. (USA)
Inventor
  • Kaehler, Adrian
  • Bradski, Gary
  • Badrinarayanan, Vijay

Abstract

A wearable device can include an inward-facing imaging system configured to acquire images of a user's periocular region. The wearable device can determine a relative position between the wearable device and the user's face based on the images acquired by the inward-facing imaging system. The relative position may be used to determine whether the user is wearing the wearable device, whether the wearable device fits the user, or whether an adjustment to a rendering location of virtual object should be made to compensate for a deviation of the wearable device from its normal resting position.

IPC Classes  ?

  • G06T 11/60 - Editing figures and text; Combining figures or text
  • G06K 9/46 - Extraction of features or characteristics of the image
  • G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
  • G06T 3/20 - Linear translation of a whole image or part thereof, e.g. panning
  • G02B 27/01 - Head-up displays

58.

TARGET INTENT-BASED CLOCK SPEED DETERMINATION AND ADJUSTMENT TO LIMIT TOTAL HEAT GENERATED BY MULTIPLE PROCESSORS

      
Application Number 16783866
Status Pending
Filing Date 2020-02-06
First Publication Date 2020-08-06
Owner Magic Leap, Inc. (USA)
Inventor Link, Gregory Michael

Abstract

A power profile library includes a plurality of power profiles with each power profile having a plurality of maximum clock speeds for respective processors. The maximum clock speeds of each power profile are selected to limit a maximum amount of heat per unit time generated by the processors in combination. A developer computer system selects sections of an eventual application for a consumer device and a target intent for each section. A power profile lookup uses the target intents to determine a power profile for each section.

IPC Classes  ?

  • H04L 29/08 - Transmission control procedure, e.g. data link level control procedure
  • G06F 1/3209 - Monitoring remote activity, e.g. over telephone lines or network connections
  • G06F 1/324 - Power saving characterised by the action undertaken by lowering clock frequency
  • G06F 1/08 - Clock generators with changeable or programmable clock frequency

59.

METHOD AND SYSTEM FOR RESOLVING HEMISPHERE AMBIGUITY IN SIX DEGREE OF FREEDOM POSE MEASUREMENTS

      
Application Number US2020015029
Publication Number 2020/159827
Status In Force
Filing Date 2020-01-24
Publication Date 2020-08-06
Owner MAGIC LEAP, INC. (USA)
Inventor
  • Degges, Jr., Ronald Joseph
  • Wan, Sheng
  • Warner, Andy
  • Gujarati, Akash

Abstract

Techniques for resolving hemisphere ambiguity are disclosed. One or more magnetic fields are emitted at a handheld controller. The one or more magnetic fields are detected by one or more sensors positioned relative to a headset. Movement data corresponding to the handheld controller or the headset is detected. During a first time interval, a first position and a first orientation of the handheld controller within a first hemisphere are determined based on the detected one or more magnetic fields, and a first discrepancy is calculated based on the first position, the first orientation, and the movement data. During a second time interval, a second position and a second orientation of the handheld controller within a second hemisphere are determined based on the detected one or more magnetic fields, and a second discrepancy is calculated based on the second position, the second orientation, and the movement data.

IPC Classes  ?

  • G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
  • G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
  • G06T 17/05 - Geographic models
  • G06T 19/00 - Manipulating 3D models or images for computer graphics

60.

Display panel or portion thereof with graphical user interface

      
Application Number 29640872
Grant Number D0892133
Status In Force
Filing Date 2018-03-16
First Publication Date 2020-08-04
Grant Date 2020-08-04
Owner Magic Leap, Inc. (USA)
Inventor
  • Busto, Javier Antonio
  • Vanhoozer, Jeremy
  • Brodsky, Jonathan
  • Laufbahn, Michael

61.

Display panel or portion thereof with a graphical user interface

      
Application Number 29640729
Grant Number D0892131
Status In Force
Filing Date 2018-03-16
First Publication Date 2020-08-04
Grant Date 2020-08-04
Owner Magic Leap, Inc. (USA)
Inventor
  • Pazmino, Lorena
  • Stolzenberg, Karen
  • Zurmoehle, Tim
  • Montoya, Andrea Isabel
  • Tran, Gregory Minh

62.

Display panel or portion thereof with a graphical user interface

      
Application Number 29640747
Grant Number D0892132
Status In Force
Filing Date 2018-03-16
First Publication Date 2020-08-04
Grant Date 2020-08-04
Owner Magic Leap, Inc. (USA)
Inventor
  • Pazmino, Lorena
  • Stolzenberg, Karen
  • Heiner, Cole Parker

63.

EYE-TRACKING USING IMAGES HAVING DIFFERENT EXPOSURE TIMES

      
Application Number 16751076
Status Pending
Filing Date 2020-01-23
First Publication Date 2020-07-30
Owner Magic Leap, Inc. (USA)
Inventor Cohen, David

Abstract

An eye tracking system can include an eye-tracking camera configured to obtain images of the eye at different exposure times or different frame rates. For example, longer exposure images of the eye taken at a longer exposure time can show iris or pupil features, and shorter exposure, glint images can show peaks of glints reflected from the cornea. The shorter exposure glint images may be taken at a higher frame rate (than the longer exposure images) for accurate gaze prediction. The shorter exposure glint images can be analyzed to provide glint locations to subpixel accuracy. The longer exposure images can be analyzed for pupil center or center of rotation. The eye tracking system can predict future gaze direction, which can be used for foveated rendering by a wearable display system.

IPC Classes  ?

  • G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
  • G09G 5/36 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of individual graphic patterns using a bit-mapped memory

64.

METHOD AND SYSTEM FOR RESOLVING HEMISPHERE AMBIGUITY IN SIX DEGREE OF FREEDOM POSE MEASUREMENTS

      
Application Number 16752165
Status Pending
Filing Date 2020-01-24
First Publication Date 2020-07-30
Owner Magic Leap, Inc. (USA)
Inventor
  • Degges, Jr., Ronald Joseph
  • Wan, Sheng
  • Warner, Andy
  • Gujarati, Akash

Abstract

Techniques for resolving hemisphere ambiguity are disclosed. One or more magnetic fields are emitted at a handheld controller. The one or more magnetic fields are detected by one or more sensors positioned relative to a headset. Movement data corresponding to the handheld controller or the headset is detected. During a first time interval, a first position and a first orientation of the handheld controller within a first hemisphere are determined based on the detected one or more magnetic fields, and a first discrepancy is calculated based on the first position, the first orientation, and the movement data. During a second time interval, a second position and a second orientation of the handheld controller within a second hemisphere are determined based on the detected one or more magnetic fields, and a second discrepancy is calculated based on the second position, the second orientation, and the movement data.

IPC Classes  ?

  • G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
  • G02B 27/01 - Head-up displays
  • G01P 15/08 - Measuring acceleration; Measuring deceleration; Measuring shock, i.e. sudden change of acceleration by making use of inertia forces with conversion into electric or magnetic values

65.

METHOD AND SYSTEM FOR MULTIPLE F-NUMBER LENS

      
Application Number 16846027
Status Pending
Filing Date 2020-04-10
First Publication Date 2020-07-30
Owner Magic Leap, Inc. (USA)
Inventor
  • Pellman, Asaf
  • Tadmor, Erez
  • Cohen, David
  • Yahav, Giora

Abstract

An imaging lens includes one or more lens elements configured to receive and focus light in a first wavelength range reflected off of one or more first objects onto an image plane, and to receive and focus light in a second wavelength range reflected off of one or more second objects onto the image plane. The imaging lens further includes an aperture stop and a filter positioned at the aperture stop. The filter includes a central region and an outer region surrounding the central region. The central region of the filter is characterized by a first transmission band in the first wavelength range and a second transmission band in the second wavelength range. The outer region of the filter is characterized by a third transmission band in the first wavelength range and substantially low transmittance values in the second wavelength range.

IPC Classes  ?

  • H04N 5/238 - Circuitry for compensating for variation in the brightness of the object by influencing optical part of the camera
  • H04N 13/254 - Image signal generators using stereoscopic image cameras in combination with electromagnetic radiation sources for illuminating objects
  • H04N 5/232 - Devices for controlling television cameras, e.g. remote control
  • G01S 7/481 - Constructional features, e.g. arrangements of optical elements
  • G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
  • H04N 5/347 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled by combining or binning pixels in SSIS
  • H04N 5/343 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled by switching between different modes of operation using different resolutions or aspect ratios, e.g. between still and video mode or between interlaced and non-interlaced mode
  • H04N 5/235 - Circuitry for compensating for variation in the brightness of the object
  • H04N 5/225 - Television cameras
  • G02B 27/14 - Beam splitting or combining systems operating by reflection only
  • G02B 27/10 - Beam splitting or combining systems
  • G02B 13/14 - Optical objectives specially designed for the purposes specified below for use with infra-red or ultra-violet radiation
  • G02B 5/20 - Filters
  • G01S 17/89 - Lidar systems, specially adapted for specific applications for mapping or imaging
  • G01S 17/42 - Simultaneous measurement of distance and other coordinates
  • G01S 7/4865 - Time delay measurement, e.g. time-of-flight measurement, time of arrival measurement or determining the exact position of a peak
  • G06T 7/521 - Depth or shape recovery from the projection of structured light

66.

MIXED REALITY SYSTEM WITH VIRTUAL CONTENT WARPING AND METHOD OF GENERATING VIRTUAL CONTENT USING SAME

      
Application Number 16848496
Status Pending
Filing Date 2020-04-14
First Publication Date 2020-07-30
Owner MAGIC LEAP, INC. (USA)
Inventor
  • Nourai, Reza
  • Taylor, Robert Blake

Abstract

A computer implemented method for warping virtual content includes generating warped virtual content by transforming source virtual content. The method also includes determining whether a memory location corresponding to an X, Y location of the warped virtual content in an output frame of reference is occupied by pre-existing virtual content. The method further includes storing the warped virtual content in the memory location if the memory location is not occupied. Moreover, the method includes comparing respective Z locations of the warped virtual content and the pre-existing virtual content to identify virtual content with a Z location closer to a viewing location if the memory location is occupied. The method also includes storing the warped virtual content in the memory location corresponding to the X, Y location if a Z location of warped virtual content is closer to the viewing location than a pre-existing Z location of pre-existing virtual content.

IPC Classes  ?

  • G06T 3/00 - Geometric image transformation in the plane of the image
  • G06T 17/10 - Volume description, e.g. cylinders, cubes or using CSG [Constructive Solid Geometry]
  • G06T 19/00 - Manipulating 3D models or images for computer graphics
  • G06T 15/40 - Hidden part removal
  • G06T 15/20 - Perspective computation

67.

EYE-TRACKING USING IMAGES HAVING DIFFERENT EXPOSURE TIMES

      
Application Number US2020014824
Publication Number 2020/154524
Status In Force
Filing Date 2020-01-23
Publication Date 2020-07-30
Owner MAGIC LEAP, INC. (USA)
Inventor Cohen, David

Abstract

An eye tracking system can include an eye-tracking camera configured to obtain images of the eye at different exposure times or different frame rates. For example, longer exposure images of the eye taken at a longer exposure time can show iris or pupil features, and shorter exposure, glint images can show peaks of glints reflected from the cornea. The shorter exposure glint images may be taken at a higher frame rate (than the longer exposure images) for accurate gaze prediction. The shorter exposure glint images can be analyzed to provide glint locations to subpixel accuracy. The longer exposure images can be analyzed for pupil center or center of rotation. The eye tracking system can predict future gaze direction, which can be used for foveated rendering by a wearable display system.

IPC Classes  ?

  • G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
  • G02B 27/01 - Head-up displays
  • G02B 27/22 - Other optical systems; Other optical apparatus for producing stereoscopic or other three-dimensional effects
  • G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form

68.

Display panel or portion thereof with graphical user interface

      
Application Number 29640790
Grant Number D0891441
Status In Force
Filing Date 2018-03-16
First Publication Date 2020-07-28
Grant Date 2020-07-28
Owner Magic Leap, Inc. (USA)
Inventor
  • Pazmino, Lorena
  • Stolzenberg, Karen
  • Meaney, Brian Everett
  • Montoya, Andrea Isabel
  • Tran, Gregory Minh
  • Dedonato, Amy

69.

Display panel or portion thereof with a transitional graphical user interface

      
Application Number 29654222
Grant Number D0891460
Status In Force
Filing Date 2018-06-21
First Publication Date 2020-07-28
Grant Date 2020-07-28
Owner Magic Leap, Inc. (USA)
Inventor
  • Pazmino, Lorena
  • Montoya, Andrea Isabel
  • Niles, Savannah
  • Rocha, Alexander
  • Bragg, Mario Antonio
  • Goel, Parag

70.

Display panel or portion thereof with a transitional graphical user interface

      
Application Number 29724714
Grant Number D0891464
Status In Force
Filing Date 2020-02-18
First Publication Date 2020-07-28
Grant Date 2020-07-28
Owner Magic Leap, Inc. (USA)
Inventor
  • Zurmoehle, Tim
  • Montoya, Andrea Isabel
  • Adams, William
  • Tran, Gregory Minh
  • Pazmino, Lorena
  • Macdonald, Robert John Cummings
  • Powderly, James M.

71.

NEAR EYE 3D DISPLAY WITH SEPARATE PHASE AND AMPLITUDE MODULATORS

      
Application Number 16650800
Status Pending
Filing Date 2018-09-26
First Publication Date 2020-07-23
Owner Magic Leap, Inc. (USA)
Inventor
  • Jia, Zhiheng
  • Zheng, Hao
  • Daiker, Jeffrey Todd
  • Grata, Jeremy A.

Abstract

Augmented reality glasses include near eye displays the include sources of imagewise amplitude modulated light optical coupled to spatial phase modulators or active zone plate modulators and optically coupled to eye coupling optics. The sources of imagewise amplitude modulated light can include emissive 2D display panels or light sources coupled to imagewise amplitude modulators. The eye coupling optics can include volume holographic diffraction gratings.

IPC Classes  ?

72.

METHOD AND SYSTEM FOR DISPLAY DEVICE WITH INTEGRATED POLARIZER

      
Application Number 16799535
Status Pending
Filing Date 2020-02-24
First Publication Date 2020-07-23
Owner Magic Leap, Inc. (USA)
Inventor
  • Cheng, Hui-Chuan
  • Yeoh, Ivan Li Chuen
  • Edwin, Lionel Ernest

Abstract

An eyepiece unit for projecting an image to an eye of a viewer includes an eyepiece having a world side and a viewer side opposite the world side. The eyepiece includes an input coupling diffractive optical element, an orthogonal pupil expander diffractive optical element, and an exit pupil expander diffractive optical element. The eyepiece unit also includes a curved cosmetic lens disposed adjacent the world side of the eyepiece and a polarizer disposed adjacent the world side of the eyepiece.

IPC Classes  ?

  • H04N 13/332 - Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
  • G02B 27/01 - Head-up displays
  • G02F 1/1335 - Structural association of cells with optical devices, e.g. polarisers or reflectors
  • H04N 9/31 - Projection devices for colour picture display
  • H01Q 15/24 - Polarising devices; Polarisation filters

73.

VIRTUAL, AUGMENTED, AND MIXED REALITY SYSTEMS AND METHODS

      
Application Number US2020014163
Publication Number 2020/150649
Status In Force
Filing Date 2020-01-17
Publication Date 2020-07-23
Owner MAGIC LEAP, INC. (USA)
Inventor
  • Rodriguez, Jose Felix
  • Perez, Ricardo Martinez
  • Nourai, Reza
  • Taylor, Robert Blake

Abstract

A method in a virtual, augmented, or mixed reality system includes a GPU determining/detecting an absence of image data. The method also includes shutting down a portion/component/function of the GPU. The method further includes shutting down a communication link between the GPU and a DB. Moreover, the method includes shutting down a portion/component/function of the DB. In addition, the method includes shutting down a communication link between the DB and a display panel. The further also includes shutting down a portion/component/function of the display panel.

IPC Classes  ?

  • G06F 1/3287 - Power saving characterised by the action undertaken by switching off individual functional units in the computer system
  • G06F 1/3203 - Power management, i.e. event-based initiation of a power-saving mode
  • G06F 1/32 - Means for saving power
  • G06F 3/14 - Digital output to display device

74.

VIRTUAL, AUGMENTED, AND MIXED REALITY SYSTEMS AND METHODS

      
Application Number 16746393
Status Pending
Filing Date 2020-01-17
First Publication Date 2020-07-23
Owner MAGIC LEAP, INC. (USA)
Inventor
  • Rodriguez, Jose Felix
  • Perez, Ricardo Martinez
  • Nourai, Reza
  • Taylor, Robert Blake

Abstract

A method in a virtual, augmented, or mixed reality system includes a GPU determining/detecting an absence of image data. The method also includes shutting down a portion/component/function of the GPU. The method further includes shutting down a communication link between the GPU and a DB. Moreover, the method includes shutting down a portion/component/function of the DB. In addition, the method includes shutting down a communication link between the DB and a display panel. The further also includes shutting down a portion/component/function of the display panel.

IPC Classes  ?

  • G06T 19/00 - Manipulating 3D models or images for computer graphics
  • H04L 29/06 - Communication control; Communication processing characterised by a protocol
  • G06T 1/20 - Processor architectures; Processor configuration, e.g. pipelining
  • H04L 12/753 - Routing tree discovery, e.g. converting from mesh topology to tree topology

75.

INTEGRATING POINT SOURCE FOR TEXTURE PROJECTING BULB

      
Application Number 16841429
Status Pending
Filing Date 2020-04-06
First Publication Date 2020-07-23
Owner Magic Leap, Inc. (USA)
Inventor
  • Kaehler, Adrian
  • Bradski, Gary

Abstract

A texture projecting light bulb includes an extended light source located within an integrator. The integrator includes at least one aperture configured to allow light to travel out of the interior of the integrator. In various embodiments, the interior of the integrator may be a diffusely reflective surface and the integrator may be configured to produce a uniform light distribution at the aperture to approximate a point source. The integrator may be surrounded by a light bulb enclosure. In various embodiments, the light bulb enclosure may include transparent and opaque regions configured to project a structured pattern of visible and/or infrared light.

IPC Classes  ?

  • F21V 3/02 - Globes; Bowls; Cover glasses characterised by the shape
  • F21V 19/00 - Fastening of light sources or lamp holders
  • F21K 9/68 - Optical arrangements integrated in the light source, e.g. for improving the colour rendering index or the light extraction - Details of reflectors forming part of the light source
  • H04N 13/395 - Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume with depth sampling, i.e. the volume being constructed from a stack or sequence of 2D image planes
  • H04N 13/344 - Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
  • H04N 13/254 - Image signal generators using stereoscopic image cameras in combination with electromagnetic radiation sources for illuminating objects
  • H04N 13/128 - Adjusting depth or disparity

76.

THREE DIMENSIONAL VIRTUAL AND AUGMENTED REALITY DISPLAY SYSTEM

      
Application Number 16844464
Status Pending
Filing Date 2020-04-09
First Publication Date 2020-07-23
Owner Magic Leap, Inc. (USA)
Inventor Macnamara, John Graham

Abstract

A system may comprise a selectively transparent projection device for projecting an image toward an eye of a viewer from a projection device position in space relative to the eye of the viewer, the projection device being capable of assuming a substantially transparent state when no image is projected; an occlusion mask device coupled to the projection device and configured to selectively block light traveling toward the eye from one or more positions opposite of the projection device from the eye of the viewer in an occluding pattern correlated with the image projected by the projection device; and a zone plate diffraction patterning device interposed between the eye of the viewer and the projection device and configured to cause light from the projection device to pass through a diffraction pattern having a selectable geometry as it travels to the eye.

IPC Classes  ?

  • G02B 30/34 - Stereoscopes providing a stereoscopic pair of separated images corresponding to parallactically displaced views of the same object, e.g. 3D slide viewers
  • G03B 21/00 - Projectors or projection-type viewers; Accessories therefor
  • G02B 30/00 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
  • G02B 30/24 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer’s left and right eyes of the stereoscopic type involving temporal multiplexing, e.g. using sequentially activated left and right shutters
  • G02B 30/52 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images the image being built up from image elements distributed over a 3D volume, e.g. voxels the 3D volume being constructed from a stack or sequence of 2D planes, e.g. depth sampling systems
  • G02B 27/01 - Head-up displays
  • G02B 5/18 - Diffracting gratings
  • G03B 35/18 - Stereoscopic photography by simultaneous viewing

77.

ROOM LAYOUT ESTIMATION METHODS AND TECHNIQUES

      
Application Number 16844812
Status Pending
Filing Date 2020-04-09
First Publication Date 2020-07-23
Owner Magic Leap, Inc. (USA)
Inventor
  • Lee, Chen-Yu
  • Badrinarayanan, Vijay
  • Malisiewicz, Tomasz Jan
  • Rabinovich, Andrew

Abstract

Systems and methods for estimating a layout of a room are disclosed. The room layout can comprise the location of a floor, one or more walls, and a ceiling. In one aspect, a neural network can analyze an image of a portion of a room to determine the room layout. The neural network can comprise a convolutional neural network having an encoder sub-network, a decoder sub-network, and a side sub-network. The neural network can determine a three-dimensional room layout using two-dimensional ordered keypoints associated with a room type. The room layout can be used in applications such as augmented or mixed reality, robotics, autonomous indoor navigation, etc.

IPC Classes  ?

  • G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
  • G06N 3/04 - Architecture, e.g. interconnection topology
  • G06K 9/46 - Extraction of features or characteristics of the image
  • G06K 9/34 - Segmentation of touching or overlapping patterns in the image field
  • G06K 9/62 - Methods or arrangements for recognition using electronic means
  • G06N 3/08 - Learning methods

78.

SEMI-GLOBAL SHUTTER IMAGER

      
Application Number 16745763
Status Pending
Filing Date 2020-01-17
First Publication Date 2020-07-16
Owner Magic Leap, Inc. (USA)
Inventor Kaehler, Adrian

Abstract

This disclosure is directed to an image sensor. The image sensor includes a two-dimensional pixel array divided into a plurality of blocks, each of the plurality of blocks comprising pixels arranged in at least two different rows and two different columns, and a shutter mechanism that exposes the plurality of blocks sequentially, with all pixels in each block being exposed synchronously.

IPC Classes  ?

  • H04N 5/353 - Control of the integration time
  • H04N 5/378 - Readout circuits, e.g. correlated double sampling [CDS] circuits, output amplifiers or A/D converters
  • H04N 5/345 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled by partially reading an SSIS array

79.

LIGHT LEAKAGE DETECTION IN EDGE SEALANTS OF OPTICAL DEVICES

      
Application Number 16836579
Status Pending
Filing Date 2020-03-31
First Publication Date 2020-07-16
Owner Magic Leap, Inc. (USA)
Inventor
  • Yang, Ming
  • Xing, Wendong
  • Browy, Eric C.
  • Welch, William Hudson
  • Mercier, Thomas

Abstract

Techniques are described for inspecting optical devices, such as eyepieces, to determine whether they exhibit light leakage through an edge sealant that has been applied to the device. Embodiments provide an inspection apparatus that can be employed to detect the leakage of light through an edge sealant of an optical device, where the edge sealant is applied to prevent, or at least reduce, the leakage of light from the optical device. Light from a light source is projected into the optical device. The light can travel along one or more wave guides within the device, until reaching an edge of the device. Light that is able to leak through an edge sealant can be reflected, using mirror(s) in the apparatus, and detected by a camera. Image(s) captured by the camera can be analyzed to determine the performance of the optical device with respect to edge leakage.

IPC Classes  ?

80.

OUTCOUPLING GRATING FOR AUGMENTED REALITY SYSTEM

      
Application Number 16837839
Status Pending
Filing Date 2020-04-01
First Publication Date 2020-07-16
Owner Magic Leap, Inc. (USA)
Inventor
  • Tekolste, Robert D.
  • Liu, Victor K.

Abstract

An eyepiece for use in front of an eye of a viewer includes a waveguide configured to propagate light therein, and a diffractive optical element optically coupled to the waveguide. The diffractive optical element includes a plurality of first ridges protruding from a surface of the waveguide. Each of the plurality of first ridges has a first height and a first width. The diffractive optical element further includes a plurality of second ridges. Each of the plurality of second ridges protrudes from a respective first ridge and has a second height greater than the first height and a second width less than the first width. The diffractive optical element is configured to diffract a portion of a light beam incident on the diffractive optical element toward the eye as a first order transmission.

IPC Classes  ?

81.

PERIOCULAR AND AUDIO SYNTHESIS OF A FULL FACE IMAGE

      
Application Number 16721625
Status Pending
Filing Date 2019-12-19
First Publication Date 2020-07-16
Owner Magic Leap, Inc. (USA)
Inventor Kaehler, Adrian

Abstract

Systems and methods for synthesizing an image of the face by a head-mounted device (HMD) are disclosed. The HMD may not be able to observe a portion of the face. The systems and methods described herein can generate a mapping from a conformation of the portion of the face that is not imaged to a conformation of the portion of the face observed. The HMD can receive an image of a portion of the face and use the mapping to determine a conformation of the portion of the face that is not observed. The HMD can combine the observed and unobserved portions to synthesize a full face image.

IPC Classes  ?

  • G06T 17/20 - Wire-frame description, e.g. polygonalisation or tessellation
  • G10L 21/10 - Transforming into visible information
  • G06T 13/40 - 3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
  • G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
  • G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
  • G02B 27/01 - Head-up displays

82.

DYNAMIC DISPLAY CALIBRATION BASED ON EYE-TRACKING

      
Application Number 16744108
Status Pending
Filing Date 2020-01-15
First Publication Date 2020-07-16
Owner Magic Leap, Inc. (USA)
Inventor
  • Edwin, Lionel E.
  • Yeoh, Ivan L.
  • Miller, Samuel A.

Abstract

Examples of a light field metrology system for use with a display are disclosed. The light field metrology may capture images of a projected light field, and determine focus depths (or lateral focus positions) for various regions of the light field using the captured images. The determined focus depths (or lateral positions) may then be compared with intended focus depths (or lateral positions), to quantify the imperfections of the display. Based on the measured imperfections, an appropriate error correction may be performed on the light field to correct for the measured imperfections. The display can be an optical display element in a head mounted display, for example, an optical display element capable of generating multiple depth planes or a light field display.

IPC Classes  ?

  • G01B 11/14 - Measuring arrangements characterised by the use of optical means for measuring distance or clearance between spaced objects or spaced apertures
  • G01B 11/22 - Measuring arrangements characterised by the use of optical means for measuring depth
  • H04N 13/344 - Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
  • H04N 13/144 - Processing image signals for flicker reduction
  • H04N 13/327 - Calibration thereof
  • H04N 13/383 - Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
  • H04N 13/398 - Synchronisation thereof; Control thereof
  • G02B 27/01 - Head-up displays
  • G09G 3/00 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
  • G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06T 15/20 - Perspective computation
  • G06T 19/00 - Manipulating 3D models or images for computer graphics
  • G09G 5/02 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the way in which colour is displayed

83.

MASSIVE SIMULTANEOUS REMOTE DIGITAL PRESENCE WORLD

      
Application Number 16831659
Status Pending
Filing Date 2020-03-26
First Publication Date 2020-07-16
Owner Magic Leap, Inc. (USA)
Inventor Abovitz, Rony

Abstract

Various methods and apparatus are described herein for enabling one or more users to interface with virtual or augmented reality environments. An example system includes a computing network having computer servers interconnected through high bandwidth interfaces to gateways for processing data and/or for enabling communication of data between the servers and one or more local user interface devices. The servers include memory, processing circuitry, and software for designing and/or controlling virtual worlds, as well as for storing and processing user data and data provided by other components of the system. One or more virtual worlds may be presented to a user through a user device for the user to experience and interact. A large number of users may each use a device to simultaneously interface with one or more digital worlds by using the device to observe and interact with each other and with objects produced within the digital worlds.

IPC Classes  ?

  • G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer

84.

SYSTEMS AND METHODS FOR AUGMENTED REALITY

      
Application Number 16833093
Status Pending
Filing Date 2020-03-27
First Publication Date 2020-07-16
Owner Magic Leap, Inc. (USA)
Inventor
  • Woods, Michael Janusz
  • Rabinovich, Andrew

Abstract

Systems and methods for reducing error from noisy data received from a high frequency sensor by fusing received input with data received from a low frequency sensor by collecting a first set of dynamic inputs from the high frequency sensor, collecting a correction input point from the low frequency sensor, and adjusting a propagation path of a second set of dynamic inputs from the high frequency sensor based on the correction input point either by full translation to the correction input point or dampened approach towards the correction input point.

IPC Classes  ?

  • G06T 7/73 - Determining position or orientation of objects or cameras using feature-based methods
  • G06T 19/00 - Manipulating 3D models or images for computer graphics
  • G06T 7/277 - Analysis of motion involving stochastic approaches, e.g. using Kalman filters
  • G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F 3/0483 - Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance interaction with page-structured environments, e.g. book metaphor
  • G06F 3/0482 - Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance interaction with lists of selectable items, e.g. menus
  • G06F 3/0484 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object or an image, setting a parameter value or selecting a range
  • G06F 3/0481 - Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
  • G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

85.

TIME-MULTIPLEXED DISPLAY OF VIRTUAL CONTENT AT VARIOUS DEPTHS

      
Application Number US2020013130
Publication Number 2020/146760
Status In Force
Filing Date 2020-01-10
Publication Date 2020-07-16
Owner MAGIC LEAP, INC. (USA)
Inventor
  • Komanduri, Ravi Kumar
  • Edwin, Lionel Ernest
  • Oh, Chulwoo

Abstract

Techniques for operating an optical system are disclosed. World light may be linearly polarized along a first axis. When the optical system is operating in accordance with a first state, a polarization of the world light may be rotated by 90 degrees, the world light may be linearly polarized along a second axis perpendicular to the first axis, and zero net optical power may be applied to the world light. When the optical system is operating in accordance with a second state, virtual image light may be projected onto an eyepiece of the optical system, the world light and the virtual image light may be linearly polarized along the second axis, a polarization of the virtual image light may be rotated by 90 degrees, and non-zero net optical power may be applied to the virtual image light.

IPC Classes  ?

  • G02B 27/01 - Head-up displays
  • G02B 6/27 - Optical coupling means with polarisation selective and adjusting means
  • G06F 1/16 - Constructional details or arrangements
  • G06T 1/00 - General purpose image data processing

86.

AUTOMATIC PLACEMENT OF A VIRTUAL OBJECT IN A THREE-DIMENSIONAL SPACE

      
Application Number 16821653
Status Pending
Filing Date 2020-03-17
First Publication Date 2020-07-09
Owner Magic Leap, Inc. (USA)
Inventor
  • Hoover, Paul Armistead
  • Mann, Jonathan Lawrence

Abstract

Augmented reality systems and methods for automatically repositioning a virtual object with respect to a destination object in a three-dimensional (3D) environment of a user are disclosed. The systems and methods can automatically attach the target virtual object to the destination object and re-orient the target virtual object based on the affordances of the virtual object or the destination object. The systems and methods can also track the movement of a user and detach the virtual object from the destination object when the user's movement passes a threshold condition.

IPC Classes  ?

  • G02B 27/01 - Head-up displays
  • G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06T 19/00 - Manipulating 3D models or images for computer graphics
  • H04N 13/156 - Mixing image signals
  • H04N 13/279 - Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals the virtual viewpoint locations being selected by the viewers or determined by tracking
  • H04N 13/344 - Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
  • H04N 13/239 - Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
  • G06F 3/0481 - Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
  • H04N 13/395 - Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume with depth sampling, i.e. the volume being constructed from a stack or sequence of 2D image planes
  • G02B 30/34 - Stereoscopes providing a stereoscopic pair of separated images corresponding to parallactically displaced views of the same object, e.g. 3D slide viewers

87.

PROJECTOR ARCHITECTURE INCORPORATING ARTIFACT MITIGATION

      
Application Number 16798236
Status Pending
Filing Date 2020-02-21
First Publication Date 2020-07-02
Owner Magic Leap, Inc. (USA)
Inventor
  • Curtis, Kevin
  • Cheng, Hui-Chuan
  • Greco, Paul M.
  • Welch, William Hudson
  • Browy, Eric C.
  • Schuck, Miller
  • Sissom, Bradley Jay

Abstract

An artifact mitigation system includes a projector assembly and a set of imaging optics optically coupled to the projector assembly. The artifact mitigation system also includes an eyepiece optically coupled to the set of imaging optics. The eyepiece includes a diffractive incoupling interface. The artifact mitigation system further includes an artifact prevention element disposed between the set of imaging optics and the eyepiece. The artifact prevention element includes a linear polarizer, a first quarter waveplate disposed adjacent the linear polarizer, and a color select component disposed adjacent the first quarter waveplate.

IPC Classes  ?

  • F21V 8/00 - Use of light guides, e.g. fibre optic devices, in lighting devices or systems
  • G02B 5/18 - Diffracting gratings
  • H05K 7/20 - Modifications to facilitate cooling, ventilating, or heating
  • G09G 3/00 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
  • G06F 1/20 - Cooling means
  • G06F 1/16 - Constructional details or arrangements
  • G02C 11/00 - Non-optical adjuncts; Attachment thereof
  • G02C 5/16 - Side-members resilient or with resilient parts
  • G02B 27/01 - Head-up displays
  • H04N 9/31 - Projection devices for colour picture display
  • G02B 27/10 - Beam splitting or combining systems
  • G02B 27/28 - Optical systems or apparatus not provided for by any of the groups , for polarising
  • G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
  • G02B 5/30 - Polarising elements
  • G09G 3/20 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix
  • G06F 3/147 - Digital output to display device using display panels
  • G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
  • G02B 7/00 - Mountings, adjusting means, or light-tight connections, for optical elements

88.

DIRECT LIGHT COMPENSATION TECHNIQUE FOR AUGMENTED REALITY SYSTEM

      
Application Number 16812343
Status Pending
Filing Date 2020-03-08
First Publication Date 2020-07-02
Owner MAGIC LEAP, INC. (USA)
Inventor Kass, Michael

Abstract

An augmented reality system and method of operating the same is provided. An end user is allowed to visualize direct light from a three-dimensional scene in an ambient environment, generating virtual image data from the point of the view of the end user. A region of spatial overlap between a real object in the three-dimensional scene and a virtual object in the virtual image data is determined. Color characteristics of the real object in the overlap region are determined. A perceived contrast between the real object and the virtual object in the overlap region is decreased based on the determined color characteristics of the real object in the overlap region. The virtual image data is displayed as a virtual image after the perceived contrast between the real object and the virtual object has been decreased that, along with the visualized direct light, creates a three-dimensional augmented scene.

IPC Classes  ?

  • G06T 15/50 - Lighting effects
  • G06T 19/00 - Manipulating 3D models or images for computer graphics
  • G06T 11/00 - 2D [Two Dimensional] image generation
  • G06T 19/20 - Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts

89.

RECOGNIZING OBJECTS IN A PASSABLE WORLD MODEL IN AUGMENTED OR VIRTUAL REALITY SYSTEMS

      
Application Number 16813671
Status Pending
Filing Date 2020-03-09
First Publication Date 2020-07-02
Owner Magic Leap, Inc. (USA)
Inventor
  • Miller, Samuel A.
  • Abovitz, Rony

Abstract

One embodiment is directed to a system for enabling two or more users to interact within a virtual world comprising virtual world data, comprising a computer network comprising one or more computing devices, the one or more computing devices comprising memory, processing circuitry, and software stored at least in part in the memory and executable by the processing circuitry to process at least a portion of the virtual world data; wherein at least a first portion of the virtual world data originates from a first user virtual world local to a first user, and wherein the computer network is operable to transmit the first portion to a user device for presentation to a second user, such that the second user may experience the first portion from the location of the second user, such that aspects of the first user virtual world are effectively passed to the second user.

IPC Classes  ?

  • G06T 19/00 - Manipulating 3D models or images for computer graphics
  • G02B 27/01 - Head-up displays
  • G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06T 7/73 - Determining position or orientation of objects or cameras using feature-based methods
  • G06T 1/20 - Processor architectures; Processor configuration, e.g. pipelining
  • G09G 5/00 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
  • G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
  • H04L 29/06 - Communication control; Communication processing characterised by a protocol
  • G06K 9/46 - Extraction of features or characteristics of the image
  • H04L 29/08 - Transmission control procedure, e.g. data link level control procedure
  • G06K 9/38 - Quantising the analogue image signal

90.

VIRTUAL AND AUGMENTED REALITY DISPLAY SYSTEMS WITH EMISSIVE MICRO-DISPLAYS

      
Application Number US2019067824
Publication Number 2020/139755
Status In Force
Filing Date 2019-12-20
Publication Date 2020-07-02
Owner MAGIC LEAP, INC. (USA)
Inventor
  • Klug, Michael, Anthony
  • Poliakov, Evgeni
  • Trisnadi, Jahja, I.
  • Chung, Hyunsun
  • Edwin, Lionel, Ernest
  • Cohen, Howard, Russell
  • Taylor, Robert, Blake
  • Russell, Andrew, Ian
  • Curtis, Kevin, Richard
  • Carlisle, Clinton

Abstract

A wearable display system includes one or more emissive micro-displays, e.g., micro-LED displays. The micro-displays may be monochrome micro-displays or full-color micro-displays. The micro-displays may include arrays of light emitters. Light collimators may be utilized to narrow the angular emission profile of light emitted by the light emitters. Where a plurality of emissive micro-displays is utilized, the micro-displays may be positioned at different sides of an optical combiner, e.g., an X-cube prism which receives light rays from different micro-displays and outputs the light rays from the same face of the cube. The optical combiner directs the light to projection optics, which outputs the light to an eyepiece that relays the light to a user's eye. The eyepiece may output the light to the user's eye with different amounts of wavefront divergence, to place virtual content on different depth planes.

IPC Classes  ?

  • G02B 6/34 - Optical coupling means utilising prism or grating
  • G02B 6/26 - Optical coupling means
  • G02B 6/293 - Optical coupling means having data bus means, i.e. plural waveguides interconnected and providing an inherently bidirectional system by mixing and splitting signals with wavelength selective means
  • G02B 6/32 - Optical coupling means having lens focusing means
  • G02B 27/18 - Optical systems or apparatus not provided for by any of the groups , for optical projection, e.g. combination of mirror and condenser and objective
  • G02B 27/40 - Optical focusing aids

91.

LOW MOTION-TO-PHOTON LATENCY ARCHITECTURE FOR AUGMENTED AND VIRTUAL REALITY DISPLAY SYSTEMS

      
Application Number US2019067841
Publication Number 2020/139758
Status In Force
Filing Date 2019-12-20
Publication Date 2020-07-02
Owner MAGIC LEAP, INC. (USA)
Inventor
  • Edwin, Lionel Ernest
  • Russell, Andrew Ian
  • Cohen, Howard Russell

Abstract

Systems and methods are disclosed for low motion-to-photon latency for augmented and virtual reality systems. Some systems generate rendered frames that are presented to a user by outputting light from a head-mounted display unit. The rendered frames are perceived by the user as virtual content. The head-mounted display unit includes an orientation sensor, a display configured to output light to the user, and processors. The processors receive a rendered frame of virtual content, obtain orientation information from the orientation sensor, and warp or modify the rendered frame of virtual content based on changes to the orientation of the user's head. The warped rendered frame is subsequently outputted from the display using modulated light. The processors and the orientation sensor may be part of a spatial light modulator for modulating the light used to present the warped rendered frame. In addition, the spatial light modulator may be a LED array having low persistence and a high duty cycle.

IPC Classes  ?

  • A63F 13/90 - Constructional details or arrangements of video game devices not provided for in groups  or , e.g. housing, wiring, connections or cabinets

92.

SYSTEMS AND METHODS FOR VIRTUAL AND AUGMENTED REALITY

      
Application Number 16729192
Status Pending
Filing Date 2019-12-27
First Publication Date 2020-07-02
Owner Magic Leap, Inc. (USA)
Inventor Browy, Eric C.

Abstract

Disclosed herein are systems and methods for distributed computing and/or networking for mixed reality systems. A method may include capturing an image via a camera of a head-wearable device. Inertial data may be captured via an inertial measurement unit of the head-wearable device. A position of the head-wearable device can be estimated based on the image and the inertial data via one or more processors of the head-wearable device. The image can be transmitted to a remote server. A neural network can be trained based on the image via the remote server. A trained neural network can be transmitted to the head-wearable device.

IPC Classes  ?

  • G06F 3/14 - Digital output to display device
  • G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06K 9/62 - Methods or arrangements for recognition using electronic means
  • H04B 7/155 - Ground-based stations

93.

LOW-PROFILE BEAM SPLITTER

      
Application Number 16737728
Status Pending
Filing Date 2020-01-08
First Publication Date 2020-07-02
Owner Magic Leap, Inc. (USA)
Inventor
  • Trisnadi, Jahja
  • St. Hilaire, Pierre
  • Cheng, Hui-Chuan
  • Carlisle, Clinton
  • Klug, Michael Anthony
  • Curtis, Kevin Richard

Abstract

Examples of light projector systems for directing input light from a light source to a spatial light modulator are provided. For example, an optical device is disclosed which includes a first surface having a diffractive optical element, a second surface normal to the first surface, and a third surface arranged at an angle to the second surface. The third surface may be a beam splitting surface that is reflective to light of a first state and transmissive to light of a second state. The diffractive optical element may receive an input beam made up of light having the first state, and may convert the input beam into at least a first diffracted beam at a first diffraction angle such that the first diffracted beam is directed toward the second surface, is reflected by the second surface toward the third surface via total internal reflection, and is reflected by the third surface in a direction substantially parallel to the first surface.

IPC Classes  ?

  • G03B 21/20 - Lamp housings
  • G02B 27/09 - Beam shaping, e.g. changing the cross-sectioned area, not otherwise provided for
  • G03B 21/00 - Projectors or projection-type viewers; Accessories therefor
  • G02B 27/10 - Beam splitting or combining systems
  • G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
  • G02B 26/10 - Scanning systems
  • G02B 27/01 - Head-up displays

94.

VARIABLE PIXEL DENSITY DISPLAY SYSTEM WITH MECHANICALLY-ACTUATED IMAGE PROJECTOR

      
Application Number US2019067816
Publication Number 2020/139752
Status In Force
Filing Date 2019-12-20
Publication Date 2020-07-02
Owner MAGIC LEAP, INC. (USA)
Inventor
  • Trisnadi, Jahja I.
  • Carlisle, Clinton
  • Chung, Hyunsun
  • Dalrymple, Timothy Mark

Abstract

Head-mounted virtual and augmented reality display systems include a light projector with one or more emissive micro-displays having a first resolution and a pixel pitch. The projector outputs light forming frames of virtual content having at least a portion associated with a second resolution greater than the first resolution. The projector outputs light forming a first subframe of the rendered frame at the first resolution, and parts of the projector are shifted using actuators, such that physical positions of light output for individual pixels occupy gaps between the old locations of light output for individual pixels. The projector then outputs light forming a second subframe of the rendered frame. The first and second subframes are outputted within the flicker fusion threshold. Advantageously, an emissive micro-display (e.g., micro-LED display) having a low resolution can form a frame having a higher resolution by using the same light emitters to function as multiple pixels of that frame.

IPC Classes  ?

  • G02B 27/18 - Optical systems or apparatus not provided for by any of the groups , for optical projection, e.g. combination of mirror and condenser and objective
  • G02B 27/22 - Other optical systems; Other optical apparatus for producing stereoscopic or other three-dimensional effects
  • G02B 27/62 - Optical apparatus specially adapted for adjusting optical elements during the assembly of optical systems

95.

AUGMENTED AND VIRTUAL REALITY DISPLAY SYSTEMS WITH SHARED DISPLAY FOR LEFT AND RIGHT EYES

      
Application Number US2019067823
Publication Number 2020/139754
Status In Force
Filing Date 2019-12-20
Publication Date 2020-07-02
Owner MAGIC LEAP, INC. (USA)
Inventor
  • Trisnadi, Jahja I.
  • Chung, Hyunsun
  • Edwin, Lionel Ernest
  • Cohen, Howard Russell
  • Taylor, Robert Blake
  • Russell, Andrew Ian
  • Curtis, Kevin Richard
  • Carlisle, Clinton

Abstract

A wearable display system includes a light projection system having one or more emissive microdisplays, e.g., micro-LED displays. The light projection system projects time-multiplexed left-eye and right-eye images, which pass through an optical router having a polarizer and a switchable polarization rotator. The optical router is synchronized with the generation of images by the light projection system to impart a first polarization to left-eye images and a second different polarization to right-eye images. Light of the first polarization is incoupled into an eyepiece having one or more waveguides for outputting light to one of the left and right eyes, while light of the second polarization may be incoupled into another eyepiece having one or more waveguides for outputting light to the other of the left and right eyes. Each eyepiece may output incoupled light with variable amounts of wavefront divergence, to elicit different accommodation responses from the user's eyes.

IPC Classes  ?

  • H04N 13/344 - Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
  • G02B 27/10 - Beam splitting or combining systems
  • G02B 27/18 - Optical systems or apparatus not provided for by any of the groups , for optical projection, e.g. combination of mirror and condenser and objective
  • G02B 30/60 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images involving reflecting prisms and mirrors only
  • H04N 13/332 - Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
  • H04N 13/341 - Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using temporal multiplexing

96.

SYSTEMS AND METHODS FOR VIRTUAL AND AUGMENTED REALITY

      
Application Number US2019068812
Publication Number 2020/140078
Status In Force
Filing Date 2019-12-27
Publication Date 2020-07-02
Owner MAGIC LEAP, INC. (USA)
Inventor Browy, Eric C.

Abstract

Disclosed herein are systems and methods for distributed computing and/or networking for mixed reality systems. A method may include capturing an image via a camera of a head-wearable device. Inertial data may be captured via an inertial measurement unit of the head-wearable device. A position of the head-wearable device can be estimated based on the image and the inertial data via one or more processors of the head-wearable device. The image can be transmitted to a remote server. A neural network can be trained based on the image via the remote server. A trained neural network can be transmitted to the head-wearable device.

IPC Classes  ?

  • G05D 1/02 - Control of position or course in two dimensions
  • G05D 1/04 - Control of altitude or depth
  • G05D 1/10 - Simultaneous control of position or course in three dimensions
  • G06K 9/60 - Combination of image acquisition and preprocessing functions
  • G06K 9/62 - Methods or arrangements for recognition using electronic means
  • G06K 9/64 - Methods or arrangements for recognition using electronic means using simultaneous comparisons or correlations of the image signals with a plurality of references, e.g. resistor matrix
  • G06K 9/66 - Methods or arrangements for recognition using electronic means using simultaneous comparisons or correlations of the image signals with a plurality of references, e.g. resistor matrix references adjustable by an adaptive method, e.g. learning

97.

Display panel or portion thereof with a transitional graphical user interface

      
Application Number 29657585
Grant Number D0888761
Status In Force
Filing Date 2018-07-24
First Publication Date 2020-06-30
Grant Date 2020-06-30
Owner Magic Leap, Inc. (USA)
Inventor
  • Pazmino, Lorena
  • Tran, Gregory Minh
  • Meaney, Brian Everett
  • Powderly, James M.
  • Adams, William
  • Bradley, Ian Michener

98.

EYEPIECE ARCHITECTURE INCORPORATING ARTIFACT MITIGATION

      
Application Number 16718017
Status Pending
Filing Date 2019-12-17
First Publication Date 2020-06-25
Owner Magic Leap, Inc. (USA)
Inventor
  • Curtis, Kevin Richard
  • Bhargava, Samarth
  • Sissom, Bradley Jay
  • Liu, Victor Kai
  • Oh, Chulwoo
  • Komanduri, Ravi Kumar
  • Messer, Kevin

Abstract

Techniques for artifact mitigation in an optical system are disclosed. Light associated with a world object is received at the optical system, which is characterized by a world side and a user side. Light associated with a virtual image is projected onto an eyepiece of the optical system, causing a portion of the light associated with the virtual image to propagate toward the user side and light associated with an artifact image to propagate toward the world side. A dimmer of the optical system positioned between the world side and the eyepiece is adjusted to reduce an intensity of the light associated with the artifact image impinging on the dimmer and an intensity of the light associated with the world object impinging on the dimmer.

IPC Classes  ?

  • G02B 26/08 - Optical devices or arrangements using movable or deformable optical elements for controlling the intensity, colour, phase, polarisation or direction of light, e.g. switching, gating or modulating for controlling the direction of light
  • G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
  • G02B 27/42 - Diffraction optics

99.

DEVICES, METHODS AND SYSTEMS FOR BIOMETRIC USER RECOGNITION UTILIZING NEURAL NETWORKS

      
Application Number 16804608
Status Pending
Filing Date 2020-02-28
First Publication Date 2020-06-25
Owner MAGIC LEAP, INC. (USA)
Inventor Bradski, Gary R.

Abstract

A user identification system includes an image recognition network to analyze image data and generate shape data based on the image data. The system also includes a generalist network to analyze the shape data and generate general category data based on the shape data. The system further includes a specialist network to compare the general category data with a characteristic to generate narrow category data. Moreover, the system includes a classifier layer including a plurality of nodes to represent a classification decision based on the narrow category data.

IPC Classes  ?

  • G06T 7/62 - Analysis of geometric attributes of area, perimeter, diameter or volume
  • G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
  • G06K 9/46 - Extraction of features or characteristics of the image

100.

FIXED-DISTANCE VIRTUAL AND AUGMENTED REALITY SYSTEMS AND METHODS

      
Application Number 16809346
Status Pending
Filing Date 2020-03-04
First Publication Date 2020-06-25
Owner Magic Leap, Inc. (USA)
Inventor
  • Miller, Samuel A.
  • Welch, William Hudson

Abstract

A fixed-distance display system includes a light source configured to generate a light beam. The system also includes a light guiding optical element configured to propagate at least a portion of the light beam by total internal reflection. The system further includes a first inertial measurement unit configured to measure a first value for calculating a head pose of a user. Moreover, the system includes a camera configured to capture an image for machine vision optical flow analysis. The display system is configured to display virtual images only within a tolerance range of a single predetermined optical plane.

IPC Classes  ?

  • G02B 27/01 - Head-up displays
  • G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
  1     2     3     ...     17        Next Page