Introduced here are computer programs and associated computer-implemented techniques for determining range of an object using a single camera. Specifically, an approach to utilizing a computing device to capture range-related information from an object (also called a “target”) using illumination parallax and spectral analysis of corresponding images is disclosed herein. To achieve illumination parallax, a series of illumination events may be performed in sequence, such that the target is sequentially illuminated with different ranges of electromagnetic radiation. Information regarding the target can be computed, inferred, or otherwise determined through analysis of images captured in conjunction with the illumination events.
Introduced here are computer programs and associated computer-implemented techniques for determining reflectance of an image on a per-pixel basis. More specifically, a characterization module can initially acquire a first data set generated by a multi-channel light source and a second data set generated by a multi-channel image sensor. The first data set may specify the illuminance of each channel of the multi-channel light source (which may be able to produce visible light and/or non-visible light), while the second data set may specify the response of each sensor channel of the multi-channel image sensor (which is configured to capture an image in conjunction with the light). Thus, the characterization module may determine reflectance based on illuminance and sensor response. The characterization module may also be configured to determine illuminance based on reflectance and sensor response, or determine sensor response based on illuminance and reflectance.
H04N 5/341 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled
Introduced here are light sources for flash photography configured to produce high-fidelity white light that is tunable over a broader range of correlated color temperatures (CCTs) than conventional flash technologies. The light source can include multiple independently controllable color channels representing illuminants (e.g., light-emitting diodes) of different colors with varying degrees of saturation. Operating collectively, the multiple color channels can produce a high spectral quality white light corresponding to different CCTs (e.g., “warm” white light having a red hue, “cool” white light having a blue hue). Operating independently, these same color channels can be pre-flashed in a variety of prescribed sequences to probe the spectral characteristics of a scene, thereby allowing for an enhanced, spectrally matched white flash as well as collecting per-pixel reflectivity data that can be later used in during post processing of the captured image.
H05B 47/125 - Controlling the light source in response to determined parameters by determining the presence or movement of objects or living beings by using cameras
H04N 25/40 - Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
G06V 30/194 - References adjustable by an adaptive method, e.g. learning
Introduced here are computer programs and associated computer-implemented techniques for determining range of an object using a single camera. Specifically, an approach to utilizing a computing device to capture range-related information from an object (also called a "target") using illumination parallax and spectral analysis of corresponding images is disclosed herein. To achieve illumination parallax, a series of illumination events may be performed in sequence, such that the target is sequentially illuminated with different ranges of electromagnetic radiation. Information regarding the target can be computed, inferred, or otherwise determined through analysis of images captured in conjunction with the illumination events.
G01S 17/06 - Systems determining position data of a target
G01C 3/32 - Measuring distances in line of sight; Optical rangefinders by focusing the object, e.g. on a ground glass screen
G01C 3/30 - Measuring distances in line of sight; Optical rangefinders using a parallactic triangle with fixed angles and a base of variable length at, near, or formed by, the object with provision for reduction of the distance into the horizontal plane with adaptation to the measurement of the height of an object, e.g. tacheometers
G01C 3/28 - Measuring distances in line of sight; Optical rangefinders using a parallactic triangle with fixed angles and a base of variable length at, near, or formed by, the object with provision for reduction of the distance into the horizontal plane
G01C 3/26 - Measuring distances in line of sight; Optical rangefinders using a parallactic triangle with fixed angles and a base of variable length at, near, or formed by, the object
G01C 3/24 - Measuring distances in line of sight; Optical rangefinders using a parallactic triangle with fixed angles and a base of variable length in the observation station, e.g. in the instrument
G01C 3/22 - Measuring distances in line of sight; Optical rangefinders using a parallactic triangle with variable angles and a base of fixed length at, near, or formed by, the object
G01C 3/20 - Measuring distances in line of sight; Optical rangefinders using a parallactic triangle with variable angles and a base of fixed length in the observation station, e.g. in the instrument with adaptation to the measurement of the height of an object
G01C 3/18 - Measuring distances in line of sight; Optical rangefinders using a parallactic triangle with variable angles and a base of fixed length in the observation station, e.g. in the instrument with one observation point at each end of the base
5.
Electromagnetic emitters and detectors for electronic devices
Introduced here are multi-channel light sources able to produce a broad range of electromagnetic radiation. A multi-channel light source (also referred to as a “multi-channel emitter”) can be designed to produce visible light and/or non-visible light. For example, some embodiments of the multi-channel light source include illuminant(s) capable of emitting electromagnetic radiation within the visible range and illuminant(s) capable of emitting electromagnetic radiation in a non-visible range, such as the ultraviolet range or infrared range. By capturing images in conjunction with the visible and non-visible light, additional information on the ambient scene can be gleaned which may be useful, for example, during post-processing.
H04N 25/40 - Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
Introduced here are computer programs and associated computer-implemented techniques for achieving high-fidelity color reproduction in the absence of any known reflectance spectrums. That is, high-fidelity color reproduction can be achieved without portable references, such as gray cards and color checkers. To accomplish this, a new reference spectrum—the “reference illuminant spectrum”—is introduced into scenes to be imaged by image sensors. The reference illuminant spectrum is created by a multi-channel light source whose spectral properties are known.
H04N 23/88 - Camera processing pipelines; Components thereof for processing colour signals for colour balance, e.g. white-balance circuits or colour temperature control
H04N 23/10 - Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
H04N 23/56 - Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
Introduced here are computer programs and associated computer-implemented techniques for determining reflectance of an image on a per-pixel basis. More specifically, a characterization module can initially acquire a first data set generated by a multi-channel light source and a second data set generated by a multi-channel image sensor. The first data set may specify the illuminance of each color channel of the multi-channel light source (which is configured to produce a flash), while the second data set may specify the response of each sensor channel of the multi-channel image sensor (which is configured to capture an image in conjunction with the flash). Thus, the characterization module may determine reflectance based on illuminance and sensor response. The characterization module may also be configured to determine illuminance based on reflectance and sensor response, or determine sensor response based on illuminance and reflectance.
G06T 7/90 - Determination of colour characteristics
G03B 15/05 - Combinations of cameras with electronic flash apparatus; Electronic flash units
H04N 5/341 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled
H05B 47/125 - Controlling the light source in response to determined parameters by determining the presence or movement of objects or living beings by using cameras
G06V 10/56 - Extraction of image or video features relating to colour
Introduced here are light sources for flash photography configured to produce high-fidelity white light that is tunable over a broader range of correlated color temperatures (CCTs) than conventional flash technologies. The light source can include multiple independently controllable color channels representing illuminants (e.g., light-emitting diodes) of different colors with varying degrees of saturation. Operating collectively, the multiple color channels can produce a high spectral quality white light corresponding to different CCTs (e.g., “warm” white light having a red hue, “cool” white light having a blue hue). Operating independently, these same color channels can be pre-flashed in a variety of prescribed sequences to probe the spectral characteristics of a scene, thereby allowing for an enhanced, spectrally matched white flash as well as collecting per-pixel reflectivity data that can be later used in during post processing of the captured image.
H05B 47/125 - Controlling the light source in response to determined parameters by determining the presence or movement of objects or living beings by using cameras
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
H04N 5/341 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled
G06K 9/66 - Methods or arrangements for recognition using electronic means using simultaneous comparisons or correlations of the image signals with a plurality of references, e.g. resistor matrix references adjustable by an adaptive method, e.g. learning
Introduced here are computer programs and associated computer-implemented techniques for achieving high-fidelity color reproduction in the absence of any known reflectance spectrums. That is, high-fidelity color reproduction can be achieved without portable references, such as gray cards and color checkers. To accomplish this, a new reference spectrum - the "reference illuminant spectrum" - is introduced into scenes to be imaged by image sensors. The reference illuminant spectrum is created by a multi-channel light source whose spectral properties are known.
H04N 23/88 - Camera processing pipelines; Components thereof for processing colour signals for colour balance, e.g. white-balance circuits or colour temperature control
G06T 7/90 - Determination of colour characteristics
Introduced here are computer programs and associated computer-implemented techniques for achieving high-fidelity color reproduction in the absence of any known reflectance spectrums. That is, high-fidelity color reproduction can be achieved without portable references, such as gray cards and color checkers. To accomplish this, a new reference spectrum - the "reference illuminant spectrum" - is introduced into scenes to be imaged by image sensors. The reference illuminant spectrum is created by a multi-channel light source whose spectral properties are known.
Introduced here are computer programs and associated computer-implemented techniques for determining reflectance of an image on a per-pixel basis. More specifically, a characterization module can initially acquire a first data set generated by a multi-channel light source and a second data set generated by a multi-channel image sensor. The first data set may specify the illuminance of each channel of the multi-channel light source (which may be able to produce visible light and/or non-visible light), while the second data set may specify the response of each sensor channel of the multi-channel image sensor (which is configured to capture an image in conjunction with the light). Thus, the characterization module may determine reflectance based on illuminance and sensor response. The characterization module may also be configured to determine illuminance based on reflectance and sensor response, or determine sensor response based on illuminance and reflectance.
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
H04N 5/232 - Devices for controlling television cameras, e.g. remote control
G03B 43/00 - Testing correct operation of photographic apparatus or parts thereof
G03B 15/05 - Combinations of cameras with electronic flash apparatus; Electronic flash units
H04N 5/341 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled
Introduced here are multi-channel light sources able to produce a broad range of electromagnetic radiation. A multi-channel light source (also referred to as a “multi-channel emitter”) can be designed to produce visible light and/or non-visible light. For example, some embodiments of the multi-channel light source include illuminant(s) capable of emitting electromagnetic radiation within the visible range and illuminant(s) capable of emitting electromagnetic radiation in a non-visible range, such as the ultraviolet range or infrared range. By capturing images in conjunction with the visible and non-visible light, additional information on the ambient scene can be gleaned which may be useful, for example, during post-processing.
G03B 43/00 - Testing correct operation of photographic apparatus or parts thereof
G03B 15/05 - Combinations of cameras with electronic flash apparatus; Electronic flash units
G06K 9/66 - Methods or arrangements for recognition using electronic means using simultaneous comparisons or correlations of the image signals with a plurality of references, e.g. resistor matrix references adjustable by an adaptive method, e.g. learning
H04N 5/341 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled
13.
Techniques for creating characterization matrices for reflectance, illuminance, or sensor response
Introduced here are computer programs and associated computer-implemented techniques for determining reflectance of an image on a per-pixel basis. More specifically, a characterization module can initially acquire a first data set generated by a multi-channel light source and a second data set generated by a multi-channel image sensor. The first data set may specify the illuminance of each color channel of the multi-channel light source (which is configured to produce a flash), while the second data set may specify the response of each sensor channel of the multi-channel image sensor (which is configured to capture an image in conjunction with the flash). Thus, the characterization module may determine reflectance based on illuminance and sensor response. The characterization module may also be configured to determine illuminance based on reflectance and sensor response, or determine sensor response based on illuminance and reflectance.
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
H04N 5/341 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled
G06K 9/66 - Methods or arrangements for recognition using electronic means using simultaneous comparisons or correlations of the image signals with a plurality of references, e.g. resistor matrix references adjustable by an adaptive method, e.g. learning
G03B 43/00 - Testing correct operation of photographic apparatus or parts thereof
Introduced here are light sources for flash photography configured to produce high-fidelity white light that is tunable over a broader range of correlated color temperatures (CCTs) than conventional flash technologies. The light source can include multiple independently controllable color channels representing illuminants (e.g., light-emitting diodes) of different colors with varying degrees of saturation. Operating collectively, the multiple color channels can produce a high spectral quality white light corresponding to different CCTs (e.g., “warm” white light having a red hue, “cool” white light having a blue hue). Operating independently, these same color channels can be pre-flashed in a variety of prescribed sequences to probe the spectral characteristics of a scene, thereby allowing for an enhanced, spectrally matched white flash as well as collecting per-pixel reflectivity data that can be later used in during post processing of the captured image.
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
H04N 5/341 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled
G06K 9/66 - Methods or arrangements for recognition using electronic means using simultaneous comparisons or correlations of the image signals with a plurality of references, e.g. resistor matrix references adjustable by an adaptive method, e.g. learning
G03B 43/00 - Testing correct operation of photographic apparatus or parts thereof
42 - Scientific, technological and industrial services, research and design
Goods & Services
Online Software as a Service (SaaS) for manipulating, improving, providing and supporting color tone, white balance, color transformations, environmental contrast, and brightness adaptation; providing online Software as a Service (SaaS) for using visual image technology to automatically adjust color tone, white balance, and lighting; image processing services, namely, processing of digital information representing images, in the field of converting, interpreting, processing, or transporting color information in video image records and still image records; none of the foregoing for use in connection with home or vehicle monitoring goods or services; none of the foregoing for use in connection with home, vehicle, or personal security goods or services; none of the aforesaid services in connection to music and/or music-related services.
42 - Scientific, technological and industrial services, research and design
Goods & Services
Providing online Software as a Service (SaaS) for manipulating, improving, providing and supporting color tone, white balance, color transformations, environmental contrast, and brightness adaptation; providing online Software as a Service (SaaS) for using visual image technology to automatically adjust color tone, white balance, and lighting; image processing services, namely, processing of digital information representing images, in the field of converting, interpreting, processing, or transporting color information in video image records and still image records; none of the foregoing for use in connection with home or vehicle monitoring goods or services; none of the foregoing for use in connection with home, vehicle, or personal security goods or services; none of the aforesaid services in connection to music and/or music-related services
Introduced here are light sources for flash photography configured to produce high-fidelity white light that is tunable over a broader range of correlated color temperatures (CCTs) than conventional flash technologies. The light source can include multiple independently controllable color channels representing illuminants (e.g., light-emitting diodes) of different colors with varying degrees of saturation. Operating collectively, the multiple color channels can produce a high spectral quality white light corresponding to different CCTs (e.g., “warm” white light having a red hue, “cool” white light having a blue hue). Operating independently, these same color channels can be pre-flashed in a variety of prescribed sequences to probe the spectral characteristics of a scene, thereby allowing for an enhanced, spectrally matched white flash as well as collecting per-pixel reflectivity data that can be later used in during post processing of the captured image.
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
H04N 5/341 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled
G06K 9/66 - Methods or arrangements for recognition using electronic means using simultaneous comparisons or correlations of the image signals with a plurality of references, e.g. resistor matrix references adjustable by an adaptive method, e.g. learning
G03B 15/05 - Combinations of cameras with electronic flash apparatus; Electronic flash units
H05B 33/08 - Circuit arrangements for operating electroluminescent light sources
18.
Techniques for creating characterization matrices for reflectance, illuminance, or sensor response
Introduced here are computer programs and associated computer-implemented techniques for determining reflectance of an image on a per-pixel basis. More specifically, a characterization module can initially acquire a first data set generated by a multi-channel light source and a second data set generated by a multi-channel image sensor. The first data set may specify the illuminance of each color channel of the multi-channel light source (which is configured to produce a flash), while the second data set may specify the response of each sensor channel of the multi-channel image sensor (which is configured to capture an image in conjunction with the flash). Thus, the characterization module may determine reflectance based on illuminance and sensor response. The characterization module may also be configured to determine illuminance based on reflectance and sensor response, or determine sensor response based on illuminance and reflectance.
G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
H04N 5/341 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled
G06K 9/66 - Methods or arrangements for recognition using electronic means using simultaneous comparisons or correlations of the image signals with a plurality of references, e.g. resistor matrix references adjustable by an adaptive method, e.g. learning
