Abstract

Introduced here are computer programs and associated computer-implemented techniques for determining range of an object using a single camera. Specifically, an approach to utilizing a computing device to capture range-related information from an object (also called a “target”) using illumination parallax and spectral analysis of corresponding images is disclosed herein. To achieve illumination parallax, a series of illumination events may be performed in sequence, such that the target is sequentially illuminated with different ranges of electromagnetic radiation. Information regarding the target can be computed, inferred, or otherwise determined through analysis of images captured in conjunction with the illumination events.

IPC Classes  ?

• G01J 3/51 - Measurement of colour; Colour measuring devices, e.g. colorimeters using electric radiation detectors using colour filters
• G01J 3/28 - Investigating the spectrum
• G01J 3/10 - Arrangements of light sources specially adapted for spectrometry or colorimetry

Abstract

Introduced here are computer programs and associated computer-implemented techniques for determining reflectance of an image on a per-pixel basis. More specifically, a characterization module can initially acquire a first data set generated by a multi-channel light source and a second data set generated by a multi-channel image sensor. The first data set may specify the illuminance of each channel of the multi-channel light source (which may be able to produce visible light and/or non-visible light), while the second data set may specify the response of each sensor channel of the multi-channel image sensor (which is configured to capture an image in conjunction with the light). Thus, the characterization module may determine reflectance based on illuminance and sensor response. The characterization module may also be configured to determine illuminance based on reflectance and sensor response, or determine sensor response based on illuminance and reflectance.

IPC Classes  ?

• G01J 3/28 - Investigating the spectrum
• G06V 40/13 - Sensors therefor
• G06T 7/90 - Determination of colour characteristics
• H04N 9/04 - Picture signal generators
• G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
• H04N 5/232 - Devices for controlling television cameras, e.g. remote control
• G03B 43/00 - Testing correct operation of photographic apparatus or parts thereof
• G03B 15/05 - Combinations of cameras with electronic flash apparatus; Electronic flash units
• H04N 5/225 - Television cameras
• H04N 5/341 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled
• H05B 45/20 - Controlling the colour of the light
• G06V 10/56 - Extraction of image or video features relating to colour
• G06V 10/141 - Control of illumination
• G06V 30/194 - References adjustable by an adaptive method, e.g. learning
• G06V 40/12 - Fingerprints or palmprints

Abstract

Introduced here are light sources for flash photography configured to produce high-fidelity white light that is tunable over a broader range of correlated color temperatures (CCTs) than conventional flash technologies. The light source can include multiple independently controllable color channels representing illuminants (e.g., light-emitting diodes) of different colors with varying degrees of saturation. Operating collectively, the multiple color channels can produce a high spectral quality white light corresponding to different CCTs (e.g., “warm” white light having a red hue, “cool” white light having a blue hue). Operating independently, these same color channels can be pre-flashed in a variety of prescribed sequences to probe the spectral characteristics of a scene, thereby allowing for an enhanced, spectrally matched white flash as well as collecting per-pixel reflectivity data that can be later used in during post processing of the captured image.

IPC Classes  ?

• G03B 15/05 - Combinations of cameras with electronic flash apparatus; Electronic flash units
• G03B 43/00 - Testing correct operation of photographic apparatus or parts thereof
• G06V 10/56 - Extraction of image or video features relating to colour
• G06T 7/90 - Determination of colour characteristics
• H05B 45/20 - Controlling the colour of the light
• H05B 47/125 - Controlling the light source in response to determined parameters by determining the presence or movement of objects or living beings by using cameras
• G06V 10/141 - Control of illumination
• G06V 40/13 - Sensors therefor
• H04N 23/10 - Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
• H04N 23/56 - Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
• H04N 23/60 - Control of cameras or camera modules
• H04N 25/40 - Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
• G06V 30/194 - References adjustable by an adaptive method, e.g. learning
• G06V 40/12 - Fingerprints or palmprints

Abstract

Introduced here are multi-channel light sources able to produce a broad range of electromagnetic radiation. A multi-channel light source (also referred to as a “multi-channel emitter”) can be designed to produce visible light and/or non-visible light. For example, some embodiments of the multi-channel light source include illuminant(s) capable of emitting electromagnetic radiation within the visible range and illuminant(s) capable of emitting electromagnetic radiation in a non-visible range, such as the ultraviolet range or infrared range. By capturing images in conjunction with the visible and non-visible light, additional information on the ambient scene can be gleaned which may be useful, for example, during post-processing.

IPC Classes  ?

• G03B 15/05 - Combinations of cameras with electronic flash apparatus; Electronic flash units
• G03B 43/00 - Testing correct operation of photographic apparatus or parts thereof
• G06T 7/90 - Determination of colour characteristics
• G06V 40/13 - Sensors therefor
• H05B 45/20 - Controlling the colour of the light
• H04N 23/10 - Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
• H04N 23/56 - Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
• H04N 23/60 - Control of cameras or camera modules
• H04N 25/40 - Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
• G06V 40/12 - Fingerprints or palmprints

Abstract

Introduced here are computer programs and associated computer-implemented techniques for achieving high-fidelity color reproduction in the absence of any known reflectance spectrums. That is, high-fidelity color reproduction can be achieved without portable references, such as gray cards and color checkers. To accomplish this, a new reference spectrum—the “reference illuminant spectrum”—is introduced into scenes to be imaged by image sensors. The reference illuminant spectrum is created by a multi-channel light source whose spectral properties are known.

IPC Classes  ?

• H04N 23/88 - Camera processing pipelines; Components thereof for processing colour signals for colour balance, e.g. white-balance circuits or colour temperature control
• H04N 23/10 - Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
• H04N 23/56 - Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
• H04N 23/60 - Control of cameras or camera modules

Abstract

Introduced here are computer programs and associated computer-implemented techniques for determining reflectance of an image on a per-pixel basis. More specifically, a characterization module can initially acquire a first data set generated by a multi-channel light source and a second data set generated by a multi-channel image sensor. The first data set may specify the illuminance of each color channel of the multi-channel light source (which is configured to produce a flash), while the second data set may specify the response of each sensor channel of the multi-channel image sensor (which is configured to capture an image in conjunction with the flash). Thus, the characterization module may determine reflectance based on illuminance and sensor response. The characterization module may also be configured to determine illuminance based on reflectance and sensor response, or determine sensor response based on illuminance and reflectance.

IPC Classes  ?

• G06T 7/90 - Determination of colour characteristics
• G03B 15/05 - Combinations of cameras with electronic flash apparatus; Electronic flash units
• H04N 5/341 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled
• H04N 5/225 - Television cameras
• G03B 43/00 - Testing correct operation of photographic apparatus or parts thereof
• H04N 5/232 - Devices for controlling television cameras, e.g. remote control
• G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
• H04N 9/04 - Picture signal generators
• H05B 45/20 - Controlling the colour of the light
• H05B 47/125 - Controlling the light source in response to determined parameters by determining the presence or movement of objects or living beings by using cameras
• G06V 10/56 - Extraction of image or video features relating to colour
• G06V 10/141 - Control of illumination
• G06V 30/194 - References adjustable by an adaptive method, e.g. learning
• G06V 40/13 - Sensors therefor
• G06V 40/12 - Fingerprints or palmprints

Abstract

Introduced here are light sources for flash photography configured to produce high-fidelity white light that is tunable over a broader range of correlated color temperatures (CCTs) than conventional flash technologies. The light source can include multiple independently controllable color channels representing illuminants (e.g., light-emitting diodes) of different colors with varying degrees of saturation. Operating collectively, the multiple color channels can produce a high spectral quality white light corresponding to different CCTs (e.g., “warm” white light having a red hue, “cool” white light having a blue hue). Operating independently, these same color channels can be pre-flashed in a variety of prescribed sequences to probe the spectral characteristics of a scene, thereby allowing for an enhanced, spectrally matched white flash as well as collecting per-pixel reflectivity data that can be later used in during post processing of the captured image.

IPC Classes  ?

• G03B 15/05 - Combinations of cameras with electronic flash apparatus; Electronic flash units
• G03B 43/00 - Testing correct operation of photographic apparatus or parts thereof
• G06T 7/90 - Determination of colour characteristics
• H04N 5/225 - Television cameras
• H04N 9/04 - Picture signal generators
• H05B 45/20 - Controlling the colour of the light
• H05B 47/125 - Controlling the light source in response to determined parameters by determining the presence or movement of objects or living beings by using cameras
• G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
• H04N 5/341 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled
• G06K 9/66 - Methods or arrangements for recognition using electronic means using simultaneous comparisons or correlations of the image signals with a plurality of references, e.g. resistor matrix references adjustable by an adaptive method, e.g. learning
• G06K 9/20 - Image acquisition
• H04N 5/232 - Devices for controlling television cameras, e.g. remote control
• G06K 9/46 - Extraction of features or characteristics of the image

Abstract

Introduced here are computer programs and associated computer-implemented techniques for determining reflectance of an image on a per-pixel basis. More specifically, a characterization module can initially acquire a first data set generated by a multi-channel light source and a second data set generated by a multi-channel image sensor. The first data set may specify the illuminance of each channel of the multi-channel light source (which may be able to produce visible light and/or non-visible light), while the second data set may specify the response of each sensor channel of the multi-channel image sensor (which is configured to capture an image in conjunction with the light). Thus, the characterization module may determine reflectance based on illuminance and sensor response. The characterization module may also be configured to determine illuminance based on reflectance and sensor response, or determine sensor response based on illuminance and reflectance.

IPC Classes  ?

• H04N 5/225 - Television cameras
• G06V 40/13 - Sensors therefor
• G06T 7/90 - Determination of colour characteristics
• H04N 9/04 - Picture signal generators
• G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
• H04N 5/232 - Devices for controlling television cameras, e.g. remote control
• G03B 43/00 - Testing correct operation of photographic apparatus or parts thereof
• G03B 15/05 - Combinations of cameras with electronic flash apparatus; Electronic flash units
• H04N 5/341 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled
• H05B 45/20 - Controlling the colour of the light
• G01J 3/28 - Investigating the spectrum
• G06V 10/56 - Extraction of image or video features relating to colour
• G06V 10/141 - Control of illumination
• G06V 30/194 - References adjustable by an adaptive method, e.g. learning
• G06V 40/12 - Fingerprints or palmprints

Abstract

Introduced here are multi-channel light sources able to produce a broad range of electromagnetic radiation. A multi-channel light source (also referred to as a “multi-channel emitter”) can be designed to produce visible light and/or non-visible light. For example, some embodiments of the multi-channel light source include illuminant(s) capable of emitting electromagnetic radiation within the visible range and illuminant(s) capable of emitting electromagnetic radiation in a non-visible range, such as the ultraviolet range or infrared range. By capturing images in conjunction with the visible and non-visible light, additional information on the ambient scene can be gleaned which may be useful, for example, during post-processing.

IPC Classes  ?

• G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
• G06T 7/90 - Determination of colour characteristics
• G06K 9/46 - Extraction of features or characteristics of the image
• H04N 9/04 - Picture signal generators
• H05B 45/22 - Controlling the colour of the light using optical feedback
• H04N 5/235 - Circuitry for compensating for variation in the brightness of the object
• H05B 45/20 - Controlling the colour of the light
• H04N 5/232 - Devices for controlling television cameras, e.g. remote control
• G06K 9/20 - Image acquisition
• G03B 43/00 - Testing correct operation of photographic apparatus or parts thereof
• G03B 15/05 - Combinations of cameras with electronic flash apparatus; Electronic flash units
• G06K 9/66 - Methods or arrangements for recognition using electronic means using simultaneous comparisons or correlations of the image signals with a plurality of references, e.g. resistor matrix references adjustable by an adaptive method, e.g. learning
• H04N 5/225 - Television cameras
• H04N 5/341 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled

Abstract

Introduced here are computer programs and associated computer-implemented techniques for determining reflectance of an image on a per-pixel basis. More specifically, a characterization module can initially acquire a first data set generated by a multi-channel light source and a second data set generated by a multi-channel image sensor. The first data set may specify the illuminance of each color channel of the multi-channel light source (which is configured to produce a flash), while the second data set may specify the response of each sensor channel of the multi-channel image sensor (which is configured to capture an image in conjunction with the flash). Thus, the characterization module may determine reflectance based on illuminance and sensor response. The characterization module may also be configured to determine illuminance based on reflectance and sensor response, or determine sensor response based on illuminance and reflectance.

IPC Classes  ?

• G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
• H04N 5/341 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled
• H04N 5/225 - Television cameras
• G06K 9/66 - Methods or arrangements for recognition using electronic means using simultaneous comparisons or correlations of the image signals with a plurality of references, e.g. resistor matrix references adjustable by an adaptive method, e.g. learning
• G03B 43/00 - Testing correct operation of photographic apparatus or parts thereof
• G06K 9/20 - Image acquisition
• H04N 5/232 - Devices for controlling television cameras, e.g. remote control
• H04N 9/04 - Picture signal generators
• G06K 9/46 - Extraction of features or characteristics of the image
• G06T 7/90 - Determination of colour characteristics
• H05B 45/20 - Controlling the colour of the light
• G03B 15/05 - Combinations of cameras with electronic flash apparatus; Electronic flash units

Abstract

Introduced here are light sources for flash photography configured to produce high-fidelity white light that is tunable over a broader range of correlated color temperatures (CCTs) than conventional flash technologies. The light source can include multiple independently controllable color channels representing illuminants (e.g., light-emitting diodes) of different colors with varying degrees of saturation. Operating collectively, the multiple color channels can produce a high spectral quality white light corresponding to different CCTs (e.g., “warm” white light having a red hue, “cool” white light having a blue hue). Operating independently, these same color channels can be pre-flashed in a variety of prescribed sequences to probe the spectral characteristics of a scene, thereby allowing for an enhanced, spectrally matched white flash as well as collecting per-pixel reflectivity data that can be later used in during post processing of the captured image.

IPC Classes  ?

• H05B 37/02 - Controlling
• H05B 39/04 - Controlling
• H05B 41/36 - Controlling
• G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
• H04N 5/341 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled
• H04N 5/225 - Television cameras
• G06K 9/66 - Methods or arrangements for recognition using electronic means using simultaneous comparisons or correlations of the image signals with a plurality of references, e.g. resistor matrix references adjustable by an adaptive method, e.g. learning
• G03B 43/00 - Testing correct operation of photographic apparatus or parts thereof
• G06K 9/20 - Image acquisition
• H04N 5/232 - Devices for controlling television cameras, e.g. remote control
• H04N 9/04 - Picture signal generators
• G06K 9/46 - Extraction of features or characteristics of the image
• G06T 7/90 - Determination of colour characteristics
• H05B 45/20 - Controlling the colour of the light
• G03B 15/05 - Combinations of cameras with electronic flash apparatus; Electronic flash units

Abstract

Introduced here are light sources for flash photography configured to produce high-fidelity white light that is tunable over a broader range of correlated color temperatures (CCTs) than conventional flash technologies. The light source can include multiple independently controllable color channels representing illuminants (e.g., light-emitting diodes) of different colors with varying degrees of saturation. Operating collectively, the multiple color channels can produce a high spectral quality white light corresponding to different CCTs (e.g., “warm” white light having a red hue, “cool” white light having a blue hue). Operating independently, these same color channels can be pre-flashed in a variety of prescribed sequences to probe the spectral characteristics of a scene, thereby allowing for an enhanced, spectrally matched white flash as well as collecting per-pixel reflectivity data that can be later used in during post processing of the captured image.

IPC Classes  ?

• H05B 37/00 - Circuit arrangements for electric light sources in general
• H05B 39/00 - Circuit arrangements or apparatus for operating incandescent light sources
• H05B 41/14 - Circuit arrangements
• G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
• H04N 5/341 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled
• H04N 5/225 - Television cameras
• G06K 9/66 - Methods or arrangements for recognition using electronic means using simultaneous comparisons or correlations of the image signals with a plurality of references, e.g. resistor matrix references adjustable by an adaptive method, e.g. learning
• G03B 15/05 - Combinations of cameras with electronic flash apparatus; Electronic flash units
• H05B 33/08 - Circuit arrangements for operating electroluminescent light sources

Abstract

Introduced here are computer programs and associated computer-implemented techniques for determining reflectance of an image on a per-pixel basis. More specifically, a characterization module can initially acquire a first data set generated by a multi-channel light source and a second data set generated by a multi-channel image sensor. The first data set may specify the illuminance of each color channel of the multi-channel light source (which is configured to produce a flash), while the second data set may specify the response of each sensor channel of the multi-channel image sensor (which is configured to capture an image in conjunction with the flash). Thus, the characterization module may determine reflectance based on illuminance and sensor response. The characterization module may also be configured to determine illuminance based on reflectance and sensor response, or determine sensor response based on illuminance and reflectance.

IPC Classes  ?

• G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
• H04N 5/341 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled
• H04N 5/225 - Television cameras
• G06K 9/66 - Methods or arrangements for recognition using electronic means using simultaneous comparisons or correlations of the image signals with a plurality of references, e.g. resistor matrix references adjustable by an adaptive method, e.g. learning