A system and method are described for performing motion capture on a subject using transparent makeup, paint, dye or ink that is visible to certain cameras, but invisible to other cameras. For example, a system according to one embodiment of the invention comprises the application of makeup, paint, dye or ink on a subject in a random pattern that contains a phosphor that is transparent in the visible light spectrum, but is emissive in a non-visible spectrum such as the infrared (IR) or ultraviolet (UV) spectrum; using visible light such as ambient light or daylight to illuminate the subject; using a first plurality of cameras sensitive in the visible light spectrum to capture the normal coloration of the subject; and using a second plurality of cameras sensitive in a non-visible spectrum to capture the random pattern.
A system and method are described for performing motion capture on a subject. For example, a computer-implemented method according to one embodiment of the invention comprises: creating a scalar field for the three- dimensional (3-D) capture volume of the subject; generating a surface mesh for the scalar field; retaining good vertices and removing bad vertices of the surface mesh; and storing the good vertices for use in subsequent reconstruction of the motion of the subject. Another computer-implemented method comprises: capturing a series of image frames of the subject over a period of time each frame each frame having a plurality of vertices defining a captured surface of the subject; establishing a reference frame having one or more of the plurality of vertices; performing frame-to-frame tracking to identify vertices within the N'th frame based on the (N-1 )'th frame or an earlier frame; and performing reference- to-frame tracking to identify vertices within the N'th frame based on the reference frame to counter potential drift between the frames. Yet another computer- implemented method comprises: capturing motion capture data including a plurality of images of the N vertices during a motion capture session; retrospectively identifying X of the N vertices to track across the plurality of images where X < N; and tracking the X vertices across the plurality of images.
A system and method are described for performing motion capture on a subject. For example, a computer-implemented method according to one embodiment of the invention comprises: creating a scalar field for the three-dimensional (3-D) capture volume of the subject; generating a surface mesh for the scalar field; retaining good vertices and removing bad vertices of the surface mesh; and storing the good vertices for use in subsequent reconstruction of the motion of the subject. Another computer-implemented method comprises: capturing a series of image frames of the subject over a period of time each frame each frame having a plurality of vertices defining a captured surface of the subject; establishing a reference frame having one or more of the plurality of vertices; performing frame-to-frame tracking to identify vertices within the N'th frame based on the (N-1 )'th frame or an earlier frame; and performing reference-to-frame tracking to identify vertices within the N'th frame based on the reference frame to counter potential drift between the frames. Yet another computer- implemented method comprises: capturing motion capture data including a plurality of images of the N vertices during a motion capture session; retrospectively identifying X of the N vertices to track across the plurality of images where X < N; and tracking the X vertices across the plurality of images.
A system and method are described for performing motion capture on a subject. For example, a method according to one embodiment of the invention comprises: mixing phosphorescent makeup with a makeup base; applying the mixture of phosphorescent makeup and makeup base to surface regions of a motion capture subject; strobing a light source on and off, the light source charging phosphor within the phosphorescent makeup when on; and strobing the shutters of a first plurality of cameras synchronously with the strobing of the light source to capture images of the phosphorescent makeup, wherein the shutters are open when the light source is off and the shutters are closed when the light source is on.
G01B 11/245 - Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures using a plurality of fixed, simultaneously operating transducers
H04N 13/239 - Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
G03B 15/16 - Special procedures for taking photographs; Apparatus therefor for photographing the track of moving objects
H04N 5/222 - Studio circuitry; Studio devices; Studio equipment
C09K 11/02 - Use of particular materials as binders, particle coatings or suspension media therefor
A method is described comprising: applying a random pattern to specified regions of an object; tracking the movement of the random pattern during a motion capture session; and generating motion data representing the movement of the object using the tracked movement of the random pattern.
G03B 41/14 - Overcoming image movement by brief flashes of light
G01B 11/245 - Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures using a plurality of fixed, simultaneously operating transducers
6.
APPARATUS AND METHOD FOR PERFORMING MOTION CAPTURE USING A RANDOM PATTERN ON CAPTURE SURFACES
A method is described comprising: applying a random pattern to specified regions of an object; tracking the movement of the random pattern during a motion capture session; and generating motion data representing the movement of the object using the tracked movement of the random pattern.
A system and method are disclosed which provide a rendered animation of a three-dimensional face. The animation includes a rendering of a first plurality of 3D points on at least part of the rendered animated 3D face and a first plurality of time intervals correlated to a second plurality of 3D points on at least part of a surface of a performers face at a second plurality of time intervals. The first plurality of 3D points automatically tracked the second plurality of 3D points within regions of the performer's face that fold or deform. The second plurality of 3D points are located on the performer's face where the performer's skin surface colour is visible. The second plurality of 3D points may correspond to facial expressions.
A method is described comprising: applying phosphorescent paint to specified regions of a performer's face and/or body; strobing a light source on and off, the light source charging the phosphorescent paint when on; and strobing the shutters of a first plurality of cameras synchronously with the strobing of the light source to capture images of the phosphorescent paint, wherein the shutters are open when the light source is off and the shutters are closed when the light source is open.
A method is described comprising: applying phosphorescent paint to specified regions of a performer's face and/or body; strobing a light source on and off, the light source charging the phosphorescent paint when on; and strobing the shutters of a first plurality of cameras synchronously with the strobing of the light source to capture images of the phosphorescent paint, wherein the shutters are open when the light source is off and the shutters are closed when the light source is open.
A method is described comprising: applying phosphorescent paint to specified regions of a performer's face and/or body; strobing a light source on and off, the light source charging the phosphorescent paint when on; and strobing the shutters of a first plurality of cameras synchronously with the strobing of the light source to capture images of the phosphorescent paint, wherein the shutters are open when the light source is off and the shutters are closed when the light source is open.