A control surface designer (CSD) module may generate a configuration user interface that lists a plurality of applications and their respective plurality of commands, wherein the configuration user interface includes, for each command of the respective plurality of commands, parameters of specific command instances. The CSD module may receive, via the configuration user interface, selections of commands from different applications in the plurality of applications, and may generate code payloads that correspond to the commands. The CSD module may generate a customized user interface that includes the commands by compiling the code payloads.
G06F 9/451 - Execution arrangements for user interfaces
G06F 3/0482 - Interaction with lists of selectable items, e.g. menus
G06F 3/04845 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
A control surface designer (CSD) module may generate a configuration user interface that lists a plurality of applications and their respective plurality of commands, wherein the configuration user interface includes, for each command of the respective plurality of commands, parameters of specific command instances. The CSD module may receive, via the configuration user interface, selections of commands from different applications in the plurality of applications, and may generate code payloads that correspond to the commands. The CSD module may generate a customized user interface that includes the commands by compiling the code payloads.
G06F 9/451 - Execution arrangements for user interfaces
G06F 3/0481 - Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
A system is provided for optimizing deployment of a processing function in a media production workflow. The system includes a media production workflow generator that builds the media production workflow that includes the processing function and determines deployment criteria that includes an input dataset for the processing function and an atomic compute function for executing the processing function. Moreover, a deployment topology generator generates a topologies of the resources available in a cloud computing network and based on the determined deployment criteria, with the generated topologies indicating different configurations of resources for executing the processing function and a processor for executing the atomic compute function of the processing function. Furthermore, a deployment optimizer selects an optimal topology to deploy the processing function within the cloud computing network, with the optimal topology selected to include the processor for optimizing accessibility of electronic memory to execute the atomic compute function.
A system and method are provided for generating a factory layout to dynamically optimize a media content production in a real-time environment. The system includes a media production optimizer with a widget controller that provides widgets that represent work packages as micro-services that perform functions of the media content production, respectively. A user interface controller receive inputs from a user interface to dynamically update the factory layout for the media content production. The media production optimizer then recompiles underlying code to update a model of the factory layout in response to the inputs from the operator of the system, and also migrates the updated factory layout to a cloud platform that includes a plurality of media production components including the plurality of micro-services for deployment thereon.
A system is provided for dynamically managing a media production work package. The system includes a media production work package generator that builds a media production work package that includes media processing functions; and a processing function manager that generates function trackers that are each assigned to a respective one of the plurality of media processing functions and comprise a unique identity. Moreover, the system includes a function deployment manager that embeds the function trackers in the respective media processing functions, and deploys the media processing functions to resources available in a cloud computing network that includes both physical resources and software resources. A performance metric collector generates a graphical representation of respective total costs of each the deployed media processing functions and a work package controller generates a data point structure that uniquely identifies the deployed media processing functions and the total costs for each deployed function.
A system is provided for dynamically managing a media production work package. The system includes a media production work package generator that builds a media production work package that includes media processing functions; and a processing function manager that generates function trackers that are each assigned to a respective one of the plurality of media processing functions and comprise a unique identity. Moreover, the system includes a function deployment manager that embeds the function trackers in the respective media processing functions, and deploys the media processing functions to resources available in a cloud computing network that includes both physical resources and software resources. A performance metric collector generates a graphical representation of respective total costs of each the deployed media processing functions and a work package controller generates a data point structure that uniquely identifies the deployed media processing functions and the total costs for each deployed function.
A system is provided for dynamically modifying media processing functions to control optimization of a media production. The system includes a media processing function library that stores media processing functions that each include a subgraph embedded therein that has pre-calculated parameters and undefined variable parameters. Media processing engines execute the plurality of media processing functions to create the media production. Moreover, the system includes a media function management controller that places the media processing functions in a job queue to be executed by one or more of the media processing engines. A resource manager receives a media production instruction from a client device to partially deploy the media processing functions in the job queue. During execution, the media processing engine can receive an input deliverable that constrains the undefined variable parameters, such that the partially deployed media processing functions is dynamically modified during runtime to create the media production.
A system is provided for dynamically modifying media processing functions to control optimization of a media production. The system includes a media processing function library that stores media processing functions that each include a subgraph embedded therein that has precalculated parameters and undefined variable parameters. Media processing engines execute the plurality of media processing functions to create the media production. Moreover, the system includes a media function management controller that places the media processing functions in a job queue to be executed by one or more of the media processing engines. A resource manager receives a media production instruction from a client device to partially deploy the media processing functions in the job queue. During execution, the media processing engine can receive an input deliverable that constrains the undefined variable parameters, such that the partially deployed media processing functions is dynamically modified during runtime to create the media production.
G06F 11/34 - Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation
G06F 16/901 - Indexing; Data structures therefor; Storage structures
H04L 65/752 - Media network packet handling adapting media to network capabilities
H04N 21/262 - Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission or generating play-lists
H04L 67/10 - Protocols in which an application is distributed across nodes in the network
H04N 21/637 - Control signals issued by the client directed to the server or network components
H04N 21/65 - Transmission of management data between client and server
H04N 21/6547 - Transmission by server directed to the client comprising parameters, e.g. for client setup
H04N 21/85 - Assembly of content; Generation of multimedia applications
9.
SYSTEM AND METHOD FOR PERFORMING LOSSLESS SWITCHING IN A REDUNDANT MULTICAST NETWORK
A system and method is provided for performing lossless switching in a redundant multicast network. An exemplary method includes receiving a primary media stream and a redundant media stream over different forwarding network paths by network ports of a receiver communicatively coupled to an A/V device. Furthermore, the receiver outputs media data of the media streams to the A/V device to be presented thereon. In response to a control signal to switch the receiver to a new primary media stream, the method disconnected either the primary ort the redundant media streams from the respective network port of the receiver receiving that stream. Furthermore, the method includes controlling the disconnected network port to receive the new primary media stream and then outputting media data of the new primary media stream to the A/V device to be presented thereon.
H04N 21/43 - Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronizing decoder's clock; Client middleware
H04N 21/438 - Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving MPEG packets from an IP network
A system is provided for capturing a key signal within video frames that includes a camera that captures a sequence of media content of a live scene that includes an electronic display having a higher frame rate than an output frame rate of the camera, and a key signal processor that convert all frames in the sequence of media content to the output frame rate of the camera, analyzes a sequence of frames to determine the key signal based on the electronic display outputting a sequence of frames including media content and at least one key frame included in the sequence, and combine remaining frames of the sequence of frames to create a live output signal. Moreover, the key signal processor determines, for each pixel in the frames, whether the pixel has a set chromaticity, and generates a key mask for each pixel in each frame.
A system is provided for capturing a key signal within video frames that includes a camera that captures a sequence of media content of a live scene that includes an electronic display having a higher frame rate than an output frame rate of the camera, and a key signal processor that convert all frames in the sequence of media content to the output frame rate of the camera, analyzes a sequence of frames to determine the key signal based on the electronic display outputting a sequence of frames including media content and at least one key frame included in the sequence, and combine remaining frames of the sequence of frames to create a live output signal. Moreover, the key signal processor determines, for each pixel in the frames, whether the pixel has a set chromaticity, and generates a key mask for each pixel in each frame.
A computing device and method for providing a user interface for summarizing and presenting information regarding dynamic provisioning and deployment of media processing resources, in a manner that is easy and intuitive and analogizes well to conventional physical media processing deployment. Users are not required to understand hypervisor configuration or virtual machine deployment, or switch through various layers and screens to find configuration information or controls, a process that may be particularly slow, complex, and difficult to learn, particularly for media and broadcast engineers unfamiliar with virtualization technologies. Instead, the present user interface improves efficiency of use of the computing environment for media processing, by providing deployment information in a format similar to physical processing deployment. Furthermore, because the user interface lends itself to intuitive monitoring and use, users may more accurately and efficiently deploy and undeploy processing resources, reducing overall system processing requirements, cost, and power consumption.
A system and method is provided for reducing the bandwidth for media broadcast production. The system includes a plurality of content providing devices and a remote production system. Each of the content providing devices has a corresponding variable encoder. The remote production system transmits control signals to the variable encoders, controlling them to use a high-fidelity encoding method or a compressed encoding method. The remote production system controls the variable encoders such that a media feed being included in a media production is encoded using the high-fidelity encoding method, and some or all of the other media streams are encoded using the compressed encoding method.
A system and method is provided for reducing the bandwidth for media broadcast production. The system includes a plurality of content providing devices and a remote production system. Each of the content providing devices has a corresponding variable encoder. The remote production system transmits control signals to the variable encoders, controlling them to use a high-fidelity encoding method or a compressed encoding method. The remote production system controls the variable encoders such that a media feed being included in a media production is encoded using the high-fidelity encoding method, and some or all of the other media streams are encoded using the compressed encoding method.
H04H 60/07 - Arrangements for generating broadcast information; Arrangements for generating broadcast-related information with a direct linkage to broadcast information or to broadcast space-time; Arrangements for simultaneous generation of broadcast information and broadcast-related information characterised by processes or methods for the generation
H04H 60/13 - Arrangements for device control affected by the broadcast information
15.
System and method of streaming content between peer devices in a broadcast environment
A system is provided for streaming broadcast media content between peer devices in a media distribution network. The system includes a virtual router panel that includes a notification service controller that receives a data communication request from two or more peer devices and a data communication handshaking controller selects a delivery protocol between the two devices based on exchanging communication candidates that identify peer addresses. A media streaming tunnel generator establishes a streaming tunnel between the first device and the second device based on the respective delivery protocol selected by the data communication handshaking controller; and an encoder packetizes video, audio and ancillary grains directly as packets of the broadcast media content to be streamed directly from the first device to the second device via the established streaming tunnel without multiplexing.
H04L 65/65 - Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
H04L 65/61 - Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
H04L 45/586 - Association of routers of virtual routers
H04L 12/18 - Arrangements for providing special services to substations for broadcast or conference
H04N 21/61 - Network physical structure; Signal processing
H04N 21/63 - Control signaling between client, server and network components; Network processes for video distribution between server and clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
A system is provided for streaming broadcast media content between peer devices in a media distribution network. The system includes a virtual router panel that includes notification service controller that receives a data communication request from two or more peer devices and a data communication handshaking controller selects a delivery protocol between the two devices based on exchanging communication candidates that identify peer addresses. A media streaming tunnel generator establishes a streaming tunnel between the first device and the second device based on the respective delivery protocol selected by the data communication handshaking controller; and an encoder packetizes video, audio and ancillary grains directly as packets of the broadcast media content to be streamed directly from the first device to the second device via the established streaming tunnel without multiplexing.
H04N 21/60 - Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client; Communication details between server and client
H04N 21/242 - Synchronization processes, e.g. processing of PCR [Program Clock References]
A system and method is provided for synchronizing media content in a media distribution network using timestamps. The system includes a decoder configured to parse a plurality of data packets of a media stream to determine a timestamp value for each video frame in the media stream; and a media content synchronizer. The media content synchronizer generates a media content timeline based on the determined timestamp value of each of video frame, generates the media content timeline based on a cadence having monotonic increasing count, determines whether each video frame of the media stream is a next frame in a video sequence of the media stream based on the timestamp value for the respective video frame, and repeats a previous frame in the video sequence to generate the media content timeline when a current frame in the video sequence was dropped based on the determined timestamp value.
A system is provided for displaying content streams on a multiviewer device and includes a GPU that resizes image data loaded therein for display in a multiviewer tile, and an image decimation controller that performs a decimation of a content stream by removing a predetermined number of lines from each frame of the content stream before loading the content stream to the internal memory of the GPU for resizing and display on the multiviewer tile. In this system, the content stream is loaded to a full resolution buffer in system memory if the content stream is not a proxy stream of the media content and the tile designated for the content stream is less the predetermined threshold, such that the image decimation controller performs the decimation to delete the predetermined number of lines before the content stream is loaded in the internal memory of the GPU as the image data.
A system is provided for displaying content streams on a multiviewer device and includes a GPU that resizes image data loaded therein for display in a multiviewer tile, and an image decimation controller that performs a decimation of a content stream by removing a predetermined number of lines from each frame of the content stream before loading the content stream to the internal memory of the GPU for resizing and display on the multiviewer tile. In this system, the content stream is loaded to a full resolution buffer in system memory if the content stream is not a proxy stream of the media content and the tile designated for the content stream is less the predetermined threshold, such that the image decimation controller performs the decimation to delete the predetermined number of lines before the content stream is loaded in the internal memory of the GPU as the image data.
A system is provided for displaying content streams on a multiviewer device and includes a GPU that resizes image data loaded therein for display in a multiviewer tile, and an image decimation controller that performs a decimation of a content stream by removing a predetermined number of lines from each frame of the content stream before loading the content stream to the internal memory of the GPU for resizing and display on the multiviewer tile. In this system, the content stream is loaded to a full resolution buffer in system memory if the content stream is not a proxy stream of the media content and the tile designated for the content stream is less the predetermined threshold, such that the image decimation controller performs the decimation to delete the predetermined number of lines before the content stream is loaded in the internal memory of the GPU as the image data.
H04N 21/43 - Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronizing decoder's clock; Client middleware
H04N 21/431 - Generation of visual interfaces; Content or additional data rendering
H04N 21/44 - Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to MPEG-4 scene graphs
21.
VIRTUALIZED PRODUCTION SWITCHER AND METHOD FOR MEDIA PRODUCTION
A virtualized production switcher for media production is provided that includes a script database that stores predefined macros that each define a script for applying media production functions to media content, and a script optimizer that selects a subset of the predefined macros to be presented on a user interface as suggested scripts for each of a plurality of scenes of a media stream. Moreover, a program generator receives a user input via the user interface that selects one of the predefined macros and applies the corresponding script to a selected scene of the media stream for a media production by applying the at least one media production function to the selected scene based on an identified key-frame thereof. A script profiler identifies metadata related to the selected scene and updates the script database to store a correspondence between the selected scene and the selected predefined macro.
A virtualized production switcher for media production is provided that includes a script database that stores predefined macros that each define a script for applying media production functions to media content, and a script optimizer that selects a subset of the predefined macros to be presented on a user interface as suggested scripts for each of a plurality of scenes of a media stream. Moreover, a program generator receives a user input via the user interface that selects one of the predefined macros and applies the corresponding script to a selected scene of the media stream for a media production by applying the at least one media production function to the selected scene based on an identified key-frame thereof. A script profiler identifies metadata related to the selected scene and updates the script database to store a correspondence between the selected scene and the selected predefined macro.
A virtualized production switcher for media production is provided that includes a script database that stores predefined macros that each define a script for applying media production functions to media content, and a script optimizer that selects a subset of the predefined macros to be presented on a user interface as suggested scripts for each of a plurality of scenes of a media stream. Moreover, a program generator receives a user input via the user interface that selects one of the predefined macros and applies the corresponding script to a selected scene of the media stream for a media production by applying the at least one media production function to the selected scene based on an identified key-frame thereof. A script profiler identifies metadata related to the selected scene and updates the script database to store a correspondence between the selected scene and the selected predefined macro.
H04N 21/443 - OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
H04N 21/462 - Content or additional data management e.g. creating a master electronic program guide from data received from the Internet and a Head-end or controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabi
G06F 3/0482 - Interaction with lists of selectable items, e.g. menus
A system is provided for optimizing deployment of a processing function in a media production workflow. The system includes a media production workflow generator that builds the media production workflow that includes the processing function and determines deployment criteria that includes an input dataset for the processing function and an atomic compute function for executing the processing function. Moreover, a deployment topology generator generates a topologies of the resources available in a cloud computing network and based on the determined deployment criteria, with the generated topologies indicating different configurations of resources for executing the processing function and a processor for executing the atomic compute function of the processing function. Furthermore, a deployment optimizer selects an optimal topology to deploy the processing function within the cloud computing network, with the optimal topology selected to include the processor for optimizing accessibility of electronic memory to execute the atomic compute function.
A system is provided for optimizing deployment of a processing function in a media production workflow. The system includes a media production workflow generator that builds the media production workflow that includes the processing function and determines deployment criteria that includes an input dataset for the processing function and an atomic compute function for executing the processing function. Moreover, a deployment topology generator generates a topologies of the resources available in a cloud computing network and based on the determined deployment criteria, with the generated topologies indicating different configurations of resources for executing the processing function and a processor for executing the atomic compute function of the processing function. Furthermore, a deployment optimizer selects an optimal topology to deploy the processing function within the cloud computing network, with the optimal topology selected to include the processor for optimizing accessibility of electronic memory to execute the atomic compute function.
A system is provided for optimizing deployment of a processing function in a media production workflow. The system includes a media production workflow generator that builds the media production workflow that includes the processing function and determines deployment criteria that includes an input dataset for the processing function and an atomic compute function for executing the processing function. Moreover, a deployment topology generator generates a topologies of the resources available in a cloud computing network and based on the determined deployment criteria, with the generated topologies indicating different configurations of resources for executing the processing function and a processor for executing the atomic compute function of the processing function. Furthermore, a deployment optimizer selects an optimal topology to deploy the processing function within the cloud computing network, with the optimal topology selected to include the processor for optimizing accessibility of electronic memory to execute the atomic compute function.
A system and method is provided for minimizing delay time for controlling media content capture during live video broadcast production. The system includes a video production receiver that receives media content streams from one or more cameras that includes live media content captured by the cameras and encoded in a first encoding format. Moreover, a multi-view interface displays the media content and a video production controller generates control instructions based on inputs to the interface to change operation of the cameras capturing the respective media content. A camera controller is included that transmits the generated control instructions to the cameras to change the operation for capturing the respective media content. Moreover, the video production controls production of a live video stream for video broadcast production using media content that is captured from the cameras and that is encoded in a second encoding format different than the first encoding format.
H04N 21/218 - Source of audio or video content, e.g. local disk arrays
H04N 21/222 - Secondary servers, e.g. proxy server or cable television Head-end
H04N 21/234 - Processing of video elementary streams, e.g. splicing of video streams or manipulating MPEG-4 scene graphs
H04N 21/2343 - Processing of video elementary streams, e.g. splicing of video streams or manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
H04N 21/242 - Synchronization processes, e.g. processing of PCR [Program Clock References]
H04N 21/262 - Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission or generating play-lists
A system is provided for partial matching of settings across cameras. The system includes a camera setting controller that controls control elements of a target camera for capturing video content of a scene. Moreover, a transfer module detects a request to transfer settings from a reference camera to the target camera and a look determiner determines a look of a scene of the video content being captured by the at least one target camera. The transfer module retrieves the control elements of the reference camera and related image capture control settings that correspond to the obtained image capture control settings of the at least one target camera. The transfer module then transfers the image capture control settings of the control elements from the reference camera to the target camera, such that the settings are applied to the target camera to modify the capturing of video content of the scene.
A media stream receiver is provided for scalable physical layer flow of packetized media streams. The media stream receiver replicates the processing block in time, rather than in hardware, through the use of a single shared memory and pointer alignment calculations, which combines multiple buffering stages as the single, shared memory buffer to offer redundancy and alignment, while acting as a receiver buffer to account for packet delay variations. By doing so the media stream receiver can perform a vertical interval switch between received media streams.
H04N 21/43 - Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronizing decoder's clock; Client middleware
H04N 21/4402 - Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
H04N 21/4385 - Multiplex stream processing, e.g. multiplex stream decrypting
A system and method is provided for synchronizing media content in a media distribution network using timestamps. The system includes a decoder configured to parse a plurality of data packets of a media stream to determine a timestamp value for each video frame in the media stream; and a media content synchronizer. The media content synchronizer generates a media content timeline based on the determined timestamp value of each of video frame, generates the media content timeline based on a cadence having monotonic increasing count, determines whether each video frame of the media stream is a next frame in a video sequence of the media stream based on the timestamp value for the respective video frame, and repeats a previous frame in the video sequence to generate the media content timeline when a current frame in the video sequence was dropped based on the determined timestamp value.
A system and method is provided for synchronizing media content in a media distribution network using timestamps. The system includes a decoder configured to parse a plurality of data packets of a media stream to determine a timestamp value for each video frame in the media stream; and a media content synchronizer. The media content synchronizer generates a media content timeline based on the determined timestamp value of each of video frame, generates the media content timeline based on a cadence having monotonic increasing count, determines whether each video frame of the media stream is a next frame in a video sequence of the media stream based on the timestamp value for the respective video frame, and repeats a previous frame in the video sequence to generate the media content timeline when a current frame in the video sequence was dropped based on the determined timestamp value.
A system is provided for determining equivalence to execute a task. The system includes an identity module that obtains a unique identity for each of a plurality of resources, and a metadata collection module that collects metadata information relating to the plurality of resources based on the obtained unique identifier for each resource, and that stores the collected metadata information in a metadata database, with the metadata information relating to capabilities of the respective resource for executing the task. Moreover, the system includes an equivalence processor that determines a set of resources of the plurality of resources that are configured to execute the task defined by a requesting client device in an equivalent manner based on the collected metadata information of the at least one set of resources.
A system and method is provided for synchronizing media content in a media distribution network using timestamps. The system includes a decoder configured to parse a plurality of data packets of a media stream to determine a timestamp value for each video frame in the media stream; and a media content synchronizer. The media content synchronizer generates a media content timeline based on the determined timestamp value of each of video frame, generates the media content timeline based on a cadence having monotonic increasing count, determines whether each video frame of the media stream is a next frame in a video sequence of the media stream based on the timestamp value for the respective video frame, and repeats a previous frame in the video sequence to generate the media content timeline when a current frame in the video sequence was dropped based on the determined timestamp value.
A method and system for providing access to and control of parameters within a scenegraph includes redefining components or nodes' semantic within a scenegraph. The set of components or nodes (depending on the scenegraph structure) are required to enable access from the Application User Interface to selected scenegraph information. In one embodiment, a user interface is generated for controlling the scenegraph parameters. In addition, constraints can be implemented that allow or disallow access to certain scenegraph parameters and restrict their range of values.
A system and method are provided for generating a factory layout to dynamically optimize a media content production in a real-time environment. The system includes a media production optimizer with a widget controller that provides widgets that represent work packages as micro-services that perform functions of the media content production, respectively. A user interface controller receive inputs from a user interface to dynamically update the factory layout for the media content production. The media production optimizer then recompiles underlying code to update a model of the factory layout in response to the inputs from the operator of the system, and also migrates the updated factory layout to a cloud platform that includes a plurality of media production components including the plurality of micro-services for deployment thereon.
A system and method are provided for generating a factory layout to dynamically optimize a media content production in a real-time environment. The system includes a media production optimizer with a widget controller that provides widgets that represent work packages as micro-services that perform functions of the media content production, respectively. A user interface controller receive inputs from a user interface to dynamically update the factory layout for the media content production. The media production optimizer then recompiles underlying code to update a model of the factory layout in response to the inputs from the operator of the system, and also migrates the updated factory layout to a cloud platform that includes a plurality of media production components including the plurality of micro-services for deployment thereon.
A system is provided for distributing media content in a distributed network. The system includes a count sequence generator that generates a monotonic increasing count sequence, a signal processor that generates a correspondence between media content and the count sequence, such that the monotonic increasing counter sequence is configured for a media content request defined by the increasing count sequence; and a media content database configured to store the media content and corresponding count sequence. Moreover, the signal processor receives a media content request that includes media request parameters that define a portion of the media content based on the corresponding count sequence and at least one of content quality, cost of the requested media content and a delivery time for the requested media content. The signal processor also accesses the requested media content from the media content database and distributes the media content to the media processing node.
H04N 21/242 - Synchronization processes, e.g. processing of PCR [Program Clock References]
H04N 21/238 - Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
H04N 21/262 - Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission or generating play-lists
H04N 21/647 - Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load or bridging bet
38.
SYSTEM AND METHOD FOR CONTROLLING DISTRIBUTION OF MEDIA CONTENT IN A DISTRIBUTED SYSTEM
A system is provided for distributing media content in a distributed network. The system includes a count sequence generator that generates a monotonic increasing count sequence, a signal processor that generates a correspondence between media content and the count sequence, such that the monotonic increasing counter sequence is configured for a media content request defined by the increasing count sequence; and a media content database configured to store the media content and corresponding count sequence. Moreover, the signal processor receives a media content request that includes media request parameters that define a portion of the media content based on the corresponding count sequence and at least one of content quality, cost of the requested media content and a delivery time for the requested media content. The signal processor also accesses the requested media content from the media content database and distributes the media content to the media processing node.
H04N 21/242 - Synchronization processes, e.g. processing of PCR [Program Clock References]
H04N 21/238 - Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
H04N 21/262 - Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission or generating play-lists
H04N 21/647 - Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load or bridging bet
39.
System and method for controlling distribution of media content in a distributed system
A system is provided for distributing media content in a distributed network. The system includes a count sequence generator that generates a monotonic increasing count sequence, a signal processor that generates a correspondence between media content and the count sequence, such that the monotonic increasing counter sequence is configured for a media content request defined by the increasing count sequence; and a media content database configured to store the media content and corresponding count sequence. Moreover, the signal processor receives a media content request that includes media request parameters that define a portion of the media content based on the corresponding count sequence and at least one of content quality, cost of the requested media content and a delivery time for the requested media content. The signal processor also accesses the requested media content from the media content database and distributes the media content to the media processing node.
H04N 21/84 - Generation or processing of descriptive data, e.g. content descriptors
H04N 21/262 - Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission or generating play-lists
A broadcast camera is provided that includes a camera housing having connectable camera housing portions to define a front, middle and rear sections of a camera body. An electronic component is provided in the front section of the camera housing and a power transformer is mounted in the rear section of the camera housing. A duct housing is mounted within the camera housing to form a cooling duct that extends through the camera housing, with a front duct housing that is positioned adjacent to the electronic component and that separates the electronic component from the cooling duct. Moreover, heat sinks extend within the cooling duct in one of the upper, middle and lower front duct sections and are mounted to be in thermal communication with the at least one electronic component. A fan is mounted within the cooling duct to draw air into the cooling duct.
G03B 17/55 - APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR - Details of cameras or camera bodies; Accessories therefor with provision for heating or cooling, e.g. in aircraft
G03B 17/12 - Bodies with means for supporting objectives, supplementary lenses, filters, masks, or turrets
A system and method is provided for timely and uniform real-time data packet transmission by a computing device. The system can include a shared packet memory buffer for storing data packets generated by a user application and a shared schedule memory buffer for storing packet identifiers and corresponding time slots for the data packets. Moreover, a kernel module is provided that operates in the kernel mode of the operating system directly above the network interface controller and can continuously poll the shared scheduled memory to access packet identifiers at corresponding time slots. Based on the packet identifiers in each time slot, the kernel module can pull the data packet having the packet identifier directly from the ring buffer and send each packet to the network interface controller for transmission as part of a media stream over a network to a media consuming device.
H04L 69/329 - Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions in the application layer [OSI layer 7]
H04L 69/321 - Interlayer communication protocols or service data unit [SDU] definitions; Interfaces between layers
H04L 69/16 - Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
H04L 69/322 - Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions
H04L 67/60 - Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
H04L 43/10 - Active monitoring, e.g. heartbeat, ping or trace-route
H04L 45/00 - Routing or path finding of packets in data switching networks
H04L 47/34 - Flow control; Congestion control ensuring sequence integrity, e.g. using sequence numbers
ABSTRACT An imaging system is provided that includes a pixel array having a plurality of columns with rows of pixels and with each pixel having a plurality of photodiodes and a common readout circuit that stores respective accumulation voltages from each of the plurality of photodiodes. Moreover, the system includes row driver circuitry that control the pixel array for pixel addressing and readout, such that the respective accumulation voltages of the photodiodes is read out on a readout channel coupled to a bit line column, and a hybrid multiplexer that multiplexes and routes output signals from the pixel array to a video imaging device to be displayed thereon. 28 wsLEGAL\061775\00206\23978877v2 CA 3069947 2020-01-24
ABSTRACT An imager that includes a pixel array with a plurality of columns having rows of pixels and with each pixel having a plurality of photodiodes and a common readout circuit that stores respective accumulation voltages from each of the plurality of photodiodes. The imager further includes row driver circuitry that controls the pixel array for pixel addressing and readout, with the row driver circuitry including a plurality of shift registers, and an image sensor controller that controls the plurality of shift registers to address the rows of pixels in the pixel array. Moreover, the row driver circuitry dynamically upward and downward shifts control signals to the pixel array, such that two rows of pixels in a single column of the pixel array are addressed during a single row time. 3 1 WSLEGAL\061775\00205\23978819v2 CA 3069858 2020-01-24
The present aspects relate to techniques of timing synchronization of audio and video (AV) data in a network. In particular, the techniques for a AV master to distribute AV data encoded with one or more time markers to a plurality of processing nodes. The one or more time markers may be indexed to a precision time protocol (PTP) time stamp used as a time reference. In one technique, the nodes extract the time markers to determine an offset value that is applied to a PLL to synchronize AV data packets at a distribution node or a processing node. In another technique the distribution node or the processing node determines the worst case path, which corresponds to a system offset value. The distribution node then reports the system offset value to the AV master, which in turn adjusts the phase based on the report.
H04L 7/033 - Speed or phase control by the received code signals, the signals containing no special synchronisation information using the transitions of the received signal to control the phase of the synchronising-signal- generating means, e.g. using a phase-locked loop
45.
Hybrid output multiplexer for a high framerate CMOS imager
An imaging system is provided that includes a pixel array having a plurality of columns with rows of pixels and with each pixel having a plurality of photodiodes and a common readout circuit that stores respective accumulation voltages from each of the plurality of photodiodes. Moreover, the system includes row driver circuitry that control the pixel array for pixel addressing and readout, such that the respective accumulation voltages of the photodiodes is read out on a readout channel coupled to a bit line column, and a hybrid multiplexer that multiplexes and routes output signals from the pixel array to a video imaging device to be displayed thereon.
H04N 5/357 - Noise processing, e.g. detecting, correcting, reducing or removing noise
H04N 5/3745 - Addressed sensors, e.g. MOS or CMOS sensors having additional components embedded within a pixel or connected to a group of pixels within a sensor matrix, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components
H04N 5/374 - Addressed sensors, e.g. MOS or CMOS sensors
H04N 5/343 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled by switching between different modes of operation using different resolutions or aspect ratios, e.g. between still and video mode or between interlaced and non-interlaced mode
H04N 5/347 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled by combining or binning pixels in SSIS
H04N 5/378 - Readout circuits, e.g. correlated double sampling [CDS] circuits, output amplifiers or A/D converters
46.
Router fabric for switching broadcast signals in a media processing network
A router fabric for switching real time broadcast video signals in a media processing network includes a logic device configured to route multiple channels of packetized video signals to another network device, a crossbar switch configured to be coupled to a plurality of input/output components and to switch video data of the multiple channels between the logic device and the plurality of input/output components in response to a control instruction, and a controller configured to map routing addresses for each video signal relative to the system clock, and to send the control instruction with the mapping to the crossbar switch and the logic device.
A system and method is provided for performing lossless switching in a redundant multicast network. An exemplary method includes receiving a primary media stream and a redundant media stream over different forwarding network paths by network ports of a receiver communicatively coupled to an A/V device. Furthermore, the receiver outputs media data of the media streams to the A/V device to be presented thereon. In response to a control signal to switch the receiver to a new primary media stream, the method disconnected either the primary ort the redundant media streams from the respective network port of the receiver receiving that stream. Furthermore, the method includes controlling the disconnected network port to receive the new primary media stream and then outputting media data of the new primary media stream to the A/V device to be presented thereon.
H04N 21/43 - Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronizing decoder's clock; Client middleware
H04N 21/438 - Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving MPEG packets from an IP network
A computing device and method for providing a user interface for summarizing and presenting information regarding dynamic provisioning and deployment of media processing resources, in a manner that is easy and intuitive and analogizes well to conventional physical media processing deployment. Users are not required to understand hypervisor configuration or virtual machine deployment, or switch through various layers and screens to find configuration information or controls, a process that may be particularly slow, complex, and difficult to learn, particularly for media and broadcast engineers unfamiliar with virtualization technologies. Instead, the present user interface improves efficiency of use of the computing environment for media processing, by providing deployment information in a format similar to physical processing deployment. Furthermore, because the user interface lends itself to intuitive monitoring and use, users may more accurately and efficiently deploy and undeploy processing resources, reducing overall system processing requirements, cost, and power consumption.
A system is provided for synchronizing video clips with audio data. The system includes one or more video capture devices that captures audio and video data of a scene, and a data store for the audio data, the metadata, and the video data generated by each respective capture device. Moreover, the system includes an audio analyzer that analyzes the audio data to determine one or more groups of overlapping video clips in the video data and to generate offset information for each video clip in the one or more groups. A metadata analyzer then corrects the one or more groups of the overlapping video clips based on camera identification data, and a sequence generator generates a plurality of video sequences with synchronized audio, based on the corrected one or more groups.
A system is provided for synchronizing video clips with audio data. The system includes one or more video capture devices that captures audio and video data of a scene, and a data store for the audio data, the metadata, and the video data generated by each respective capture device. Moreover, the system includes an audio analyzer that analyzes the audio data to determine one or more groups of overlapping video clips in the video data and to generate offset information for each video clip in the one or more groups. A metadata analyzer then corrects the one or more groups of the overlapping video clips based on camera identification data, and a sequence generator generates a plurality of video sequences with synchronized audio, based on the corrected one or more groups.
A system and method is provided for performing high dynamic range digital double sampling. More particularly, a CMOS image sensor is provided that includes a pixel array with each pixel sampling both dark and bright values for digital double sampling. After the sampled signals are digitized, a mean dark value is determined and each dark value is further fed to a lookup table that generates an output value taking into account whether the pixel has been saturated. In over exposed conditions, the lookup table will generate a negative value output to eliminate image artifacts. All three values are fed to adder logic circuit that subtracts the mean dark value and the lookup table output from the bright value. This resulting output is fed to a video viewer.
H04N 5/359 - Noise processing, e.g. detecting, correcting, reducing or removing noise applied to excess charges produced by the exposure, e.g. smear, blooming, ghost image, crosstalk or leakage between pixels
H04N 5/363 - Noise processing, e.g. detecting, correcting, reducing or removing noise applied to reset noise, e.g. KTC noise
H04N 5/374 - Addressed sensors, e.g. MOS or CMOS sensors
H04N 5/378 - Readout circuits, e.g. correlated double sampling [CDS] circuits, output amplifiers or A/D converters
H04N 5/361 - Noise processing, e.g. detecting, correcting, reducing or removing noise applied to dark current
An apparatus includes a separator for selectively separating audio from input signals including video with audio, a switcher for selectively transferring the input signals to at least one output, a multiplexed path for sending the separated audio signal to the at least one output, the at least one output being configured for selectively directing the input signals and separated audio signals.
A system and method is provided for minimizing delay time for controlling media content capture during live video broadcast production. The system includes a video production receiver that receives media content streams from one or more cameras that includes live media content captured by the cameras and encoded in a first encoding format. Moreover, a multi-view interface displays the media content and a video production controller generates control instructions based on inputs to the interface to change operation of the cameras capturing the respective media content. A camera controller is included that transmits the generated control instructions to the cameras to change the operation for capturing the respective media content. Moreover, the video production controls production of a live video stream for video broadcast production using media content that is captured from the cameras and that is encoded in a second encoding format different than the first encoding format.
H04N 21/218 - Source of audio or video content, e.g. local disk arrays
H04N 21/222 - Secondary servers, e.g. proxy server or cable television Head-end
H04N 21/8547 - Content authoring involving timestamps for synchronizing content
H04N 21/242 - Synchronization processes, e.g. processing of PCR [Program Clock References]
H04N 21/234 - Processing of video elementary streams, e.g. splicing of video streams or manipulating MPEG-4 scene graphs
H04N 21/2343 - Processing of video elementary streams, e.g. splicing of video streams or manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
H04N 21/262 - Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission or generating play-lists
A system is provided for partial matching of settings across cameras. The system includes a camera setting controller that controls control elements of a target camera for capturing video content of a scene. Moreover, a transfer module detects a request to transfer settings from a reference camera to the target camera and a look determiner determines a look of a scene of the video content being captured by the at least one target camera. The transfer module retrieves the control elements of the reference camera and related image capture control settings that correspond to the obtained image capture control settings of the at least one target camera. The transfer module then transfers the image capture control settings of the control elements from the reference camera to the target camera, such that the settings are applied to the target camera to modify the capturing of video content of the scene, so that a the scenes captured give a similar impression to a viewer.
An image capture control apparatus is provided for single-handed seamless camera control of a camera during capture of video content. The apparatus includes a stick extending from a base and operating bi-directionally to adjust a setting of the camera. Moreover, first, second and third continuous control elements are disposed around the base to control respective parameters of the camera for image content capture. Each of the first continuous control element, the second continuous control element and the third continuous control element are configured to be physically manipulated simultaneously by a hand of an operator of the single-handed seamless camera.
A system is provided for determining equivalence to execute a task. The system includes an identity module that obtains a unique identity for each of a plurality of resources, and a metadata collection module that collects metadata information relating to the plurality of resources based on the obtained unique identifier for each resource, and that stores the collected metadata information in a metadata database, with the metadata information relating to capabilities of the respective resource for executing the task. Moreover, the system includes an equivalence processor that determines a set of resources of the plurality of resources that are configured to execute the task defined by a requesting client device in an equivalent manner based on the collected metadata information of the at least one set of resources.
A system is provided for live video production and asset management that includes an orchestration software and platform that uses artificial intelligence or machine learning to automate show rundown and playlist assembly based on social topical trends, historical and predictive content and associated advertising performance by type and consumer demographics by platform viewership. The system and method provides an automated lineup (or suggested lineup that can be modified by the producer) of the best predictive performance results rather than solely based on experience of the producer himself or herself.
H04N 21/262 - Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission or generating play-lists
H04N 21/24 - Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth or upstream requests
H04N 21/258 - Client or end-user data management, e.g. managing client capabilities, user preferences or demographics or processing of multiple end-users preferences to derive collaborative data
H04N 21/85 - Assembly of content; Generation of multimedia applications
60.
System and method of identifying equivalents for task completion
A system is provided for determining equivalence to execute a task. The system includes an identity module that obtains a unique identity for each of a plurality of resources, and a metadata collection module that collects metadata information relating to the plurality of resources based on the obtained unique identifier for each resource, and that stores the collected metadata information in a metadata database, with the metadata information relating to capabilities of the respective resource for executing the task. Moreover, the system includes an equivalence processor that determines a set of resources of the plurality of resources that are configured to execute the task defined by a requesting client device in an equivalent manner based on the collected metadata information of the at least one set of resources.
A system is provided for live video production and asset management that includes an orchestration software and platform that uses artificial intelligence or machine learning to automate show rundown and playlist assembly based on social topical trends, historical and predictive content and associated advertising performance by type and consumer demographics by platform viewership. The system and method provides an automated lineup (or suggested lineup that can be modified by the producer) of the best predictive performance results rather than solely based on experience of the producer himself or herself.
H04N 21/262 - Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission or generating play-lists
H04N 21/24 - Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth or upstream requests
H04N 21/258 - Client or end-user data management, e.g. managing client capabilities, user preferences or demographics or processing of multiple end-users preferences to derive collaborative data
H04N 21/85 - Assembly of content; Generation of multimedia applications
62.
SYSTEM AND METHOD OF IDENTIFYING EQUIVALENTS FOR TASK COMPLETION
A system is provided for determining equivalence to execute a task. The system includes an identity module that obtains a unique identity for each of a plurality of resources, and a metadata collection module that collects metadata information relating to the plurality of resources based on the obtained unique identifier for each resource, and that stores the collected metadata information in a metadata database, with the metadata information relating to capabilities of the respective resource for executing the task. Moreover, the system includes an equivalence processor that determines a set of resources of the plurality of resources that are configured to execute the task defined by a requesting client device in an equivalent manner based on the collected metadata information of the at least one set of resources.
A system is provided for partial matching of settings across cameras. The system includes a camera setting controller that controls control elements of a target camera for capturing video content of a scene. Moreover, a transfer module detects a request to transfer settings from a reference camera to the target camera and a look determiner determines a look of a scene of the video content being captured by the at least one target camera. The transfer module retrieves the control elements of the reference camera and related image capture control settings that correspond to the obtained image capture control settings of the at least one target camera. The transfer module then transfers the image capture control settings of the control elements from the reference camera to the target camera, such that the settings are applied to the target camera to modify the capturing of video content of the scene.
An image capture control apparatus is provided for single-handed seamless camera control of a camera during capture of video content. The apparatus includes a stick extending from a base and operating bi-directionally to adjust a setting of the camera. Moreover, first, second and third continuous control elements are disposed around the base to control respective parameters of the camera for image content capture. Each of the first continuous control element, the second continuous control element and the third continuous control element are configured to be physically manipulated simultaneously by a hand of an operator of the single-handed seamless camera.
An editing apparatus for an editing video sequence that includes an editing unit for setting a first range to one part of the video sequence; a video sequence file generating unit for generating a video sequence file including video sequence corresponding to the first range and video sequence corresponding to a second range, within the second range is consecutively preceding to and/or subsequent to the first range; and an output for outputting the video sequence file.
A system and method that splices an initial 3D LUT for imaging format conversion into a plurality of smaller LUTs that can be stored in separate RAMs. During operation, the upper 5-bits serve as index values of each component of an incoming GBR pixel and are used to determine which of the smaller RAMs contain the correct index values for the pixel data. Specifically, a first index value can be derived from the incoming GBR pixel data and used to lookup all sub-cube vertices corresponding to the incoming pixel and the corresponding RAMs. After determining the correct RAMs, a predetermined algorithm for each given RAM is applied to find the normalized RAM look-up addresses and identify the correct data for the exemplary imaging format conversion process.
A system and method that recognizes and highlights objects in a video frame for augmented video production workflow. Ae video production camera is provided to capture a video frame and generate frame data and object data relating to objects within the video frame that are in focus. Moreover, a display device is included that is wearable by the camera operator and includes a camera that captures field of view data that corresponds to a field of view of the camera operator. Furthermore, the display device can compare the video frame data with the field of view data captured by the camera to generate visual indicators for the video frame and the in focus objects. As a result, the display device can provide the camera operator with a field of view having visual indicators of the video frame and the objects that appears as overlays over the operator's field of view.
An image processor is provided for correcting brightness of saturated pixels of a captured image. The image processor can include a pixel saturation determiner that whether one or more pixels in an image sensor have been saturated by comparing pixel brightness levels of the pixels to a predetermined saturation threshold. Moreover, the image processor includes an image enhancer that generates a corrected image without artifacts due to the saturated pixel(s) by replacing the pixel brightness of the saturated pixel(s) with a pixel correction value that is based on a pixel brightness of one or more unsaturated pixel in the image sensor.
H04N 5/243 - Circuitry for compensating for variation in the brightness of the object by influencing the picture signal
H04N 5/365 - Noise processing, e.g. detecting, correcting, reducing or removing noise applied to fixed-pattern noise, e.g. non-uniformity of response
H04N 5/235 - Circuitry for compensating for variation in the brightness of the object
H04N 5/341 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled
H04N 5/357 - Noise processing, e.g. detecting, correcting, reducing or removing noise
The present aspects relate to techniques of timing synchronization of audio and video (AV) data in a network. In particular, the techniques for a AV master to distribute AV data encoded with one or more time markers to a plurality of processing nodes. The one or more time markers may be indexed to a precision time protocol (PTP) time stamp used as a time reference. In one technique, the nodes extract the time markers to determine an offset value that is applied to a PLL to synchronize AV data packets at a distribution node or a processing node. In another technique the distribution node or the processing node determines the worst case path, which corresponds to a system offset value. The distribution node then reports the system offset value to the AV master, which in turn adjusts the phase based on the report.
H04L 7/033 - Speed or phase control by the received code signals, the signals containing no special synchronisation information using the transitions of the received signal to control the phase of the synchronising-signal- generating means, e.g. using a phase-locked loop
An imager that includes a pixel array with a plurality of columns having rows of pixels and with each pixel having a plurality of photodiodes and a common readout circuit that stores respective accumulation voltages from each of the plurality of photodiodes. The imager further includes row driver circuitry that controls the pixel array for pixel addressing and readout, with the row driver circuitry including a plurality of shift registers, and an image sensor controller that controls the plurality of shift registers to address the rows of pixels in the pixel array. Moreover, the row driver circuitry dynamically upward and downward shifts control signals to the pixel array, such that two rows of pixels in a single column of the pixel array are addressed during a single row time.
H04N 5/3745 - Addressed sensors, e.g. MOS or CMOS sensors having additional components embedded within a pixel or connected to a group of pixels within a sensor matrix, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components
H04N 5/357 - Noise processing, e.g. detecting, correcting, reducing or removing noise
H04N 5/232 - Devices for controlling television cameras, e.g. remote control
H04N 5/343 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled by switching between different modes of operation using different resolutions or aspect ratios, e.g. between still and video mode or between interlaced and non-interlaced mode
H04N 5/347 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled by combining or binning pixels in SSIS
H04N 5/378 - Readout circuits, e.g. correlated double sampling [CDS] circuits, output amplifiers or A/D converters
71.
Hybrid output multiplexer for a high framerate CMOS imager
An imaging system is provided that includes a pixel array having a plurality of columns with rows of pixels and with each pixel having a plurality of photodiodes and a common readout circuit that stores respective accumulation voltages from each of the plurality of photodiodes. Moreover, the system includes row driver circuitry that control the pixel array for pixel addressing and readout, such that the respective accumulation voltages of the photodiodes is read out on a readout channel coupled to a bit line column, and a hybrid multiplexer that multiplexes and routes output signals from the pixel array to a video imaging device to be displayed thereon.
H04N 5/3745 - Addressed sensors, e.g. MOS or CMOS sensors having additional components embedded within a pixel or connected to a group of pixels within a sensor matrix, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components
H04N 5/357 - Noise processing, e.g. detecting, correcting, reducing or removing noise
H04N 5/232 - Devices for controlling television cameras, e.g. remote control
H04N 5/374 - Addressed sensors, e.g. MOS or CMOS sensors
H04N 5/343 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled by switching between different modes of operation using different resolutions or aspect ratios, e.g. between still and video mode or between interlaced and non-interlaced mode
H04N 5/347 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled by combining or binning pixels in SSIS
H04N 5/378 - Readout circuits, e.g. correlated double sampling [CDS] circuits, output amplifiers or A/D converters
72.
System and method for controlling media content capture for live video broadcast production
A system and method is provided for minimizing delay time for controlling media content capture during live video broadcast production. The system includes a video production receiver that receives media content streams from one or more cameras that includes live media content captured by the cameras and encoded in a first encoding format. Moreover, a multi-view interface displays the media content and a video production controller generates control instructions based on inputs to the interface to change operation of the cameras capturing the respective media content. A camera controller is included that transmits the generated control instructions to the cameras to change the operation for capturing the respective media content. Moreover, the video production controls production of a live video stream for video broadcast production using media content that is captured from the cameras and that is encoded in a second encoding format different than the first encoding format.
H04N 21/242 - Synchronization processes, e.g. processing of PCR [Program Clock References]
H04N 21/218 - Source of audio or video content, e.g. local disk arrays
H04N 21/8547 - Content authoring involving timestamps for synchronizing content
H04N 21/234 - Processing of video elementary streams, e.g. splicing of video streams or manipulating MPEG-4 scene graphs
H04N 21/2343 - Processing of video elementary streams, e.g. splicing of video streams or manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
H04N 21/262 - Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission or generating play-lists
A system and method is provided for timely and uniform real-time data packet transmission by a computing device. The system can include a shared packet memory buffer for storing data packets generated by a user application and a shared schedule memory buffer for storing packet identifiers and corresponding time slots for the data packets. Moreover, a kernel module is provided that operates in the kernel mode of the operating system directly above the network interface controller and can continuously poll the shared scheduled memory to access packet identifiers at corresponding time slots. Based on the packet identifiers in each time slot, the kernel module can pull the data packet having the packet identifier directly from the ring buffer and send each packet to the network interface controller for transmission as part of a media stream over a network to a media consuming device.
An apparatus for HDR image processing is provided. The apparatus determines an imaging sensitivity value. The apparatus then compares subsets of imaging information with the determined imaging sensitivity value and applies a gamma correction to each subset of imaging information using a gamma low contrast curve or a gamma high contrast curve based on the comparison to obtain the gamma corrected subset of imaging information.
A system and method is provided for performing high dynamic range digital double sampling. More particularly, a CMOS image sensor is provided that includes a pixel array with each pixel sampling both dark and bright values for digital double sampling. After the sampled signals are digitized, a mean dark value is determined and each dark value is further fed to a lookup table that generates an output value taking into account whether the pixel has been saturated. In over exposed conditions, the lookup table will generate a negative value output to eliminate image artifacts. All three values are fed to adder logic circuit that subtracts the mean dark value and the lookup table output from the bright value. This resulting output is fed to a video viewer.
H04N 5/359 - Noise processing, e.g. detecting, correcting, reducing or removing noise applied to excess charges produced by the exposure, e.g. smear, blooming, ghost image, crosstalk or leakage between pixels
H04N 5/363 - Noise processing, e.g. detecting, correcting, reducing or removing noise applied to reset noise, e.g. KTC noise
H04N 5/374 - Addressed sensors, e.g. MOS or CMOS sensors
H04N 5/378 - Readout circuits, e.g. correlated double sampling [CDS] circuits, output amplifiers or A/D converters
H04N 5/361 - Noise processing, e.g. detecting, correcting, reducing or removing noise applied to dark current
76.
System and method for scalable physical layer flow of packetized media streams
A media stream receiver is provided for scalable physical layer flow of packetized media streams. The media stream receiver replicates the processing block in time, rather than in hardware, through the use of a single shared memory and pointer alignment calculations, which combines multiple buffering stages as the single, shared memory buffer to offer redundancy and alignment, while acting as a receiver buffer to account for packet delay variations. By doing so the media stream receiver can perform a vertical interval switch between received media streams.
H04N 21/43 - Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronizing decoder's clock; Client middleware
H04N 21/4385 - Multiplex stream processing, e.g. multiplex stream decrypting
H04N 21/4402 - Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
H04L 29/06 - Communication control; Communication processing characterised by a protocol
77.
SYSTEM AND METHOD FOR MAPPED SPLICING OF A THREE-DIMENSIONAL LOOK-UP TABLE FOR IMAGE FORMAT CONVERSION
A system and method that splices an initial 3D LUT for imaging format conversion into a plurality of smaller LUTs that can be stored in separate RAMs. During operation, the upper 5-bits serve as index values of each component of an incoming GBR pixel and are used to determine which of the smaller RAMs contain the correct index values for the pixel data. Specifically, a first index value can be derived from the incoming GBR pixel data and used to lookup all sub-cube vertices corresponding to the incoming pixel and the corresponding RAMs. After determining the correct RAMs, a predetermined algorithm for each given RAM is applied to find the normalized RAM look-up addresses and identify the correct data for the exemplary imaging format conversion process.
G09G 5/06 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the way in which colour is displayed using colour palettes, e.g. look-up tables
H04N 19/59 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
A system and method that splices an initial 3D LUT for imaging format conversion into a plurality of smaller LUTs that can be stored in separate RAMs. During operation, the upper 5-bits serve as index values of each component of an incoming GBR pixel and are used to determine which of the smaller RAMs contain the correct index values for the pixel data. Specifically, a first index value can be derived from the incoming GBR pixel data and used to lookup all sub-cube vertices corresponding to the incoming pixel and the corresponding RAMs. After determining the correct RAMs, a predetermined algorithm for each given RAM is applied to find the normalized RAM look-up addresses and identify the correct data for the exemplary imaging format conversion process.
The present disclosure is directed to a single card solid-state play out server for retrieving or receiving content from a network or cloud based storage, and playing content according to an automated playlist received from a media distribution and management system.
H04L 29/06 - Communication control; Communication processing characterised by a protocol
H04N 21/222 - Secondary servers, e.g. proxy server or cable television Head-end
H04N 21/262 - Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission or generating play-lists
H04N 21/231 - Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers or prioritizing data for deletion
H04N 21/2387 - Stream processing in response to a playback request from an end-user, e.g. for trick-play
A method and system for providing access to and control of parameters within a scenegraph includes redefining components or nodes' semantic within a scenegraph. The set of components or nodes (depending on the scenegraph structure) are required to enable access from the Application User Interface to selected scenegraph information. In one embodiment, a user interface is generated for controlling the scenegraph parameters. In addition, constraints can be implemented that allow or disallow access to certain scenegraph parameters and restrict their range of values.
An editing apparatus for an editing video sequence that includes an editing unit for setting a first range to one part of the video sequence; a video sequence file generating unit for generating a video sequence file including video sequence corresponding to the first range and video sequence corresponding to a second range, within the second range is consecutively preceding to and/or subsequent to the first range; and an output for outputting the video sequence file.
H04N 9/80 - Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
G06F 3/00 - Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
G06F 13/00 - Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
A router fabric for switching real time broadcast video signals in a media processing network includes a logic device configured to route multiple channels of packetized video signals to another network device, a crossbar switch configured to be coupled to a plurality of input/output components and to switch video data of the multiple channels between the logic device and the plurality of input/output components in response to a control instruction, and a controller configured to map routing addresses for each video signal relative to the system clock, and to send the control instruction with the mapping to the crossbar switch and the logic device.
A router fabric for switching real time broadcast video signals in a media processing network includes a logic device configured to route multiple channels of packetized video signals to another network device, a crossbar switch configured to be coupled to a plurality of input/output components and to switch video data of the multiple channels between the logic device and the plurality of input/output components in response to a control instruction, and a controller configured to map routing addresses for each video signal relative to the system clock, and to send the control instruction with the mapping to the crossbar switch and the logic device.
A router fabric for switching real time broadcast video signals in a media processing network includes a logic device configured to route multiple channels of packetized video signals to another network device, a crossbar switch configured to be coupled to a plurality of input/output components and to switch video data of the multiple channels between the logic device and the plurality of input/output components in response to a control instruction, and a controller configured to map routing addresses for each video signal relative to the system clock, and to send the control instruction with the mapping to the crossbar switch and the logic device.
A method for performing differential double sampling and a CMOS image sensing device for performing the same. In one example, the CMOS image sensing device includes a pixel array include a multitude of pixels with each pixel formed by a plurality of photodiodes, a floating diffusion point and a plurality of transistors electrically coupled the plurality of photodiodes. Moreover, a column readout circuit with four storage capacitors is selectively coupled to the pixel array by switches so that the storage capacitors can store sampled pixel values. A control circuit connected to the pixel array and the column readout circuit selectively activates the transistors to output to the column readout circuit sampled dark value and bright values of one photodiode and a sampled double bright value of the one photodiode and one additional photodiode.
H04N 5/374 - Addressed sensors, e.g. MOS or CMOS sensors
H04N 5/357 - Noise processing, e.g. detecting, correcting, reducing or removing noise
H04N 5/363 - Noise processing, e.g. detecting, correcting, reducing or removing noise applied to reset noise, e.g. KTC noise
H04N 5/345 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled by partially reading an SSIS array
H04N 5/3745 - Addressed sensors, e.g. MOS or CMOS sensors having additional components embedded within a pixel or connected to a group of pixels within a sensor matrix, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components
H04N 5/378 - Readout circuits, e.g. correlated double sampling [CDS] circuits, output amplifiers or A/D converters
Disclosed herein are systems and methods for controlling luminance during video production and broadcast. An exemplary system includes a camera to capture video content in a first imaging range, a histogram calculator to evaluate luminance in each pixel in the captured video content, and to generate a luminance histogram for the captured video content, a user interface generator that generates a user interface displaying the video content overlaid with the luminance histogram and generates a user interface displaying a light intensity curve and adjustable parameters for converting the first range into a second range, a luminance controller to convert luminance of the video content into the second imaging range based on the light intensity curve, and a broadcast controller to encode the video content with the second imaging range into broadcast range for transmitting to one or more endpoint devices.
H04N 21/44 - Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to MPEG-4 scene graphs
H04N 5/20 - Circuitry for controlling amplitude response
An apparatus for HDR image processing is provided. The apparatus determines an imaging sensitivity value. The apparatus then compares subsets of imaging information with the determined imaging sensitivity value and applies a gamma correction to each subset of imaging information using a gamma low contrast curve or a gamma high contrast curve based on the comparison to obtain the gamma corrected subset of imaging information.
An IP router capable of isochronous switching of a packetized media stream. According to an example, the IP router parses the RTP header within an incoming IP datagram to extract the RTP time stamp, which provides a time value for a unique IP Flow. By inspecting the header, the IP router can switch the flow at the point in time that the RTP time stamp value changes, or matches a target value. In one aspect, the IP router looks for the change in the RTP time stamp value and performs the switch based on the detected change. In another aspect, the IP router performs the switch at a specified time stamp value that can be unique to a group of signals or based on a common “sync” value published to all the ports of the IP router.
A network apparatus and a content distribution apparatus are described. The network apparatus is configured to transcode and transmit pre-broadcast content into transcoded content according to a format associated with a content distribution apparatus. The transcoded content includes a distribution indicator to restrict distribution of the transcoded content to one or more remote apparatus. Network apparatus is configured to transmit a “delta file” to content distribution apparatus with transcoded content and instructions to signal modifying the pre-broadcast content. Content distribution apparatus is configured to receive transcoded pre-broadcast content and “delta file” with instructions from network apparatus. Content distribution apparatus removes the distribution indicator from the transcoded pre-broadcast content once the signaling instructions indicates that the broadcast content corresponds with pre-broadcast content. Content distribution apparatus may use the “delta file” to modify the transcoded pre-broadcast content such that the modified pre-broadcast content corresponds with broadcast content with a tolerance.
H04N 21/472 - End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification or for manipulating displayed content
H04N 21/4402 - Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
A method and apparatus for enhancing digital video effects (DVE) operates to embed DVE functionality within a graphics modeling system and provides the user with an interface configured to present model elements to a user as controllable parameters. In order to embed DVE functionality, a dynamic data structure is introduced as a scene to allow the addition of user defined model elements. The user interface enables the identification of, and access to the newly introduced model elements.
G06F 3/0484 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
An image sensor that provides global shutter scanning with exposure time control during image capture. The image sensor includes a pixel array with shared pixel units that each include four photodiodes with a floating diffusion node shared therebetween and respective global shutter gates disposed between each photodiode and a supply voltage of the pixel array. Moreover, an image capture timing controller controls an exposure time of each photodiode by adjusting a width of a global shutter reset pulse applied to the plurality of global shutter gates after each readout cycle during image capture to change the respective exposure time of each shared pixel unit.
H04N 5/347 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled by combining or binning pixels in SSIS
92.
SHARED PHOTODIODE RESET IN A 5 TRANSISTOR - FOUR SHARED PIXEL
An image sensor that provides global shutter scanning with exposure time control during image capture. The image sensor includes a pixel array with shared pixel units that each include four photodiodes with a floating diffusion node shared therebetween and respective global shutter gates disposed between each photodiode and a supply voltage of the pixel array. Moreover, an image capture timing controller controls an exposure time of each photodiode by adjusting a width of a global shutter reset pulse applied to the plurality of global shutter gates after each readout cycle during image capture to change the respective exposure time of each shared pixel unit.
A system and method is provided for timely and uniform real-time data packet transmission by a computing device. The system can include a shared packet memory buffer for storing data packets generated by a user application and a shared schedule memory buffer for storing packet identifiers and corresponding time slots for the data packets. Moreover, a kernel module is provided that operates in the kernel mode of the operating system directly above the network interface controller and can continuously poll the shared scheduled memory to access packet identifiers at corresponding time slots. Based on the packet identifiers in each time slot, the kernel module can pull the data packet having the packet identifier directly from the ring buffer and send each packet to the network interface controller for transmission as part of a media stream over a network to a media consuming device.
H04L 67/60 - Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
H04L 69/16 - Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
H04L 69/321 - Interlayer communication protocols or service data unit [SDU] definitions; Interfaces between layers
H04L 69/322 - Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions
H04L 69/329 - Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions in the application layer [OSI layer 7]
94.
System and method for timely and uniform distribution for real-time packet transmission
A system and method is provided for timely and uniform real-time data packet transmission by a computing device. The system can include a shared packet memory buffer for storing data packets generated by a user application and a shared schedule memory buffer for storing packet identifiers and corresponding time slots for the data packets. Moreover, a kernel module is provided that operates in the kernel mode of the operating system directly above the network interface controller and can continuously poll the shared scheduled memory to access packet identifiers at corresponding time slots. Based on the packet identifiers in each time slot, the kernel module can pull the data packet having the packet identifier directly from the ring buffer and send each packet to the network interface controller for transmission as part of a media stream over a network to a media consuming device.
An image sensor that provides global shutter scanning with exposure time control during image capture. The image sensor includes a pixel array with shared pixel units that each include four photodiodes with a floating diffusion node shared therebetween and respective global shutter gates disposed between each photodiode and a supply voltage of the pixel array. Moreover, an image capture timing controller controls an exposure time of each photodiode by adjusting a width of a global shutter reset pulse applied to the plurality of global shutter gates after each readout cycle during image capture to change the respective exposure time of each shared pixel unit.
H04N 5/378 - Readout circuits, e.g. correlated double sampling [CDS] circuits, output amplifiers or A/D converters
H04N 5/347 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled by combining or binning pixels in SSIS
H04N 5/343 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled by switching between different modes of operation using different resolutions or aspect ratios, e.g. between still and video mode or between interlaced and non-interlaced mode
H04N 5/3745 - Addressed sensors, e.g. MOS or CMOS sensors having additional components embedded within a pixel or connected to a group of pixels within a sensor matrix, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components
A focus assist circuit for a viewfinder, including a video amplifier configured to amplify a video signal, a video gain controller configured to adjust gain of the video amplifier to provide peaking headroom, and a peaking processor configured to adjust the amplified video signal. The focus assist circuitry may facilitate focusing a camera lens by proving peaking headroom for a peaking signal that is combined with an amplified signal. The peaking headroom limits the gain applied to a video signal in order to reduce distortions in the peaks. A user interface may include input controls configured to limit the gain of the of a video amplifier.
H04N 5/208 - Circuitry for controlling amplitude response for correcting amplitude versus frequency characteristic for compensating for attenuation of high frequency components, e.g. crispening, aperture distortion correction
97.
System and method for augmented video production workflow
A system and method that recognizes and highlights objects in a video frame for augmented video production workflow. A video production camera is provided to capture a video frame and generate frame data and object data relating to objects within the video frame that are in focus. Moreover, a display device is included that is wearable by the camera operator and includes a camera that captures field of view data that corresponds to a field of view of the camera operator. Furthermore, the display device can compare the video frame data with the field of view data captured by the camera to generate visual indicators for the video frame and the in focus objects. As a result, the display device can provide the camera operator with a field of view having visual indicators of the video frame and the objects that appears as overlays over the operator's field of view.
A computing device and method for providing a user interface for summarizing and presenting information regarding dynamic provisioning and deployment of media processing resources, in a manner that is easy and intuitive and analogizes well to conventional physical media processing deployment. Users are not required to understand hypervisor configuration or virtual machine deployment, or switch through various layers and screens to find configuration information or controls, a process that may be particularly slow, complex, and difficult to learn, particularly for media and broadcast engineers unfamiliar with virtualization technologies. Instead, the present user interface improves efficiency of use of the computing environment for media processing, by providing deployment information in a format similar to physical processing deployment. Furthermore, because the user interface lends itself to intuitive monitoring and use, users may more accurately and efficiently deploy and undeploy processing resources, reducing overall system processing requirements, cost, and power consumption.
G06F 3/0484 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
G06F 9/451 - Execution arrangements for user interfaces
G06F 3/0483 - Interaction with page-structured environments, e.g. book metaphor
G06F 9/50 - Allocation of resources, e.g. of the central processing unit [CPU]
H04L 12/911 - Network admission control and resource allocation, e.g. bandwidth allocation or in-call renegotiation
G06F 3/06 - Digital input from, or digital output to, record carriers
G06F 9/455 - Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
G06F 17/00 - Digital computing or data processing equipment or methods, specially adapted for specific functions
99.
SYSTEM AND METHOD FOR CREATING METADATA MODEL TO IMPROVE MULTI-CAMERA PRODUCTION
A system and method is provided for using camera metadata from multiple cameras in a live environment to improve video production workflow. Each camera of the system is provided to media content of a live scene and store camera metadata that includes camera lens, position and gyro setting. This metadata can then be provided to other cameras in the system and/or a control that can generate a 3D metadata feed using the camera metadata. Moreover, based on the metadata feed, control instructions can be generated and transmitted to one or more of the cameras to control camera operations for capturing the media content.
A system and method that recognizes and highlights objects in a video frame for augmented video production workflow. Ae video production camera is provided to capture a video frame and generate frame data and object data relating to objects within the video frame that are in focus. Moreover, a display device is included that is wearable by the camera operator and includes a camera that captures field of view data that corresponds to a field of view of the camera operator. Furthermore, the display device can compare the video frame data with the field of view data captured by the camera to generate a visual indicator for the video frame, and can use the in focus object data to generate visual indicators for the in focus objects. As a result, the display device can provide the camera operator with a field of view having visual indicators of the video frame and the objects that appear as overlays over the operator's field of view.
