A method is disclosed that comprises training encoder and decoder neural networks to learn encoder and decoder parameters, wherein the method comprises, during training, quantizing and freezing learned decoder parameters decoding layer per decoding layer at different epochs.
In one implementation, we propose a bitwise octree coding approach based on deep neural networks and operations on 3D sparse tensors. To encode/decode a certain level of detail (LoD) in an octree, geometric features are first inherited from the previous LoD by upsampling. Then based on the already encoded/decoded voxels, the point cloud geometry is firstly refined by pruning, followed by combining with the known context information. In the end, feature aggregation and probability estimation can be applied to obtain the occupancy probabilities for actual arithmetic encoding/decoding. A corresponding probabilistic training strategy is also proposed for our bitwise octree coding approach.
Viewport- and/or region-of-interest-dependent delivery of V3C data may be performed using RTF, RTP/RTCP signaling may support spatial region based and/or viewport-based partial access of V3C content. An SDP parameter may signal static 3D regions In immersive media content. An RTCP FB message type may carry 3D region of interest request during an RTP media transmission session. An SDP parameter may indicate an RTCP-based ability to request a desired 3D region during capability negotiations. An RTP header extension type may carry transmitted 3D regions information during RTP transmission of immersive media. An SDP parameter may indicate an RTP-based ability to signal transmitted 3D region information during capability negotiations. An SDP parameter may indicate an RTP-based ability to signal updated 3D region information during capability negotiations. An RTCP FB message type may carry viewport information during an RTP media transmission session. An SDP parameter may indicate RTCP-based capability to signal viewport information during capability negotiations.
At least a method and an apparatus are presented for efficiently encoding or decoding video using neural networks wherein the bitstream is adapted to hybrid machine/human vision applications. For example, the scalable decoding comprises applying to a tensor of reconstructed data a neural network-based feature synthesis processing to generate a tensor of input feature representative of a feature of image data samples, resizing the tensor of input feature to generate a tensor of output feature intended to be fed a neural network-based vision inference processing to generate a collection of inference results. Advantageously, resizing the tensor of input feature adapt at least a dimension of the tensor of input feature to the neural network-based vision inference processing.
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
H04N 19/33 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the spatial domain
H04N 19/187 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer
H04N 19/85 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
An end-to-end neural network-based rate control method based on reinforcement learning implements video codec embodiments. In one embodiment, the codec environment is based on an Asymmetric Gained Variational Auto-Encoder (AG-VAE) architecture. A Reinforcement Learning (RL) agent is implemented through a deep convolutional neural network. In an embodiment, the RL agent conveys a choice of gain vector to the AG-VAE codec and receives reward data from the AG-VAE environment. Rate control is optimized over a period of frames, such as a Group of Pictures (GOP).
H04N 19/147 - Data rate or code amount at the encoder output according to rate distortion criteria
H04N 19/177 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
6.
VIDEO COMPRESSION FOR BOTH MACHINE AND HUMAN CONSUMPTION USING A HYBRID FRAMEWORK
In one implementation, we propose a scalable framework where a base layer uses NN-based methods to compress the content for computer vision machine tasks and enhancement layer(s) use traditional predictive coding for human viewing. Typically, the based layer performs NN-based analysis to generate a latent tensor, which is entropy coded to produce the base layer bitstream. By performing synthesis on the latent tensor, an inter-layer predictor can be obtained for the enhancement layer(s). Since many machine tasks are not required to be performed for each frame, the base layer may skip analysis for some frames. The synthesis may be performed at the base layer or the enhancement layer(s). In one example, the base layer compresses features optimized for a machine task and the enhancement layer(s) rely on predictive coding. In another example, the enhancement layer(s) can use traditional scalable video compression methods.
H04N 19/30 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
H04N 19/103 - Selection of coding mode or of prediction mode
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/187 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer
Some embodiments of a method may include a learning-based point cloud geometry processing block method, the method including: accessing a first feature map, wherein the first feature map has a quantity of C channels and is an input to the processing block, and wherein the first feature map is generated by a first set of neural network layers; accessing a set of distribution parameters; transforming the first feature map to a second feature map based on the set of distribution parameters; and encoding the second feature map into a bitstream. These example processes may be applicable to both the encoder and the decoder of an AI-based point cloud compression (PCC) framework.
A device may access a set of occupancy bits of the neighboring voxels at a current level of detail (LoD) that are already encoded or decoded, using a tree-based point cloud decoder. The device may compute a feature, using a neural network module, based on the accessed voxels. The device may access a deep feature vector from a previous LoD. The device may combine the two features using another neural network module to obtain a new combined feature. The device may concatenate the new combined feature along with the known features of the current voxels to be encoded or decoded to compose a new comprehensive feature. The device may predict the probability distribution of the occupancy of voxels at the current LoD based on the comprehensive feature using yet another neural network module. One or more of the neural network modules may be convolution based neural network modules.
H04N 19/91 - Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
H04N 19/30 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
In one implementation, we propose an end-to-end image video compression method that decomposes the spatial frequencies of the input content into a partitioned latent representation. Decomposed frequencies in the latent space are analyzed and grouped into separate latent representation or separate tensors, each tensor being jointly optimized to be decoded independently one from another. Therefore, the decoder can independently decode the tensors in a scalable manner to progressively reconstruct the input. This method enables quality scalability by progressively transmitting individual latent representations of decomposed frequency data, separated in the produced latent space. Furthermore, the quality scalability of region of interest (ROI) is enabled by which the decoder takes only corresponding latent representations in the enhancement tensors as input together with latent representations already delivered to the decoder.
H04N 19/63 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets
H04N 19/61 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
H04N 19/17 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
H04N 19/167 - Position within a video image, e.g. region of interest [ROI]
H04N 19/132 - Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
H04N 19/36 - Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability
10.
UNSUPERVISED 3D POINT CLOUD DISTILLATION AND SEGMENTATION
In one implementation, we propose an unsupervised point cloud primitive learning method based on the principle of analysis by synthesis. In one example, the method uses a partitioning network and a point cloud autoencoder. The partitioning network partitions an input point cloud into a list of chunks. For each chunk, an encoder network of the autoencoder performs analysis to output a codeword in a feature space, and a decoder network performs synthesis to reconstruct the point cloud chunk. The reconstructed chunks are merged to output a fully reconstructed point cloud frame. By end-to-end training to minimize the mismatch between the original point cloud and the reconstructed point cloud, the autoencoder discovers primitive shapes in the point cloud data. During the network training, the parameters of the partitioning network and the autoencoder are updated. The trained modules can be applied to different applications, including segmentation, detection, and compression.
G06V 10/82 - Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
H04N 19/597 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
11.
BLOCK-BASED COMPRESSION AND LATENT SPACE INTRA PREDICTION
In one implementation, we propose a block-based end-to-end image and video compression method that takes non-overlapping or overlapping split blocks of input images or frames of videos as input. Then, the proposed decoder network reconstructs non-overlapped split blocks of the input. We also introduce an intra prediction method to reduce spatial redundancy in the latent space, i.e., one or more previously decoded latent tensors from neighboring blocks are used as references to predict the current block's latent tensor. Additionally, the decoder can selectively complete the pixel reconstruction process for decoded latent blocks without causing any error drift to neighboring blocks since the prediction is made in the latent space. Enabling and disabling the pixel reconstruction can be signaled by the encoder as metadata in the bitstream or decided at the decoding stage using a computer vision task.
H04N 19/593 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
12.
SIGNALING VOLUMETRIC VISUAL VIDEO-BASED CODING CONTENT IN IMMERSIVE SCENE DESCRIPTIONS
The present system and method are directed to volumetric video representation in a scene description. The described systems and methods present a generic design to support V3C/V-PCC content. The systems and methods include the semantics as well as binary representation for decoded V3C/V-PCC media data in the form of buffers which may be used by the presentation engine for reconstruction and rendering.
H04N 21/234 - Processing of video elementary streams, e.g. splicing of video streams or manipulating MPEG-4 scene graphs
H04N 21/44 - Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to MPEG-4 scene graphs
H04N 21/443 - OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
In one implementation, we propose a lossy point cloud compression scheme to encode point cloud geometry with deep neural networks. The encoder first encodes a coarser version of the input point cloud as a bitstream. Then it represents the residual (fine geometry details) of the input point cloud as pointwise features of the encoded coarser point cloud, followed by encoding the features as the second bitstream. On the decoder side, the coarser point cloud is firstly decoded from the first bitstream. Then its pointwise features are decoded. In the end, the residual is decoded from the pointwise features and added back to the coarser point cloud, leading to a high-quality decoded point cloud. The encoding and/or decoding of the features can be further augmented with feature aggregation, such as transformer blocks.
H04N 19/33 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the spatial domain
14.
COORDINATE REFINEMENT AND UPSAMPLING FROM QUANTIZED POINT CLOUD RECONSTRUCTION
Systems, methods, and instrumentalities are disclosed for coordinate refinement and/or up- sampling from quantized point cloud reconstruction. In examples, point-based coordinate refinement may be provided. An after-decoder point cloud refinement module may include one or more of the following. The module may include accessing a decoded quantized version of a point cloud. The module may include accessing and/or fetching point(s) within a neighborhood area of each of the point(s). A feature may be computed using a point-based neural network module, for example, based on the three-dimensional (3D) (e.g., or KD) location(s) of the fetched points, e.g., that summarizes the details (e.g., intricate details). A refinement offset for the current, point may be predicted based on the comprehensive featuring using a fully connected (FC) module.
H04N 19/90 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups , e.g. fractals
15.
TEMPORAL ATTENTION-BASED NEURAL NETWORKS FOR VIDEO COMPRESSION
Systems, methods, and instrumentalities are disclosed for video encoding and/or video decoding using artificial neural networks (e.g., convolutional neural networks or recurrent neural networks), attention, and/or attention with spatial attributes. For example, an apparatus may be configured to perform one or more of the following: obtaining a context block, a current block, and a latent vector associated with the context block; performing at least one convolution on the context block, the reference block, and the latent vector; generating motion flow data associated with the current block based on the at least one convolution; or generating a bitstream the comprises an indication of the motion flow data. The motion flow data may be quantized. The generated bitstream may comprise an indication of the quantized motion flow data.
H04N 19/503 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
16.
VIEWPORT-BASED AND REGION-OF-INTEREST-BASED RETRIEVAL OF MEDIA OBJECTS IN SCENE RENDERING ENGINES
A device may receive information associated with a piuraiity of cameras where each of the cameras has an associated camera object. The device may associate a first camera object with a first viewer. The first camera object may have associated first extrinsic properties and associated first intrinsic properties. The device may associate a second camera object with a second viewer. The second camera object may have associated second extrinsic properties and associated second intrinsic properties. The device may send a registration request to a Media Access Function (MAF) where the registration request identifies the first camera object and the second camera object. The first viewer and the second viewer may update their preferred views of media content, in response, the device may send an update request to the MAF, where the request comprises updated information associated with the first camera object and updated information associated with the second camera object.
In one implementation, we propose a hybrid architecture to compress and decompress a point cloud. In particular, a first decoding block is for the most significant bits, typically coded by a tree-based coding method. A second decoding block is for the middle-range of bits, typically coded by a voxel-based method. A third decoding block is for the least significant bits, typically coded by a point-based method. For example, the decoder configures the decoder's network according to the total number of bits and the bit partitioning positions; decodes a coarse point cloud and its associated point-wise features using a tree-based decoding block; upsamples the coarse point cloud to a denser one and updates the point-wise features using a voxel-based decoding block; and refines the precision of the coordinates of the dense but low bit depth point cloud to high bit depth point cloud using a point-based decoding block.
H04N 19/33 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the spatial domain
H04N 19/34 - Scalability techniques involving progressive bit-plane based encoding of the enhancement layer, e.g. fine granular scalability [FGS]
H04N 19/132 - Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
H04N 19/187 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer
H04N 19/119 - Adaptive subdivision aspects e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
18.
CONCAVITY-BASED GROUPING FOR UNORGANIZED 3D POINT CLOUD SEGMENTATION AND ABSTRACTION
Points are grouped from a point cloud using Concavity-induced Distance (CID). First, a set of seed points is sampled from the input point cloud. Then a grouping of points is conducted based on a nearest neighbor search computed using CID. These two steps enable two novel solutions in point cloud segmentation and scene abstraction. In one embodiment, CID is determined between two points residing within an object surface. In a second embodiment, a CID is determined between groups of points.
In one implementation, we propose an adaptive point generation mechanism that can control the number of output points, for example, to have it matched exactly to the number of input points. The proposed method can be used in folding-based point cloud compression systems. In one example, using FPS (Farthest Point Sampling), we propose the adaptive grid generator, which provides control over the number of points in the reconstructed point cloud. Given an input point cloud, a pre-defined 2D grid is sampled using FPS procedure with the number of input points controlling the number of samples. On one hand, this enables lossless reconstruction of point clouds which is useful for storage and several real-world applications. On the other hand, having control over the number of output points also opens avenues to machine and vision applications such as hierarchical processing, super-resolution, summarization, of point clouds.
Methods and apparatuses for decoding and encoding point cloud data are described herein. A method may include accessing point cloud data compressed based on a tree structure. The method may further comprise fetching points in a neighborhood associated with a current node of the tree structure, and computing a feature using a point-based neural network module, based on three-dimensional (3D) locations of the fetched points. The method may include predicting, using a neural network module, an occupancy symbol distribution for the current node based on the feature, and determining the occupancy for the current node from the encoded bitstream and the predicted occupancy symbol distribution. The method may include computing another feature using a convolution-based neural network module, based on a voxelized version of the fetched points, and fusing the feature and the another feature with one or more known features of a current node to compose a comprehensive feature.
H04N 19/13 - Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
H04N 19/184 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
H04N 19/593 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
H04N 19/91 - Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
A method and system are provided for processing image content. In one embodiment the method comprises receiving a plurality of captured contents showing same scene as captured by one or more cameras having a different focal length and depth maps and generating a consensus cube by obtaining depth map estimations from said received contents. The visibility of different objects in then analysed to create a soft visibility cube that provides visibility information about each content. A color cube is then generated by using information from the consensus and soft visibility cube. The color cube is then used to combine different received contents and generate a single image for the plurality of contents received.
A method for decoding or encoding comprising: obtaining (140) views parameters for a set of views comprising at least one reference view and a current view of a multi-views video content wherein each view comprises a texture layer and a depth layer; for at least one couple of a reference view and the current view of the set of views, generating (141) an intermediate prediction image applying a forward projection method to pixels of the reference view to project these pixels from a camera coordinates system of the reference view to a camera coordinates system of the current view, the prediction image comprising information allowing reconstructing image data; storing (143) at least one final prediction image obtained from at least one intermediate prediction image in a buffer of reconstructed images of the current view; reconstructing (144) a current image of the current view from the images stored in said buffer, said buffer comprising said at least one final prediction image.
H04N 19/597 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
H04N 19/80 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
In one implementation, a picture is partitioned into multiple blocks, with uniform or different block sizes. Each block is compressed by an auto-encoder, which may comprise a deep neural network and entropy encoder. The compressed block may be reconstructed or decoded with another deep neural network. Quantization may be used in the encoder side, and de-quantization at the decoder side. When the block is encoded, neighboring blocks may be used as causal information. Latent information can also be used as input to a layer at the encoder or decoder. Vertical and horizontal position information can further be used to encode and decode the image block. A secondary network can be applied to the position information before it is used as input to a layer of the neural network at the encoder or decoder. To reduce blocking artifact, the block may be extended before being input to the encoder.
H04N 19/90 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups , e.g. fractals
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
G06N 3/04 - Architecture, e.g. interconnection topology
24.
METHODS AND APPARATUSES FOR ENCODING, DECODING AND RENDERING 6DOF CONTENT FROM 3DOF+ COMPOSED ELEMENTS
A volumetric content is encoded as a set of clusters by an encoder and transmitted to a decoder which retrieves the volumetric content. Clusters common to different viewpoints are obtained and mutualized. Clusters are projected onto 2D images and encoded as independent video streams. Reduction in visual artefacts and reduction of data for storage and streaming are achieved.
H04N 19/597 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
H04N 19/20 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
H04N 19/46 - Embedding additional information in the video signal during the compression process
A method for encoding a volumetric video content representative of a 3D scene is disclosed. The method comprises obtaining a reference viewing box and an intermediate viewing box defined within the 3D scene. For the reference viewing bounding box, the volumetric video reference subcontent is encoded as a central image and peripheral patches for parallax. For the intermediate viewing bounding box, the volumetric video intermediate sub-content is encoded as intermediate central patches which are differences between the intermediate central image and the reference central image.
H04N 19/597 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
At least a method and an apparatus are presented for efficiently encoding or decoding video. For example, a plurality of frames is provided to a motion estimator to produce an output comprising estimated motion information. The estimated motion information is provided to an auto-encoder or an auto-decoder to produce an output comprising reconstructed motion field. The reconstructed motion field and one or more decoded frames of the plurality of frames are provided to a deep neural network to produce an output comprising refined bi-directional motion field. The video is encoded or decoded based on the refined bi-directional motion field.
Methods, apparatuses and streams are disclosed for transmitting tiled volumetric video and, at the receiver, for generating an atlas image compatible with a legacy decoder. At the server side, viewport information is obtained and a first list of central tiles and a second list of border tiles are selected. A central tile is a part of an image obtained by projecting the 3D scene onto an image plane according to a central point of view. A border tile is an image comprising dis-occluding patches. Sizes and shapes of border tiles are function of size and shape of central tiles. At the client side, tiles are arranged according to a layout selected in a set of layouts according to the number, sizes and shapes of border tiles.
H04N 19/597 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
H04N 13/161 - Encoding, multiplexing or demultiplexing different image signal components
28.
METHOD AND APPARATUS FOR VIDEO ENCODING AND DECODING WITH MATRIX BASED INTRA-PREDICTION
Different implementations are described, particularly implementations for video encoding and decoding based on linear weighted intra prediction, also called matrix based intra prediction, are presented. Accordingly, the encoding or decoding comprises obtaining intra predicted samples of a block from a selected weight matrix and associated bias and from a set of neighboring reference samples; wherein any coefficient of the selected weight matrix is a power of two. According to relaxed version, not all but only a part of the coefficients of the selected weight matrix is a power of two. Advantageously, such arrangement allows to reduce the amount of memory for storing data and to reduce the complexity of the intra prediction samples computation.
H04N 19/593 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
H04N 19/463 - Embedding additional information in the video signal during the compression process by compressing encoding parameters before transmission
H04N 19/42 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals - characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
29.
A METHOD AND APPARATUS FOR DELIVERING A VOLUMETRIC VIDEO CONTENT
Methods, devices and data stream are provided for signaling and decoding information representative of restrictions of navigation in a volumetric video. The data stream comprises metadata associated to video data representative of the volumetric video. The metadata comprise data representative of a viewing bounding box, data representative of a curvilinear path in the 3D space of said volumetric video; and data representative of at least one viewing direction range associated with a point on the curvilinear path.
Different implementations are described, particularly implementations for video encoding and decoding based on linear weighted intra prediction, also called matrix based intra prediction, are presented. Accordingly, for a block being encoded or decoded in linear weighted intra prediction, obtaining intra predicted samples from at least two matrix-vector products between at least two selected weight matrices of reduced size and a set of neighboring reference samples. Advantageously, such arrangement allows to reduce the amount of memory for storing data and to reduce the complexity of the intra prediction samples computation.
H04N 19/593 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
H04N 19/463 - Embedding additional information in the video signal during the compression process by compressing encoding parameters before transmission
H04N 19/42 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals - characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
31.
METHODS FOR TRANSMITTING AND RENDERING A 3D SCENE, METHOD FOR GENERATING PATCHES, AND CORRESPONDING DEVICES AND COMPUTER PROGRAMS
The disclosure discloses methods and devices for transmitting and rendering a 3D scene. The method for transmitting comprises: segmenting a space into m angular sectors, the m angular sectors each corresponding to an angular distance from a viewport, and the space into n depth ranges; obtaining (11) at least one first patch, generated from a first view of the 3D scene, said at least one first patch comprising a texture component and a depth component; obtaining (12) at least one atlas, generated from at least one second view of the 3D scene, said at least one atlas being built by packing together at least one second patch generated for at least one point of one of said second view that is not visible in another view of the 3D scene and that belongs to a same angular sector among the m angular sectors, and a same depth range among the n depth ranges, at least one of m or n being greater than or equal to 2, said at least one second patch comprising a texture component and a depth component, wherein each of the at least one first patch and the at least one second patch is based on at least one of a sector and a depth; generating (13) a first subset of streams comprising m' pairs of streams and a second subset of streams comprising m' x n' pairs of streams; and transmitting (14) the first and second subsets of streams to the terminal.
H04N 19/597 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
H04N 13/161 - Encoding, multiplexing or demultiplexing different image signal components
Methods (800, 900, 1600, 1700) and apparatuses (2100) for signaling decoding data in a video bitstream, wherein one uses a syntax element indicating whether the decoding data are explicitly coded in the video bitstream or inferred from previous data of the video bitstream. A bitstream, a computer- readable storage medium and a computer program product are also described.
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
H04N 19/50 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
H04N 19/174 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
33.
HIGH LEVEL SYNTAX FOR CONTROLLING THE TRANSFORM DESIGN
Different implementations are described, particularly implementations for video encoding and decoding are presented. Accordingly, the encoding or decoding comprises obtaining at least one syntax element related to enabling multiple transform selection MTS and, based on the at least one syntax element, obtaining a horizontal transform or a vertical transform used in a transform method to apply to a block of residue. According to a particular characteristic, in an Intra Sub Partitioning ISP or a Sub Block Transform SBT, the horizontal transform and vertical transform of a transform method are set to the core transform DCT2 in case said at least one syntax element disables the multiple transform selection. According to another embodiment, the controlling of the use of non-separable secondary transform is also described.
H04N 19/12 - Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
H04N 19/46 - Embedding additional information in the video signal during the compression process
H04N 19/625 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using discrete cosine transform [DCT]
H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
34.
METHOD AND APPARATUS FOR ENCODING A BLOCK AND DECODING BASED ON ILLUMINATION COMPENSATION
Methods (800, 1600, 1700) and apparatuses (1800) for video coding and decoding are provided. The method (800, 1600, 1700) includes deriving one or more illumination compensation parameters based on neighboring samples of a sub-block of a block and neighboring samples of a motion- compensated reference sub-block; deriving a prediction sub-block by applying on the motion-compensated reference sub-block an illumination compensation using the one or more derived illumination compensation parameters. A computer-readable storage medium and a computer program product are also described.
A video codec can involve determining a motion compensation mode associated with encoding a first block of picture information, the motion compensation mode including a sub-block based motion compensation prediction mode or a non-rectangular block partition mode; determining that a second block of picture information spatially neighboring the first block was encoded or decoded based on an illumination compensation; and encoding or decoding the first block based on the motion compensation mode and the illumination compensation.
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
H04N 19/136 - Incoming video signal characteristics or properties
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/51 - Motion estimation or motion compensation
H04N 19/537 - Motion estimation other than block-based
H04N 19/80 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
36.
TRANSFORM SELECTION FOR IMPLICIT MULTIPLE TRANSFORM SELECTION
A method and apparatus to improve compression efficiency in a video compression scheme enables use of new tools with multiple transform selection. In one embodiment, transform pair selection is based on a flag indicative of low-frequency non-separable transforms. In another embodiment, transform pair selection is based on a flag indicative of low-frequency non-separable transforms and on a flag indicative of matrix-based intra prediction. In another embodiment, when an implicit multiple transform selection mode is used, transform pair selection is based on a flag indicative of low-frequency non-separable transforms. Bitstream syntax is used to convey the flags.
H04N 19/122 - Selection of transform size, e.g. 8x8 or 2x4x8 DCT; Selection of sub-band transforms of varying structure or type
H04N 19/119 - Adaptive subdivision aspects e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
H04N 19/157 - Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/625 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using discrete cosine transform [DCT]
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
37.
A METHOD AND APPARATUS FOR DECODING THREE-DIMENSIONAL SCENES
Generating an image from a source image can involve encoding a projection of a part of a three-dimensional scene. Pixels of a source image comprise a depth and a color attribute. Pixels of a source image are de-projected as colored point cloud. A de-projected point in a 3D space has the color attribute of the pixel that it has been de-projected from. Also, a score is attributed to the generated point according to a local depth gradient and/or a local color gradient of the pixel it comes from, the lower the gradient, the higher the score. The generated point cloud is captured by a virtual camera for rendering on a display device. The point cloud is projected onto the viewport image by blending color of points projected on a same pixel, the blending being weighted by the scores of these points.
A method and apparatus for performing deep neural network compression of convolutional and fully connected layers using a linear approximation of their outputs with information, such as in matrices representing weights, biases and non-linearities, to iteratively compress a pre-trained deep neural network by low displacement rank based approximation of the network layer weight matrices. Extension of the technique enables consecutive layers to be compressed jointly, allowing compression and speeding inference by reducing the number of channels/hidden neurons in the network.
Encoding or decoding picture information can involve determining a first scaling factor varying with a first granularity to scale a chroma prediction residual associated with chroma information included in the picture information; determining a second scaling factor varying with a second granularity finer than the first granularity; scaling the chroma prediction residual 5 based on a combination of the first scaling factor and the second scaling factor to provide a scaled chroma prediction residual with the second granularity; and encoding or decoding at least a portion of the picture information based on the scaled chroma prediction residual.
H04N 19/186 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
H04N 19/50 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
H04N 19/82 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
H04N 19/80 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
H04N 19/46 - Embedding additional information in the video signal during the compression process
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
40.
HIGH LEVEL SYNTAX SIMPLIFIED VIDEO CODING TOOL SET FOR SMALL BLOCKS
A coding tool set enablement scheme allows one or more coding tools to be used in the encoding or decoding of video data based on one or more characteristics related to the video. In one embodiment, some coding tools are enabled for block sizes below a particular threshold. In another embodiment, a group of coding tools are enabled based on one flag for blocks having a particular characteristic. In another embodiment, these flags are included in a bitstream with the video. In another embodiment, at least one of the flags are inferred to enable some coding tools.
H04N 19/102 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
H04N 19/109 - Selection of coding mode or of prediction mode among a plurality of temporal predictive coding modes
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
H04N 19/136 - Incoming video signal characteristics or properties
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/577 - Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
41.
FRAMEWORK FOR CODING AND DECODING LOW RANK AND DISPLACEMENT RANK-BASED LAYERS OF DEEP NEURAL NETWORKS
A method and apparatus for conveying information in a bitstream for deep neural network compression, such as in matrices representing weights, biases and non-linearities, to iteratively compress a pre-trained deep neural network by low displacement rank based approximation of the network layer weight matrices. The low displacement rank approximation allows for replacement of an original layer weight matrices of the pre-trained deep neural network as the sum of small number of structured matrices, allowing compression and low inference complexity. A decoder stage parses a bitstream for inference.
H04N 19/13 - Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
H04N 19/30 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
G06N 3/04 - Architecture, e.g. interconnection topology
42.
METHOD AND APPARATUS FOR VIDEO ENCODING AND DECODING WITH OPTICAL FLOW BASED ON BOUNDARY SMOOTHED MOTION COMPENSATION
Different implementations are described, particularly implementations for video encoding and decoding are presented. According to an implementation, in a method for encoding or decoding a part of an image, an inter-prediction refinement of the image block using optical flow based on boundary smoothed motion compensation is performed. The inter-prediction refinement of the image block further comprises obtaining a motion information for the block, a motion information for the top neighboring block, a motion information for the left neighboring block; and applying an optical flow based on a weighted sum of the obtained motion information to refine the prediction for the block. Advantageously, the refined inter- prediction is applied on boundary sub-blocks of the causal border of the image block or on any sub-block of the image block at a sub-block level if the image block has sub-block motion field.
H04N 19/583 - Motion compensation with overlapping blocks
H04N 19/86 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
H04N 19/55 - Motion estimation with spatial constraints, e.g. at image or region borders
H04N 19/46 - Embedding additional information in the video signal during the compression process
A method and apparatus for performing prediction for encoding or decoding uses intra prediction with sub-partitions. The sub-partitions are oriented either horizontally or vertically and can use wide-angle modes different than that of the video block they originate from. Reference samples for a sub-partition are those of the video block when reference samples for the sub-partition are not available, such as due to direction. In an embodiment, when a sub-partition is square, conventional intra prediction directions are used. Reference samples can be used from a block above and right of the video block or left and below the video block using a mapping along a prediction direction, vertically, or horizontally.
H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
H04N 19/593 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
44.
METHOD FOR DISPLAYING IMAGES ON A FLEXIBLE DISPLAY DEVICE IN A HEAD-MOUNTABLE DEVICE AND CORRESPONDING APPARATUS
A method and an apparatus are defined for displaying images on a flexible display in a head-mountable device (HMD). One or more flexible display devices may be inserted in the HMD. The one or more flexible display devices may be constrained by the HMD to take a particular curved form and wrap the field of view (FOV) of images displayed on the one or more flexible display devices for an improved user experience. The display surface of the one or more flexible displays may be divided in display areas, the display areas corresponding to a focus area and a peripheral FOV. Image processing may be differentiated according to display area.
At least one embodiment relates to a method assigning a pixel value of an occupancy map either indicates that a depth value of at least one 3D sample of a point cloud frame projected along a same projection line is stored as a pixel value of at least one layer or equals a fixed-length codeword representing a depth value of at least one 3D sample projection along said projection line.
H04N 19/597 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
46.
LOW DISPLACEMENT RANK BASED DEEP NEURAL NETWORK COMPRESSION
A method and an apparatus for performing deep neural network compression use an approximation training set along with information, such as in matrices representing weights, biases and non-linearities, to iteratively compress a p re-trained deep neural network by low displacement rank based approximation of the network layer weight matrices. The low displacement rank approximation allows for replacement of an original layer weight matrices of the pre-trained deep neural network as the sum of a small number of structured matrices, allowing compression and low inference complexity.
H04N 19/42 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals - characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
At least one embodiment relates to a method for signaling a syntax element representing a Point Local Reconstruction mode, said Point Local Reconstruction mode being representative of at least one parameter defining a mode for reconstructing at least one point of a point cloud frame.
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
At least one embodiment relates to signaling at least one texture patch representing a texture value of at least one in-between 3D sample, a texture patch being a set of 2D samples representing texture values of orthogonally projected 3D samples of a point cloud along projection lines onto a projection plane, and said at least one in-between 3D sample being a 3D sample of the point cloud having a depth value greater than a nearer 3D sample of the point cloud and lower than a farther 3D sample of the point cloud, said at least one in-between 3D sample and said nearer and farther 3D samples being projected along the same projection line
H04N 19/597 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
At least one embodiment relates to a method comprising storing a depth value of at least two 3D samples of a point cloud frame in at least two depth images; and determining a minimum depth value and a maximum depth value at a 2D location of a projection plane from depth values stored at said 2D location in said at least two depth images and encoding a depth value of at least one additional 3D sample of the point cloud according to said minimal and maximal depth values, said at least one 3D sample and said at least one additional 3D sample being projected onto the projection plane along a same projection line.
H04N 19/597 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
A method for obtaining a temporal motion vector predictor is disclosed. A new temporal motion vector predictor is obtained by using a motion vector of a block in a collocated image. The block is displaced (with respect spatial location of the current block) by a motion vector coming from a new temporal motion vector predictor (TMVP) process.
H04N 19/196 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters
H04N 19/52 - Processing of motion vectors by encoding by predictive encoding
51.
A METHOD AND APPARATUS FOR DEPTH ENCODING AND DECODING
Methods, device and data stream format are disclosed in the present document for the encoding, the formatting and the decoding of depth information representative of a 3D scene. Compression and decompression of quantized values by a video codec leads to a value error. This error on values is particularly sensitive for depth encoding. The present invention proposes to encode and decode depth with a quantization function that minimize an angle error when a value error on quantized depth creates a location delta between the projected point and the de-projected point. The inverse of such a quantization function has to be encoded in metadata associated with the 3D scene, for example as a LUT, to be retrieved at the decoding, as such functions are not tractable.
H04N 19/597 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
52.
A METHOD AND APPARATUS FOR ENCODING AND RENDERING A 3D SCENE WITH INPAINTING PATCHES
Methods, devices and stream are disclosed for encoding, transporting and decoding a 3D scene prepared to be viewed from the inside of a viewing zone. A central view comprising texture and depth information is encoded by projected points of the 3D scene visible from a central point of view onto an image plane. Patches are generated to encode small parts of the 3D scene not visible from the central point of view. At the rendering, a viewport image is generated for the current point of view. Holes, that is dis-occluded areas, of the viewport are filled using a patch based inpainting algorithm adapted to take the patches, warped according to the rotation and translation between virtual camera used for capturing the patch and the current virtual camera.
H04N 19/597 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
H04N 19/46 - Embedding additional information in the video signal during the compression process
A method for decoding is presented. A forward mapping is performed to a prediction sample corresponding to a sample of a block of a picture. The forward mapping is based on a forward mapping function modeled as a piece wise linear function. An inverse mapping, based on an inverse mapping function, is performed to a reconstructed version of the sample of the block. At least information representative of a number of pivot points of the piece wise linear function and information representative of the value of each of the pivot points are decoded.
H04N 19/85 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
H04N 19/46 - Embedding additional information in the video signal during the compression process
H04N 19/463 - Embedding additional information in the video signal during the compression process by compressing encoding parameters before transmission
H04N 19/182 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
H04N 19/82 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
54.
TRANSFORM SELECTION AND SIGNALING FOR VIDEO ENCODING OR DECODING
In at least one embodiment, a method and apparatus for encoding/decoding a picture comprising the selection of a transform amongst a set of transform functions and the signaling of the selected transform in a bitstream at the encoding side and determining the inverse transform from the bitstream and using the determined inverse transform function to decode the picture from the bitstream at the decoder side.
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/61 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
H04N 19/12 - Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
55.
METHOD AND APPARATUS FOR VIDEO ENCODING AND DECODING WITH SUBBLOCK BASED LOCAL ILLUMINATION COMPENSATION
Different implementations are described, particularly implementations for video encoding and decoding based on a linear model responsive to neighboring samples are presented. Accordingly, for a block being encoded or decoded in a picture, refined linear model parameters are determined for a current subblock in the block and for encoding the block, the local illumination compensation uses a linear model for the current subblock based on the refined linear model parameters. In a first embodiment, the number N of reconstructed samples increases with the available data for the subblock. In a second embodiment, partial linear model parameters are determined for the subblock and refined linear model parameters are derived from a weighted sums of partial linear model parameters. In a third embodiment, the subblocks are independently LIC processed.
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
H04N 19/463 - Embedding additional information in the video signal during the compression process by compressing encoding parameters before transmission
H04N 19/14 - Coding unit complexity, e.g. amount of activity or edge presence estimation
H04N 19/82 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
H04N 19/192 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding the adaptation method, adaptation tool or adaptation type being iterative or recursive
56.
A METHOD AND APPARATUS FOR ENCODING AND DECODING VOLUMETRIC VIDEO
Methods, devices and stream are disclosed to encode and decode a 3D scene (such as a point cloud) in the context of a patch-based transmission of a volumetric video content. The present principles relate a method of associating to each projection center a domain of validity with respect to the viewing location. Doing so, the rendering engine is able to select the subset of patches among all patches transmitted in the patch atlas, which is best suited to the current viewport pose. Such validity information is explicitly transmitted as additional metadata within the volumetric video content stream.
H04N 21/218 - Source of audio or video content, e.g. local disk arrays
H04N 21/234 - Processing of video elementary streams, e.g. splicing of video streams or manipulating MPEG-4 scene graphs
H04N 21/2343 - Processing of video elementary streams, e.g. splicing of video streams or manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
H04N 21/845 - Structuring of content, e.g. decomposing content into time segments
H04N 19/597 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
H04N 13/161 - Encoding, multiplexing or demultiplexing different image signal components
H04N 21/235 - Processing of additional data, e.g. scrambling of additional data or processing content descriptors
H04N 21/41 - Structure of client; Structure of client peripherals
H04N 21/414 - Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
H04N 21/84 - Generation or processing of descriptive data, e.g. content descriptors
57.
FLEXIBLE ALLOCATION OF REGULAR BINS IN RESIDUAL CODING FOR VIDEO CODING
In at least one embodiment, a method and apparatus for encoding/decoding a video is based on a CABAC coding of bins where a high-level constraint on the maximum usage of regular CABAC coding of bins is enforced. In other words, a budget of regular coded bins is allocated over a picture area that is larger than a coding group, thus covering a plurality of coding groups, and which is determined from an average allowed number of regular bins per unit of area.
H04N 19/13 - Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
H04N 19/91 - Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
H04N 19/42 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals - characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
H04N 19/127 - Prioritisation of hardware or computational resources
H04N 19/156 - Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
For multi-view video content represented in the MVD (Multi-view + Depth) format, the depth maps may be processed to improve the coherency therebetween. In one implementation, to process a target view based on an input view, pixels of the input view are first projected into the world coordinate system, then into the target view to form a projected view. The texture of the projected view and the texture of the target view are compared. If the difference at a pixel is small, then the depth of the target view at that pixel is adjusted, for example, replaced by the corresponding depth of the projected view. When the multi-view video content is encoded and decoded in a system, depth map processing may be applied in the pre-processing and post-processing modules to improve video compression efficiency and the rendering quality.
H04N 13/271 - Image signal generators wherein the generated image signals comprise depth maps or disparity maps
H04N 19/597 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
To encode with CABAC, a non-binary syntax element value is mapped to a binary sequence (bin string), through a binarization process. A binary arithmetic coding engine encodes or decodes a bin, in a regular (context-based) mode and a bypass mode.
H04N 19/91 - Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
H04N 19/13 - Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
H04N 19/88 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving rearrangement of data among different coding units, e.g. shuffling, interleaving, scrambling or permutation of pixel data or permutation of transform coefficient data among different blocks
H04N 19/50 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
H04N 19/577 - Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
60.
LOCAL ILLUMINATION COMPENSATION FOR VIDEO ENCODING OR DECODING
In at least one embodiment, a method and apparatus for encoding/decoding a picture comprising predicting at least one block, wherein the predicting comprises performing motion compensation and local illumination compensation based on a reference block, the local illumination compensation including applying a linear model based on sums of absolute differences of neighboring reconstructed samples and corresponding reference samples of the reference block, wherein the neighboring reconstructed samples and corresponding reference samples of the reference block are co-located according to an L-shape substantially adjacent to the block to be predicted, the L-shape comprising a row of pixels located to the top side of the predicted block and a column of pixels located to the left side of the predicted block, the co-location being determined according a motion vector of the predicted block.
H04N 19/82 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/196 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters
Encoding or decoding syntax information associated with video information can involve identifying a coding context associated with a syntax element of a current coding unit of the video information, wherein the identifying occurs without using a syntax element of a neighboring block, and encoding or decoding the syntax element of the current coding unit based on the coding context.
H04N 19/91 - Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
A method and apparatus for performing intra prediction mode partitioning predicts pixels of a video coding block using a plurality of intra prediction modes over a plurality of regions of the video coding block. Predictions can be based on reference arrays using at least one reference line above the block to be coded and/or using at least one reference column to the left of the block to be coded. Different prediction modes are used in different regions of the coding block. In at least one embodiment, the video coding block is split into a plurality of partitions in addition to having a plurality of intra prediction modes over different regions of the block. Signaling enables a decoder to determine the number of regions within a coding block. In at least another embodiment, prediction modes allowable within regions of a video coding block differ by one angular position.
H04N 19/11 - Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
H04N 19/119 - Adaptive subdivision aspects e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/593 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
A method and apparatus for performing a forward mapping function or its inverse is implemented through information conveyed in a bitstream to perform mapping. The information can be implemented in a uniform or non-uniform lookup table. A decoder can receive the information and derive the inverse function to be used. In one embodiment, a decoder receives information representative of an inverse mapping function and uses the information to implement an inverse mapping lookup table for intra coded picture portions and can derive a forward mapping lookup table to be used with an inverse mapping lookup table for inter coded picture portions.
H04N 19/82 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
64.
METHOD AND DEVICE FOR PICTURE ENCODING AND DECODING
A method for video decoding is disclosed. A first reconstructed version of an image block of an encoded video is accessed. The first reconstructed version of said image block is filtered by a first neural network to form a second reconstructed version of said image block to be used as reference. The second reconstructed version of said image block is filtered by a second neural network to form a third reconstructed version of said image block to be displayed. The first and second neural networks are trained jointly.
G06N 3/04 - Architecture, e.g. interconnection topology
H04N 19/82 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
H04N 19/86 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
A cross-component dependent tool to be used for a chroma block of a picture is enabled responsive to a size of said chroma block and to a size of at least one luma block co-located with the chroma block. Then, the chroma block is decoded responsive to said enablement of said cross-component dependent tool. A encoding and decoding methods are presented as well as encoding and decoding devices.
H04N 19/127 - Prioritisation of hardware or computational resources
H04N 19/186 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
H04N 19/167 - Position within a video image, e.g. region of interest [ROI]
A method and apparatus for performing intra prediction for encoding or decoding adds multiple prediction modes to those of prior intra prediction schemes. A horizontal mode, a vertical mode, and a diagonal mode are added. Reference pixels for each of the added modes can come from multiple pixel positions away from a block to be encoded or decoded. Reference pixels to the left and above a block are reconstructed from those already coded. Reference pixels from right of, and below, a block are estimated or extrapolated and can be based on other pixels around the block. An index can be sent in a bitstream indicating which prediction was used.
H04N 19/593 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
H04N 19/11 - Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
H04N 19/147 - Data rate or code amount at the encoder output according to rate distortion criteria
H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/182 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
H04N 21/235 - Processing of additional data, e.g. scrambling of additional data or processing content descriptors
H04N 21/435 - Processing of additional data, e.g. decrypting of additional data or reconstructing software from modules extracted from the transport stream
H04N 21/44 - Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to MPEG-4 scene graphs
H04N 21/234 - Processing of video elementary streams, e.g. splicing of video streams or manipulating MPEG-4 scene graphs
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
H04N 19/46 - Embedding additional information in the video signal during the compression process
68.
METHOD AND DEVICE FOR PICTURE ENCODING AND DECODING USING ILLUMINATION COMPENSATION
A method for reconstructing a picture block is disclosed, wherein the block is predicted using local illumination compensation. The parameters of local illumination compensation are determined according to a selection of reconstructed samples located to the left and above of the current block. In the case where some of them are unavailable, they may be replaced using different techniques.
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
H04N 19/14 - Coding unit complexity, e.g. amount of activity or edge presence estimation
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/82 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
H04N 19/86 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
69.
METHOD AND APPARATUS FOR VIDEO ENCODING AND DECODING WITH BI-DIRECTIONAL OPTICAL FLOW ADAPTED TO WEIGHTED PREDICTION
Different implementations are described, particularly implementations for video encoding and decoding are presented. According to an implementation, in a method for encoding or decoding a part of an image, at least an equation of the bi-directional optical flow is modified for unequal weights in a weighted prediction of the part of the image. According to non-limiting examples, modifying the bi-directional optical flow equation comprises bit depth shifting the unequal weights used in the weighted prediction, quantifying the unequal weighs used in the weighted prediction or deriving modified weighs to apply to predictions of the part of the image from the unequal weights used in weighted prediction.
Reshaping can be used to better exploit the sample value distribution of video data. When reshaping is used inside the coding loop, forward mapping is applied to prediction signals from intra or inter prediction, and inverse mapping is applied to reconstructed signals. To simplify the inverse mapping operations, in one embodiment, the inverse mapping function is modelled as a piece-wise linear function, and each line segment is defined on an equi-distant interval of a length equal to a power of 2. In this embodiment, the inverse mapping function is specified by the number of pieces, initial offset value and the slope for each piece. In one example, the slope parameters can be signaled directly in the bitstream. In another example, an initial estimate of the slope parameters can be obtained from the forward mapping function, and the difference between the initial estimate and the actual parameters are signaled.
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
H04N 19/85 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
At least a method and an apparatus are presented for efficiently encoding or decoding video. For example, a prediction block for a current block is obtained. A reconstructed neighboring block of the prediction block is obtained. Filtering is performed on a boundary between the prediction block and the reconstructed neighboring block. At the encoder side, the prediction residual is obtained as the difference between the filtered prediction block and the current block, and then encoded. At the decoder side, the prediction residual is added to the filtered prediction block to reconstruct the current block.
H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/61 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
72.
METHODS FOR PROCESSING AUDIO AND/OR VIDEO CONTENTS AND CORRESPONDING SIGNAL, DEVICES, ELECTRONIC ASSEMBLY, SYSTEM, COMPUTER READABLE PROGRAM PRODUCTS AND COMPUTER READABLE STORAGE MEDIA
The disclosure relates to a method including applying a first format modification to an audio and video input content in a first format to output a content complying with a second format, information about the first format modification being associated to the output content. The disclosure also relates to a method including obtaining an audio and video input content complying with an input format and information about a first format modification applied to the input content and determining a second format modification to apply to the input content by taking account of the first format modification. It also relates to corresponding signal, devices, electronic assembly, system, computer readable program products and storage media.
A method for decoding an image enables to preserve artistic intent at the final rendering stage by adjusting the image to luminance characteristics of the content and of the presentation display that will display the image. Values representative of luminance of both the image and the display device are obtained. Parameters of a display adaptation function are adjusted according to these values and the adjusted display adaptation function is used to decode the image. In at least one embodiment, the adjusted display adaptation function relates to a tone mapping function. Corresponding apparatus implementing the method is also described.
H04N 19/46 - Embedding additional information in the video signal during the compression process
H04N 19/85 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
In an encoding apparatus or a decoding apparatus, an encoding method or decoding method encodes or decodes a bitstream comprising a unified syntax for coding motion information in video coding providing great flexibility for the mode choices through a large number of available modes related to the motion information. The unified motion information syntax comprises modes for both bi-prediction or uni-prediction and introduces a new skip mode that provides a finer cost granularity.
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
H04N 19/51 - Motion estimation or motion compensation
H04N 19/463 - Embedding additional information in the video signal during the compression process by compressing encoding parameters before transmission
75.
COMBINING MOTION VECTOR DIFFERENCE CODING TOOLS WITH OTHER MOTION MODES
The general aspects extend motion modes, such as merge with motion vector difference, and symmetrical motion vector difference, to motion models beyond a simple translational model, for example in combination with merge and alternative temporal motion vector prediction modes. Embodiments extend the use of MMVD and SMVD motion vector coding tools to all the motion model derivation methods and temporal prediction methods that are supported in proposed video standards, so as to increase the overall compression performance. Particular embodiments describe combining MMVD or SMVD with the affine motion model, the ATMVP motion model, the planar motion model, the regressive motion field, the triangle-partition-based motion model, the GBI temporal prediction method, the LIC temporal prediction method and the Multi-hypothesis prediction method.
Methods and devices are provided to encode points of a sphere onto an image by projecting them as a function of an isotropic region guided mapping operator and/or to decode pixels of an image onto a sphere by de-projected them according to the same parametrized mapping operator. A region of interest is determined on the sphere and the angular resolution of pixels of the image is modulated as a function of their distance to the reference pixel corresponding to the center of the region of interest. Chosen angular resolutions and size of the region of interest are associated with the image and encoded in a stream.
H04N 19/597 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
G06T 3/00 - Geometric image transformation in the plane of the image
Different implementations are described, particularly implementations for video encoding and decoding are presented including a method for deblocking an image. According to an implementation, in a method for deblocking an image, at least one boundary is determined between a first block of samples and a second block of samples; a boundary strength is determined according to at least one of a prediction mode of the first block and a prediction mode of the second block; and samples of the first and second blocks neighboring the at least one boundary are filtered according to the boundary strength. Advantageously, in case the prediction mode of the first block is a weighted prediction mode, the boundary strength further depends on the relative weight of samples used in predicting the first block of samples according to the weighted prediction mode of the first block and reciprocally for the second block.
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/86 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
78.
METHOD AND DEVICE FOR PICTURE ENCODING AND DECODING
An encoding method is presented. Transform coefficients of a block are first obtained. They are then scanned according to a scan pattern for entropy coding. The scan pattern is determined responsive to a shape of the block.
H04N 19/129 - Scanning of coding units, e.g. zig-zag scan of transform coefficients or flexible macroblock ordering [FMO]
H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/147 - Data rate or code amount at the encoder output according to rate distortion criteria
H04N 19/157 - Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
79.
METHOD AND DEVICE FOR PICTURE ENCODING AND DECODING
A decoding method is presented. a type of split of a block into transform units is first decoded. A transform is then determined for each transform unit of said block responsive to said type of split. Finally, decoded transform coefficients of said transform units are inverse transformed using the determined transforms.
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
H04N 19/119 - Adaptive subdivision aspects e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
H04N 19/122 - Selection of transform size, e.g. 8x8 or 2x4x8 DCT; Selection of sub-band transforms of varying structure or type
H04N 19/625 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using discrete cosine transform [DCT]
80.
METHOD AND APPARATUS FOR VIDEO ENCODING AND DECODING WITH ADJUSTING THE QUANTIZATION PARAMETER TO BLOCK SIZE
Different implementations are described, particularly implementations for video encoding and decoding are presented with adjusting the quantization parameter to block size. According to an implementation, in a method for decoding a block of an image, a quantizing parameter offset is determined for the block according to an indication relative to the size of the block; the quantizing parameter is adjusted by adding the quantizing parameter offset to a quantizing parameter previously determined; then a block of quantized transform coefficients is inverse-transformed using the adjusted quantizing parameter and the block of image is reconstructed. In variant implementations, an indication relative to the size of the block is function of a surface or a split depth for the block. In other variant implementations, the quantizing parameter offset is obtained from a table wherein the table is either known from the decoder or signaled in the bitstream.
H04N 19/157 - Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
81.
MANAGING CODING TOOLS COMBINATIONS AND RESTRICTIONS
Video coding tools can be controlled by including syntax in a video bitstream that makes better use of video decoding resources. An encoder inserts syntax into a video bitstream to enable a decoder to parse the bitstream and easily control which tools combinations are enabled, which combinations are not permitted, and which tools are activated for various components in a multiple component bitstream, leading to potential parallelization of bitstream decoding.
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
At least a method and an apparatus are provided for efficiently encoding or decoding video. For example, a first set of affine motion model candidates is obtained for a current block. A second set of affine motion model candidates is obtained using a combination of one or more of the affine motion model candidates in the first set. The current block is then encoded or decoded based on one or more of the affine motion model candidates in the first set and the second set.
At least a method and an apparatus are provided for efficiently encoding or decoding video. For example, a plurality of different motion prediction modes for a current block are obtained. The current block is encoded or decoded based on a combination of the plurality of different motion prediction modes with corresponding weights for a plurality of sub-blocks of the current block, wherein the combination with the corresponding weights comprising an inter prediction mode and an intra prediction mode.
H04N 19/109 - Selection of coding mode or of prediction mode among a plurality of temporal predictive coding modes
H04N 19/11 - Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
H04N 19/119 - Adaptive subdivision aspects e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/503 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
H04N 19/593 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
84.
UNIFIED PROCESS AND SYNTAX FOR GENERALIZED PREDICTION IN VIDEO CODING/DECODING
At least a method and an apparatus are provided for efficiently encoding or decoding video. For example, a plurality of different motion prediction modes are obtained for a current block. The current block is encoded or decoded based on a combination of the plurality of different motion prediction modes with corresponding weights, wherein the combination with the corresponding weights comprising at least two inter prediction modes, or an inter prediction mode and an intra prediction mode. Both triangle prediction and multi-hypothesis prediction are allowed to be indicated in one or more lists of possible motion vector candidates, such as, e.g., in advanced motion vector prediction (AMVP) mode.
H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
H04N 19/119 - Adaptive subdivision aspects e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
At least a method and an apparatus are provided for efficiently encoding or decoding video. For example, with a first scan pass of a plurality of scan positions of a current block, one or more parameters representing one or more transform coefficient values are obtained using a first type of entropy coding or decoding. With a further scan pass of the plurality of scan positions of the current block, the one or more parameters representing the one or more transform coefficient values are obtained using a second type of entropy coding or decoding, wherein the first type is different than the second type. The current block is encoded or decoded based on the one or more parameters.
Different implementations are described; particularly implementations for video encoding and decoding using merge lists comprising history-based motion vector predictor candidates and averaged motion vector predictor candidates. The method comprises: determining for a current block of the picture one or more history-based motion vector predictor candidates using motion information of blocks preceding the current block; determining for the current block one or more averaged motion vector predictor candidates by averaging a pair of motion vector predictor candidates in a list of motion vector predictor candidates, wherein the motion vector predictor candidates in the list are formed using motion information of blocks spatially and/or temporally surrounding the current block; and inserting one or more of the averaged motion vector predictor candidates before one or more of the history-based motion vector predictor candidates in the list of motion vector predictor candidates.
A decoding method is disclosed. It comprises: - decoding parameters for a current block; - disabling a first coding tool for said current block in the case where one or more of the following conditions is verified: a second coding tool is used for said current block and a given condition on the decoded parameters is verified; - enabling for said current block said first coding tool otherwise; and - decoding said current block using said first coding tool if said first coding tool is enabled.
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/103 - Selection of coding mode or of prediction mode
H04N 19/157 - Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
At least a method and an apparatus are presented for efficiently encoding or decoding video. For example, a quantization mode selection condition is obtained. A first quantization mode is selected for processing a first portion of a set of transform coefficients based on the quantization mode selection condition. A second quantization mode is selected for processing a second portion of the set of transform coefficients based on the quantization mode selection condition. The video is encoded or decoded based on the processed first and second portions of the set of transform coefficients.
H04N 19/126 - Quantisation - Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
H04N 19/18 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a set of transform coefficients
H04N 19/186 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
89.
RESIDUAL CODING WITH REDUCED USAGE OF LOCAL NEIGHBORHOOD
Different implementations are described, particularly implementations for video encoding and decoding using entropy coding of quantized transform coefficients. The method comprises: determining context model indices for one or more syntax elements of quantized transform coefficients of a transform block, wherein different context model indices are obtained for quantized transform coefficients in different regions of the transform block and a single context index is used for at least one region of the transform block; and selecting for the one or more syntax elements associated with a particular quantized transform coefficient one of several context models based on the determined content model index.
H04N 19/13 - Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
H04N 19/18 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a set of transform coefficients
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
H04N 19/91 - Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
90.
CURRENT PICTURE REFERENCING BLOCK VECTOR INITIALIZATION WITH DUAL TREE
A chroma component block vector is initialized using one of a neighboring or collocated luma block vector when current picture referencing mode is used and when dual tree is enabled. In a first embodiment, if a collocated luminance block is not coded in current picture reference mode, a luma vector from a left chroma subblock is used. When the left chroma subblock is not coded in current picture reference mode, a luma vector from the above chroma subblock is used, and if that is not available, a default vector is used. In a second embodiment, a collocated luma block partition is used to derive a chroma block vector.
H04N 19/186 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/11 - Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
H04N 19/52 - Processing of motion vectors by encoding by predictive encoding
H04N 19/593 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
H04N 19/119 - Adaptive subdivision aspects e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
Encoding or decoding video information can involve, for example, partitioning a coding unit of the video information using a partitioning based on a modification of a constraint on partitioning that is associated with a pipeline configuration for reconstruction of the coding unit, where the modification is based on an information dependency between two or more pipeline units associated with the pipeline configuration, and encoding or decoding the video information based on the partitioning.
At least a method and an apparatus are provided for efficiently encoding or decoding video. For example, a most probable mode (MPM) list comprising a number of intra prediction mode candidates for a current block is obtained depending on a shape of the current block. The current block is then encoded or decoded based on the obtained most probable mode list.
H04N 19/11 - Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
H04N 19/593 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
93.
QUANTIZATION FOR VIDEO ENCODING OR DECODING BASED ON THE SURFACE OF A BLOCK
An image is split into a plurality of blocks of various sizes and a subdivision level counter is associated to each of the blocks. The value of this subdivision level counter for a block is representative of the size of the block and is used to determine the quantization parameter for the block. The value is propagated for each subdivision and incremented according the type of the subdivision. When the image is split, an analysis is done according to the subdivision level counter, a maximal value of subdivision and the type of split, in order to determine the start of a new quantization group and when it is the case, the current position of the partition is propagated to the further split partitions to be stored with these partition and serve in the prediction process when decoding.
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/174 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
H04N 19/503 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
H04N 19/593 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
H04N 19/467 - Embedding additional information in the video signal during the compression process characterised by the embedded information being invisible, e.g. watermarking
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
94.
SIMPLIFICATIONS OF CODING MODES BASED ON NEIGHBORING SAMPLES DEPENDENT PARAMETRIC MODELS
Aspects aim at improving and simplifying the design of modes similar to CCLM or LIC, that are based on neighboring samples dependent parametric models. Proposed modifications relate to ways of deriving the parameters of the parametric model and designing the parametric-model-based prediction tools contained in a codec in a unified and simplified way. In one embodiment, an approach proposes a simplification of the Cross-component linear model process for deriving the linear parameters. It is proposed to replace the Least Mean Squared method to derive parameters instead as parameters of a straight line passing through two points corresponding to the minimum and maximum luma values among all the luma neighboring reconstructed samples.
H04N 19/593 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
H04N 19/503 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
H04N 19/103 - Selection of coding mode or of prediction mode
H04N 19/11 - Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
H04N 19/186 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
H04N 19/109 - Selection of coding mode or of prediction mode among a plurality of temporal predictive coding modes
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
95.
PARAMETER GROUPING AMONG PLURAL CODING UNITS FOR VIDEO ENCODING AND DECODING
At least a method and an apparatus are presented for encoding or decoding video and can involve, for example, obtaining a group of coding units including two or more of a plurality of coding units divided from a current block wherein the two or more of the plurality of coding units share a coding parameter, and the group of coding units overlaps at least two different pipeline units associated with a pipelined decoding operation, and encoding or decoding the current block based on the group of coding units, and the shared coding parameter.
H04N 19/436 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals - characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation using parallelised computational arrangements
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
96.
VIDEO ENCODING OR DECODING USING BLOCK EXTENSION FOR OVERLAPPED BLOCK MOTION COMPENSATION
Different implementations are described, particularly implementations for video encoding and decoding using block extension for overlapped block motion compensation. The method comprises: obtaining for a current block of a picture to be encoded or decoded an extended portion corresponding to at least one portion of a neighboring block, the at least one portion being adjacent to the current block; forming an extended block using the current block and the extended portion; and performing a prediction to determine prediction samples for the extended block.
In general, encoding or decoding image information can involve processing a signal including image information based on determining a block of spatial-domain values for a prediction residual; replacing in a set of multiple transforms at least one first transform matrix with at least one second transform matrix and/or adding at least one second transform matrix to said set of multiple transforms; transforming the block of spatial -domain values using said second transform matrix; and encoding or decoding at least a portion of the image information based on the transforming of the block of spatial-domain values.
H04N 19/12 - Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
H04N 19/14 - Coding unit complexity, e.g. amount of activity or edge presence estimation
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/61 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
98.
MULTI-REFERENCE LINE INTRA PREDICTION AND MOST PROBABLE MODE
At least a method and an apparatus are provided for efficiently encoding or decoding video. For example, multiple reference lines for intra prediction of a current block are obtained, wherein the multiple reference lines include at least one reference line that is immediately adjacent to the current block and at least one reference line that is not immediately adjacent to the current block. A number of intra prediction candidate modes are obtained respectively for each of the multiple reference lines. The current block is encoded based on the respective number of candidate modes for each of the multiple reference lines.
H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
H04N 19/11 - Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/593 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
H04N 19/91 - Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
99.
METHOD AND DEVICE FOR PICTURE ENCODING AND DECODING
A decoding method is disclosed. A current block is first intra predicted to obtain a prediction block. The current block is then decoded using the prediction block. At least one sample of the prediction block is obtained by a linear combination of reference samples, wherein one reference sample is padded. In this case, a weight associated with the padded reference sample decreases as a function of a distance between the padded reference sample and a last available reference sample.
H04N 19/593 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
H04N 19/11 - Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
H04N 19/167 - Position within a video image, e.g. region of interest [ROI]
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
100.
VIDEO ENCODING AND DECODING USING BLOCK-BASED IN-LOOP RESHAPING
Different implementations are described, particularly implementations for video encoding and decoding using a block-adaptive mapping for reshaping. The method for encoding and/or decoding a block of a picture comprises: determining one or more values characterizing samples of a block; modifying the determined values using a mapping function; deriving from the modified values one or more block-dependent parameters of a parametric function that approximates the mapping function; and mapping samples of the block using the parametric function and the derived one or more block-dependent parameters.
H04N 19/117 - Filters, e.g. for pre-processing or post-processing
H04N 19/136 - Incoming video signal characteristics or properties
H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
H04N 19/182 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
H04N 19/184 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
H04N 19/30 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
H04N 19/82 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
patents
