Multi view Video Coding (MVC, also known as MVC 3D) is a stereoscopic video coding standard for video compression that allows for the efficient encoding of video sequences captured simultaneously from multiple camera angles in a single video stream. It uses the

2D plus Delta 2D Plus Delta (also 2D+Delta) is a method of encoding 3D image listed as a part of MPEG2 and MPEG4 standards, specifically on the H.264 implementation of the Multiview Video Coding extension. This technology originally started as a proprietary me ...

method and is an amendment to the H.264 (MPEG-4 AVC) video compression standard, developed jointly by

MPEG The Moving Picture Experts Group (MPEG) is an alliance of working groups established jointly by ISO and IEC that sets standards for media coding, including compression coding of audio, video, graphics, and genomic data; and transmission and f ...

and VCEG, with contributions from a number of companies, primarily

Panasonic formerly between 1935 and 2008 and the first incarnation of between 2008 and 2022, is a major Japanese multinational conglomerate corporation, headquartered in Kadoma, Osaka. It was founded by Kōnosuke Matsushita in 1918 as a lightbulb ...

and

LG Electronics LG Electronics Inc. () is a South Korean multinational electronics company headquartered in Yeouido-dong, Seoul, South Korea. LG Electronics is a part of LG Corporation, the fourth largest '' chaebol'' in South Korea, and often considered a ...

. MVC formatting is intended for encoding stereoscopic (two-view)

3D video 3D films are motion pictures made to give an illusion of three-dimensional solidity, usually with the help of special glasses worn by viewers. They have existed in some form since 1915, but had been largely relegated to a niche in the motion pict ...

, as well as

free viewpoint television Free viewpoint television (FTV) is a system for viewing natural video, allowing the user to interactively control the viewpoint and generate new views of a dynamic scene from any 3D position. The equivalent system for computer-simulated video is ...

and multi-view 3D television. The Stereo High profile has been standardized in June 2009; the profile is based on the MVC tool set and is used in stereoscopic

Blu-ray 3D The Blu-ray Disc (BD), often known simply as Blu-ray, is a digital optical disc data storage format. It was invented and developed in 2005 and released on June 20, 2006 worldwide. It is designed to supersede the DVD format, and capable of sto ...

releases.

Technical overview

MVC is based on the idea that video recordings of the same scene from multiple angles share many common elements. It is possible to encode all simultaneous frames captured in the same

elementary stream An elementary stream (ES) as defined by the MPEG communication protocol is usually the output of an audio encoder or video encoder. An ES contains only one kind of data (e.g. audio, video, or closed caption). An elementary stream is often referred ...

and to share as much information as possible across the different layers. This can reduce the size of the encoded video. Multiview video contains a large amount of inter-view statistical dependencies, since all cameras capture the same scene from different viewpoints. Therefore, combined temporal and inter-view prediction is important for efficient MVC encoding. A frame from a certain camera can be predicted not only from temporally related frames from the same camera, but also from the frames of neighboring cameras. These interdependencies can be used for efficient prediction. The method for this used in Multiview Video Coding for Blu-ray 3D movies is known as the

algorithm, and the MVC specification itself is part of the H.264 standard as an amendment in H.264 “Annex H” of the specification.

Open source support mostly missing

As of April 2015, there is still no free and open-source software that supports software decoding of the MVC video compression standard. So popular open source H.264 and HEVC (H.265) decoders such as those used in the

FFmpeg FFmpeg is a free and open-source software project consisting of a suite of libraries and programs for handling video, audio, and other multimedia files and streams. At its core is the command-line ffmpeg tool itself, designed for processing of vid ...

and Libav libraries simply ignore the additional information for the second view and thus do not show the second view for stereoscopic views. In most cases the reason for this support not being added is that MVC was not considered when the initial core H.264 and HEVC decoders code was written so it was coded in one large chunk, and later amendment would as such often mean a lot of prerequisite

code refactoring In computer programming and software design, code refactoring is the process of restructuring existing computer code—changing the '' factoring''—without changing its external behavior. Refactoring is intended to improve the design, structur ...

work and large changes its current architecture, with major work in untangling and reordering some code, and splitting different functions in existing decoder code into smaller chunks for simpler handling to in turn then make amendments such as MVC easier to add. Some proof-of-concept work has however been done downstream in the past, but never made it upstream into official releases of

or Libav. On March 8, 2016, the situation improved. Version 0.68 of the DirectShow Media Splitter and Decoders Collection

LAV Filters FFmpeg is a free and open-source software project consisting of a suite of libraries and programs for handling video, audio, and other multimedia files and streams. At its core is the command-line ffmpeg tool itself, designed for processing of vid ...

was released by developer "Nevcairiel" (who also works for

Media Player Classic Media Player Classic (MPC), Media Player Classic - Home Cinema (MPC-HC), and Media Player Classic - Black Edition (MPC-BE) are a family of free and open-source, compact, lightweight, and customizable media players for 32-bit and 64-bit Microsoft ...

— Home Cinema (

MPC-HC Media Player Classic (MPC), Media Player Classic - Home Cinema (MPC-HC), and Media Player Classic - Black Edition (MPC-BE) are a family of free and open-source, compact, lightweight, and customizable media players for 32-bit and 64-bit Microsoft ...

)) with support of H.264 MVC 3D demuxing and decoding. With the aid of this release and FRIM written by a programmer named “videohelp3d” it is possible to write an

AviSynth AviSynth is a frameserver program for Microsoft Windows, Linux and macOS initially developed by Ben Rudiak-Gould, Edwin van Eggelen, Klaus Post, Richard Berg and Ian Brabham in May 2000 and later picked up and maintained by the open source communi ...

script to pre process a H.264 MVC 3D video clip which can then be opened by free 3D video player Bino and then shown as red — cyan anaglyph video for example. The usage of the FRIM AviSynth plugin (FRIMSource) is described on “videohelp3d” home page. LAV Filters can be used to get audio from H.264 MVC 3D video clip. The developer posted that in a future release of, it might be possible that LAV Video renders the video as Side-by-Side directly.

Patent holders

The following organizations hold

patent A patent is a type of intellectual property that gives its owner the legal right to exclude others from making, using, or selling an invention for a limited period of time in exchange for publishing an enabling disclosure of the invention."A ...

s that contributed to the development of MVC technology, listed in a

patent pool In patent law, a patent pool is a consortium of at least two companies agreeing to cross-license patents relating to a particular technology. The creation of a patent pool can save patentees and licensees time and money, and, in case of blocking ...

MPEG LA MPEG LA is an American company based in Denver, Colorado that licenses patent pools covering essential patents required for use of the MPEG-2, MPEG-4, IEEE 1394, VC-1, ATSC, MVC, MPEG-2 Systems, AVC/H.264 and HEVC standards. History MPEG LA ...

References

External links

Mitsubishi Electric Research Laboratories – Multiview Video Coding project

MPEG – Technologies – Introduction to Multiview Video Coding

Nokia Research Center – Mobile 3D Video project and MVC source code

NetBlender – MVC encoding solution for 3D Blu-ray authoring
*TDVision Systems, Inc – Stereoscopic decoding patents: *
TDVision Systems, Inc – Stereoscopic encoding patent
*
TDVision Systems, Inc – Stereoscopic decoding patent
{{High-definition 3D imaging IEC standards ISO standards MPEG-4 Open standards covered by patents Video codecs Video compression

Technical overview

Open source support mostly missing

Patent holders

See also

References

External links