0The Ultimate Codec Guide

How data is stored in a multimedia file

Files on a com­puter (or on an optic­al disk like DVD or BluRay) need to con­tain more than 1 type of data. A typ­ic­al movie will include at least 1 video “stream” and one audio “stream”. Most movies include mul­tiple lan­guages and sub­titles, each of which requires an addi­tion­al stream. Each of these streams is effect­ively a file in its own right, but they are all stored togeth­er with­in a “con­tain­er” which also starts each of them at the right time (sub­titles don’t start imme­di­ately at the start of a movie for example) and keeps them in sync as well as stor­ing meta-data about each of them – i.e. what lan­guage they are, what fram­er­ate and res­ol­u­tion the video is, and what com­pres­sion stand­ards have been used.

Video streams

Video streams con­tain only the video part of the movie. They are com­pressed using a par­tic­u­lar sys­tem and there should be meta-data about their res­ol­u­tion, fram­er­ate, if they are inter­laced or pro­gress­ive and details of the encod­ing sys­tem used.

Audio streams

Audio streams con­tain only the audio part of the movie. There are usu­ally mul­tiple audio streams included with the movie and each has its own stream. They can be com­pressed in a range of ways or in some cases they are uncom­pressed raw audio. There should be meta-data about their bitrate, res­ol­u­tion, lan­guage, num­ber of chan­nels and details of the encod­ing sys­tem used.

Oth­er streams (e.g. Closed Captions)

Many movies con­tain oth­er streams, most com­monly closed cap­tions (also known as sub­titles).  These come in sev­er­al formats, but are typ­ic­ally just text with time stamps. They are so small rel­at­ively that no com­pres­sion is used. There should be meta-data about their language.
[google_adsense]
Con­tain­ers which bundle all the streams together

All of the streams that com­prise the movie are bundled togeth­er and kept in sync by a con­tain­er. The con­tain­er should con­tain (and provide) all the meta-data about each stream. The con­tain­er also enables the col­lec­tion of streams to be stored as a single file. The most com­mon con­tain­er formats are VOB (used by DVD) and M2TS (used by BluRay).  Oth­er com­mon con­tain­er formats on PC are TS, MPEG, AVI, MKV, WMV, WTV, DVR-MS and MP4. The obsol­ete HD-DVD format used EVO containers.