12 MPEG - MPEG-4, 7 12.1 MPEG-4 12.2 MPEG-4 12.3 MPEG-4 12.4 MPEG-4 , 12.5 MPEG-4 Part10/H.26412.6 MPEG-712.7 MPEG-212009-2*

MPEG-4: . , .

MPEG-4 (object-based coding) :

, , , , .

12.1 MPEG-4 .

MPEG-4 5kbps 10Mbps .2009-2*

12.1: MPEG-4 2009-2*

MPEG-4( 12.2(b)) :

(a) .

(b) (QoS: Quality of Service) .

(c) .2009-2*

12.2: MPEG : (a) MPEG-1 2 ( MPEG-2 ); (b) MPEG-4 2009-2*

MPEG-4 ()MPEG-4 , MPEG-1 MPEG-2 . 12.3: MPEG-4 2009-2*

1. (VS) 2 3, MPEG-4 .2. (VO) ( ) .3. (VOL) ( ) . (VO) (VOLs) , (VOL) .4. (GOV) .( )5. (VOP) .2009-2*

MPEG-1 MPEG-2 VOP . , -(frame-based) .(, - (blocks-based coding) )

12.4(c) - .

12.4(d) VOP , . VOP 2009-2*

12.4: 2009-2*

MPEG-4 VOP :

VOP I-VOP .

VOP P-VOPs , B-VOPs .

VOP : , VOP .

: VOP ( ) .2009-2*

MPEG-4 VOP :

(a)

(b)

(c)

() VOP VOP .

, VOP (MBs) . 1616 88 .

: 2009-2*

MPEG-4 VOP .( 12.5 )

VOP (Interior Macroblocks) .

VOP (Boundary Macroblocks) .

VOP (, DCT) VOP .

: VOP .2009-2*

12.5: VOP 2009-2*

I. VOP , .

, VOP (Exterior Macroblocks) . 12.6: MPEG-4 VOP 2009-2*

. 12.1 :2009-2*

12.7: VOP : (a) VOP , (b) , (c) .2009-2*

, 5

II. C(x+k, y+l) VOP , R(x+i+k, y+j+l) VOP . (SAD) :

N . C(p, q) VOP Map(p, q) = 1, Map(p, q) = 0 . SAD (i, j) MV(u, v) :

p u v .

MPEG-4 :

DCT DCT(SA-DCT)

I-VOP VOP JPEG DCT VLC .

P-VOP B-VOP, . DCT VLC . I. DCT 2009-2*

:

VOP 1616, VOP 88.

6 88 .

:

VOP VOP , VOP DCT .

, VOP .2009-2*

, 5

II. DCT(SA-DCT) DCT(SA-DCT) . , SA-DCT MPEG-4 2 . 1 DCT-N IDCT-N :1 DCT-N:

1 IDCT-N:

SA-DCT 2 DCT 1 DCT-N 2 .

12.8 DCT(SA-DCT) . 2009-2*

12.8: DCT(SA-DCT) 2009-2*

MPEG-4 (binary) (gray scale) .

VOP ( ) .

1() 0() VOP .

0( ) 255() .2009-2*

BABs( : Binary Alpha Blocks): , 1616 .

BABs VOP . .

:

(a) READ(MMR: Modified Modified READ)

(b) - (CAE: Context-based Arithmetic Encoding)2009-2*

MMR (READ: Relative Element Address Designate) .

READ :

a0: ;a1: a0 ;a2: a2 ;b1: a0 ;b2: b1 .2009-2*

READ :

, a0, b1, b2 a1 a2 .

:

1. - , a1 b1 a0 a1 . a1 - b1 - .

2. - , - 1 - . .

3. a0 b1 < b2 < a1 , (codeword) b2 a0 .2009-2*

READ .

, a1 - b1 < 3 , .

, k - k- .

G3 READ (Modified READ) . MMR( READ) k- . 2009-2*

12.9: BAB( ) CAE . (a) -CAE, (b) -CAE.2009-2*

(, 0 1) .

k , 2k .

. CAE BAB 1616 BAB .

-CAE -CAE : . 2009-2*

(gray-scale) (transparency) .

MPEG-4 (gray-scale shape coding) .

, DCT .

VOP . 2009-2*

MPEG-4 .

MPEG-4 :

DPCM . .

.

- .

.2009-2*

(sprite) .

, (sprite panorama) : .

.

, .

12.10 .2009-2*

12.10: . (a) , (b) ( ) (c) * Simon Fraser University Pipe Band 2009-2*

(Global) - ((pan), (tilt), (rotation), (zoom))

GMC(Global Motion Compensation) .

GMC :

(warping) (blending)

LMC( : Local Motion Compensation) GMC 2009-2*

, 5

S I' :

:

2 (2D mesh): 2 ( ):

(node) . (triangular mesh).MPEG-4 2 : (unform mesh) Delaunay 2 . . 2 (MOP: mesh object plane) .2 2009-2*

12.11: 2 (MOP) 2009-2*

I. 2 MPEG-4 3 . 12.12: 4 2009-2*

: D Delaunay 3 , tn = (Pi, Pj, Pk)D tn Pl .

Delaunay :

1. : .

2. : (, ) .

3. Delaunay 3 : Delaunay 3 .2009-2*

, 5

Delaunay 3 . Delaunay . (Pi, Pj, Pk) (Pj, Pk, Pl) , (Pi, Pj, Pk) Pl (Pj, Pk, Pl) Pi , Delaunay . Pl (Pi, Pj, Pk) ( Pi (Pj, Pk, Pl) ), Pi Pl x Delaunay .

, 5

(x0, y0) , . , n 1 ,

dxn, dyn . 12.13: Delaunay : (a) (P0 ~ P7) (P8 ~ P13). (b) Delaunay 3 .

, 5

II. 2 - , 3 - . 2 1 1 .

MOP (Pi, Pj, Pk) , Pi Pj MVi MVj , Predk Pk :

ek :

12.14: 2 MOP 2009-2*

12.15: 2 2009-2*

, MPEG-4 (face objects) (body objects) 3 .

, - , , .

(shaded) -(texture-mapped) MPEG-4 (wireframes) .2009-2*

MPEG-4 VRML . (FAPs: Face Animation Parameters) ( ) ., (FDPs: Face Definition Parameters) . 12.16 FDPs . (FAPs) . 2009-2*

12.16: (FDPs). ((teeth) (tongue) .)2009-2*

MPEG-4 2 (body objects) .

VRML (H-Anim) , .

, .

296 (BAPs: Body Animation Parmeters) . MPEG-4 , .2009-2*

BAPs : , , , , , , , , , 25 , 186 .

.

, (BDPs: Body Definition Parameters) , , .

BAPs FAPs : , .2009-2*

MPEG-4 (Profiles) (Levels) :

(a)

(b)

MPEG-4 , , .

(object type) .2009-2*

12.1: MPEG-4 2009-2*

Simple, Core, Main, Scalable Still Texture . 12.2: MPEG-4 2009-2*

12.3: Simple, Core, Main MPEG-4 2009-2*

H.26L , H.264 ISO/IEC MPEG ITU-T VCEG Joint Video Team (JVT) .

H.264 MPEG-2 3050% , H.263+ MPEG-4 Simple 30% .

: ISO MPEG-4 Part10 ITU-T H.264.

H.264 TV (HDTV: High Definition TV) .2009-2*

VLC :

: -VLC(UVLC) VLC(CAVLC)

(P-):

44 (1616, 168, 816, 88, 84, 48, 44) . . 4 1 .

- (I-):

H.264 H.263+ .2009-2*

- 44 DCT - .

H.264 .

H.264 , IP .

(ASO) (FMO) 2009-2*

.

(ASO, FMO, ) :

B (CABAC)

( X) . , , - .2009-2*

MPEG-7 ( ) .

, ( ) ( ) .

MPEG-7 2001 9 (Multimedia Content Description Interface) . 2009-2*

MPEG-7 . , , 3 , , , , ( ) .

MPEG-7 (textual format) (binary format) .

12.17 MPEG-7 .2009-2*

12.17: MPEG-7 2009-2*

MPEG-7 (D), (DS), (DDL) . :

, D DS .(D) ( ) (DS) D DS (DDL) DS D

MPEG-7 D, DS DDL . MPEG-7 . 2009-2*

, , . :

(Color)

(a) RGB, (b) YCbCr, (c) HSV(, , ), (d) HMMD (HueMaxMinDiff), (e) RGB 33 3 , (f)

(a) , (b) , (c)

/ (GoF/GoP) 2009-2*

(Texture)

(Shape)

3 2009-2*

(Motion)

( 12.18 )

(Localization)

(Others)

2009-2*

12.18: : , , , , , 2009-2*

(Basic Elements)

(Content Management)

(Content Description)

2009-2*

, DS . : DS, DS, DS, DS, DS. DS . (Navigation and Access) (Content Organization) (User Interaction) 2009-2*

12.19: MPEG-7 2009-2*

12.20: 2009-2*

MPEG-7 (DDL: Description Definition Language) WWW (W3C) XML . XML :

, , MimeType, CountryCode, RegionCode, CurrencyCode, and CharacterSetCode D DS (IPMP: Intellectual Property Management and Protection) 2009-2*

, MPEG-21: 2000 6 2003 .

MPEG-21 .

MPEG-21 7 :

.

, .2009-2*

(, , , ) .

(IPMP) .

(QoS) .

MPEG-21 , .

( ) . 2009-2*