Online Motion Puppetry for Non-human Characters비인간형 캐릭터에 대한 실시간 조종

서울대학교 대학원컴퓨터 공학부

윤민지

Introduction to Online Motion Puppetry Problems

http://www.youtube.com/watch?v=A_iPnC5sgRQ

Introduction to Online Motion Puppetry Problems

4/ 12

Related Work

Seol et al. SCA 2013

Number of DOFs

Absolute position 3 (x, y, z)

Root-coordinate position 3 (x, y, z)

Distance from root joint 1

Displacement from parent joint 3 (x, y, z)

Ground height 1

Joint angle at parent marker 1

Displacement from end effectors 15 (3×5 end effectors)

Distance from end effectors 5 (for 5 end effectors)

Velocity 3 (x, y, z)

Acceleration 3 (x, y, z)

Square of above features 38

Exponential of above features 38

Dot product of two vector features 45

Multiplication of two scalar features 28

(x,y,z)

Related Work

6 / 12

Challenges on …

• Limitation of pose to pose mapping

• Characters' Original Motion Style

(ex) Biped VS Quadruped manner

7 / 12

Our Approach

Motion Motion Mapping Pose Mapping

: Predefined motions : Undefined motions

Motion Mapping

What kind of predefined motions?

From the current motion, what is the most natural

motion?

9 / 12

일정차트Motion Mapping

(a) (c)(b)

• Motion Classifier: classify input motion among predefined motions

• Background data for classifying undefined motion

What kind of predefined motions?

10 / 12

일정차트Motion Mapping

From the current motion, what is the most natural motion?

11 / 12

일정차트Motion Mapping

From the current motion, what is the most natural motion?Motion graph

12 / 12

일정차트Motion Mapping

From the current motion, what is the most natural motion?Motion graph + probability

prob1

prob2

prob3

prob4

prob5

prob6

prob7

prob8

prob9

prob10

prob11

prob12

13 / 12

일정차트Motion Mapping

From the current motion, what is the most natural motion?

prob1

prob2

prob3

prob4

prob5

prob6

prob7

prob8

prob9

prob10

Current Node

prob12

14 / 12

일정차트Motion Mapping

From the current motion, what is the most natural motion?

prob1

prob2

Current Node

prob4

prob5

prob6

prob7

prob8

prob9

prob10

prob12

prob11

Motion Mapping

What kind of predefined motions?

Walk!

From the current motion, what is the most natural

motion?Node3 from motion graph

Motion Mapping

What kind of predefined motions?

Walk!

From the current motion, what is the most natural

motion?Node3 from motion graph

17 / 12

Pose Mapping

Number of DOFs

Absolute position 3 (x, y, z)

Root-coordinate position 3 (x, y, z)

Distance from root joint 1

Displacement from parent joint 3 (x, y, z)

Ground height 1

Joint angle at parent marker 1

Displacement from end effectors 15 (3×5 end effectors)

Distance from end effectors 5 (for 5 end effectors)

Velocity 3 (x, y, z)

Acceleration 3 (x, y, z)

Square of above features 38

Exponential of above features 38

Dot product of two vector features 45

Multiplication of two scalar features 28

(x,y,z)

18/ 12

Online Process ..

Input motion

Motion Mapping

Motion classifier & Motion graph

Pose MappingPose mapping

Predefined Motion

Undefined Motion

Final Motion

19/ 12

Results

For predefined motions, original motion styles are well maintained.

20/ 12

Results

The motion classifier succeeds in distinguishing undefined motions and the pose mappings work well based on input motion.

21/ 12

Results

predefined Motion + undefined Motion → Final Motion

Question & Answers

23/ 12

Discussion & Future Works

• Expansion of motion feature vectors• Support Vector Regression learning for pose mappings