Dapuzzo2012

7/29/2019 Dapuzzo2012

1/49

Copyright 2004-2012 1www.hometrica.ch www.3dbodyscanning.chHOMETRICA CONSULTING - Dr. Nicola DApuzzo

Hometrica Consulting - Dr. Nicola DApuzzoZurich/Ascona, Switzerland

3D Human Body Scanning TechnologiesOverview, Trends, Applications

7/29/2019 Dapuzzo2012

2/49

7/29/2019 Dapuzzo2012

3/49

Copyright 2004-2012 3 www.hometrica.ch www.3dbodyscanning.chHOMETRICA CONSULTING - Dr. Nicola DApuzzo

Hometrica Consulting

Activities: Technical consulting in the field of human body measurement,surface digitization and 3D scanning.Organization of conferences, exhibitions, workshops.

Company: Individual company, Principal: Nicola DApuzzo, Ph.D.Founded in 2004Locations: Zrich and Ascona, Switzerland

Fields of Applications

Computer Graphics, Animation

Medical and Forensic Sciences

Ergonomics, Anthropology

Arts, Sculpture

Textile, Apparel, Fashion

Biometry, Security Sport, Fitness

Communications

Beauty, Cosmetics

7/29/2019 Dapuzzo2012

4/49


1989 - 23 years ago!

PRE-INTRODUCTION Human Body 3D ScanningExamples of Human Body 3D Measurement and Scanning

2009 Today

7/29/2019 Dapuzzo2012

5/49


4D Scanningof Brad Pitt

PRE-INTRODUCTION Movies 2009

Benjamin Button, 2009Paramount/Warner Bros

Budget160 Mio$

Acquisition method: 3D and 4D Scanning/Photogrammetry MOVA Ltd.

video

video

3D Scanning ofplastic model

Transpose 4D data ontoCG model of old Benjamin

7/29/2019 Dapuzzo2012

6/49


Benjamin Button, 2009Paramount/Warner Bros

Budget160Mio$

Acquisition method: 4D Scanning/Photogrammetry MOVA Ltd.video

4D scanningBrad Pitt

video

3D scanningPlastic model

Transpose 4D data onto CG model of old Benjamin

Ph sical actor 4D scan of ex ressions

video

Trans ose 4D data onto CG model

video

Final

video


7/29/2019 Dapuzzo2012

7/49


The Abyss, 198920th Century Fox

23 years ago!

Budget40Mio$

Acquisition method: Laser scanning CyberWare Inc.

video

video


7/29/2019 Dapuzzo2012

8/49


Examples of applications

Technologies, methods, systems

Historical notes and introduction

The future

3D BODY SCANNING TECHNOLOGIESCONTENTS OF THIS LECTURE ON

7/29/2019 Dapuzzo2012

9/49


Photogrammetry Antrhopometry Motion capture

1901 1st stereo-comparatorDr. Carl Pulfrich (D)

1896 1st stereo-plotterEduard Deville (CA)

1851 1st photogrammetric deviceAim Laussedat (F)

1858 photogrammetric methodsAlbrecht Meydenbauer (D)

1882 photogrammetric recordingFrech dome in Belrin (D)

1893 Identification anthropomtriqueAlphone Bertillon (F)Systematic recording of 11 measures

1910 introduction of Head-Measurer"

designed for anthropological research

1882 ChronoPhotographic gun12 frames per secondtienne-Jules Marey (F)

1894 Publication Le MouvementHuman locomotion studytienne-Jules Marey (F)

1883 Introduction of BertillonageRecording of anthropometric dataAlphonse Bertillon (F)

HISTORICAL NOTES The past

7/29/2019 Dapuzzo2012

10/49


HISTORICAL NOTES The past

1832 StereoscopeSir Charles Wheatstone (England)

1882 Fusil chronophotographiquetienne-Jules Marey (France)Human locomotion study

MOCAP systems

Anthropometryand Biometry

1883 BertillonageAlphonse Bertillon (France)Recording of anthropometricdata for identification

3D Measurementand 3D Scanning

3D Displays and3D Visualization

TODAY

Aim Laussedat (France)1st Photogrammetric recordFaade Hotel des Invalides

1849 Mtrophotographie

7/29/2019 Dapuzzo2012

11/49


1985 Patent filed for 3D surface digitizer by laser beamCyberware Inc. (USA)

1989 Face scanning for The AbyssCyberware Inc. (USA)

1989 1st full body scanning systemThe Loughborough anthropometric shadow scanner (LASS)University of Loughborough (UK)Curve fitting (shahe-from-shadow) at distinct locationsApplication: anthropometric surveys

2005 Millimeter wave scannerScanning without undressingIntellifit (USA)

HISTORICAL NOTES Development of 3D Body Scanners

1995 1st 3D color full body scannerCapable of capturing shape and color in one passCyberware Inc. (USA)

Application: US Air Force, Hollywood

1998 1st 3D full body scanner for clothing industryTC2 (USA)

1996 3D full body scannerTriFrom System, fringe techniqueWicks&Wilson (UK)Application: shape tracking, health clubs

1995 3D full body scannerSYMCAD, fringe techniqueTelmat Industry (F)Application: French navy, uniform fit

1995 3D full body scannerVITUS Pro, laser scanningVitronic (D)

2008 Full automaticfrom 3D scan to AvatarTC2 (USA)

1970 Shadow Moiree topographyApplication for human bodyTakasaki (JP)

2009 Microsoft Project Natal Kinect (2010)Extremely low cost 3D sensor 10 Mio)Application: game-controller, hacked -> direct access to 3D data

7/29/2019 Dapuzzo2012

12/49


Full body

Face

Foot

Half body

Skin

Legs

Arms

Hands

Body parts

BackChest

INTRODUCTION What can be measured

7/29/2019 Dapuzzo2012

13/49


Animation

Computer games

Ergonomics

Medicine / Forensic

Anthropometry

Cosmetics / Dermatology

Biometry / Security

Fitness / Sport

Apparel / Fashion / Beauty

Art / Sculpture

Communications

INTRODUCTION For which purpose, what kind of applications

7/29/2019 Dapuzzo2012

14/49


Issues to be considered by human body scanning

Object to be 3D scanned is a person!

Physical limits

INTRODUCTION Object = Person

Comfort by thescanning process

stature size weight

posture by scanning scanning time environment

Acceptance of thescanning technology

non-harmful eye safe

Private data visibility data storage on-line

Psychological problems 3D shock nudity non-medical

Practical problems movements breathing hairs eyes

7/29/2019 Dapuzzo2012

15/49





The future

3D BODY SCANNING TECHNOLOGIESCONTENTS OF THIS LECTURE ON

7/29/2019 Dapuzzo2012

16/49


White light scanning

Laser Scanning

Others active /contact

Photogrammetry /Visual hull /Silhouette

TECHNOLOGIES Currently employed for human body scanning

7/29/2019 Dapuzzo2012

17/49


Method:

Laser stripe projected onto the human body

Light sensor acquire the sceneTriangulation: distance projected line - sensor

Laser scanning system:

Laser beam

Optics

Light sensor

Displacement mechanism:optical, electromechanical, mechanical, free

Laser Sensorb

ad

Scanning head

TECHNOLOGY Laser scanning

To scan surface parts: displacement of line

7/29/2019 Dapuzzo2012

18/49


Full head scanner (Cyberware Inc.)

1 scanner unit moves horizontally around a person

Full body scanner (VITRONIC GmbH)4 scanner units moves vertically along 4 pillars

Examples of systems

Foot scanner (Vorum Research Corp.)3 scanner units moves horizontally along the foot

TECHNOLOGY Laser scanning

7/29/2019 Dapuzzo2012

19/49


4 scanner units moves vertically along 4 pillars

Total scanning time: ~ 12 seconds

FULL BODY SCANNER Vitus(VITRONIC GmbH)

TECHNOLOGY Laser scanning Examples of systems

video

7/29/2019 Dapuzzo2012

20/49


FULL HEAD SCANNER 3030RGB/PS(Cyberware Inc.)

1 scanner unit moves horizontally in circle around a person



video

7/29/2019 Dapuzzo2012

21/49


FULL FOOT SCANNER YETI(Vorum Research Corp.)

3 scanner units moves horizontally along the foot



video

7/29/2019 Dapuzzo2012

22/49


Method:

Light pattern projected onto the human body

Camera(s) acquire the scene

Triangulation: distance projected lines - sensor

Coding system to determine position of source:

Projector camerab

ad

TECHNOLOGY Wight light scanning

binary code, vertical, horizontal, shifted,

color code, each line coded

7/29/2019 Dapuzzo2012

23/49


Projection of single patterns with internal coding


Acquisition of dynamic events is possible!

Color coding (Siemens) Internal binary code for each fringe (Artec)

7/29/2019 Dapuzzo2012

24/49


Full body scanner (Creaform Inc.)6 scanning units (1 camera, 1 projector)

on 3 pillars (each pillar, 2 units)

Face scanner (Breuckmann GmbH)

4 scanning units (1 camera, 1 projector)2 frontal, 2 from back

Examples of systems


Hand held scanner (Artec Group Inc.)1 scanning unit (cam., proj, c.cam., light)Displacement of scanner around the subjector dynamic acquisition with fix scanner

7/29/2019 Dapuzzo2012

25/49


FULL BODY SCANNER Mega 3P(InSpeck Inc.)

3 pillars placed around a person

Each pillar has 2 sensor units: projector and cameraTotal scanning time: ~ 4 seconds

projector

camera

TECHNOLOGY Wight light scanning Examples of systems

video

7/29/2019 Dapuzzo2012

26/49


scanning unit: 1 projector and 1 camera

4 scanning units: 2 frontal, 2 from back

FACE SCANNER faceSCAN-III(Breuckmann GmbH)


video

7/29/2019 Dapuzzo2012

27/49


HAND-HELD SCANNER Artec MHT(Artec Group Inc.)

1 scanning unit: camera, projector, color camera, led illumination

videovideo


Displacement of scanner around the subject

Dynamic acquisition with fix scanner

7/29/2019 Dapuzzo2012

28/49


camera camera

Multiple cameras acquire the scene

Corresponding points are determined

Triangulation: distance points - sensor

d

b

a

TECHNOLOGY Passive photogrammetry

Method:

Result: 3D point cloud

7/29/2019 Dapuzzo2012

29/49


Face scanner Contour(MOVA Ltd.)

2-256 cameras and synchronized illumination

Phosphorescent make-up required

Illumination synchronized with camera acquisition (1 frame on - 1 frame off)

with illumination: not visibleIn the dark: green noise on the face

Matching - triangulation - surface model - texture

illumination onillumination offvideo

Example of system

TECHNOLOGY Passive photogrammetry

7/29/2019 Dapuzzo2012

30/49


Setup: multiple cameras (>8)

Extraction of body silhouettes in all images of all cameras

Visual Hull: intersection of all cones formed by the silhouettes in the images

and the focal points of the camerasResult: 3D volume of the subject

video

TECHNOLOGY Visual Hull

Method:

Advantage: acquisition of dynamic, fast and very complex movements

Disadvantage: 3D surface model without details

7/29/2019 Dapuzzo2012

31/49


Full body scanner Intellifit System(Intellifit Corp., Unique Ltd.) (2005)

Person step inside the cabin without undressing

L shaped mm-waves transceiver swings around the person

Non-harmful radiation penetrates clothing and reflects off the body.The reflected signal are recorded by the transceiver and analyzed.

200,000 points of body surface measured

Body sizes extracted automatically, accuracy: 6mm

TECHNOLOGY Millimeter-wave radar

video

7/29/2019 Dapuzzo2012

32/49


Foot plantar scanner Amfit Digitizer(Amfit Inc.)

Mechanical touch probe system with an arrayof 500 touching elements

The vertical displacement of the elements correspondto the 3D scanning of the foot plantar

TECHNOLOGY Contact measurement

Example of system

7/29/2019 Dapuzzo2012

33/49





The future

3D BODY SCANNING TECHNOLOGIES

CONTENTS OF THIS LECTURE ON

7/29/2019 Dapuzzo2012

34/49


APPLICATIONS 3D Body Scanning Technologies

MedicinePlastic surgeryForensicsOrthopedics

Fashion/apparelVirtual-try-onSize surveyingMade-to-measure

Other sectorsVirtual-make-overArt & sculptureSecurity

APPLICATIONS E l di i Pl ti

7/29/2019 Dapuzzo2012

35/49


Simulation of beaty surgery

APPLICATIONS Example medicine Plastic surgery

Face scanning Canfield Scientific Inc. (USA)3D scanning and texture acquisition (high resolution and best image-color quality)

Acquisition method: white light scanning (random pattern)

Application: simulation of surgical intervention as communication tool

video

APPLICATIONS E l di i F i

7/29/2019 Dapuzzo2012

36/49


Virtual autopsy University of Zurich, Institute of Forensic Medicine

Documentation of internal and external morphology of corpses

CT and MRI for internal body structures

3D scanning for external surface GOM GmbH (D)

Wight light scanning (2 cameras, 1 projector)

Application: analysis and study of injuries to determine causes

3D model of vehicle and injured pedestrian

APPLICATIONS Example medicine - Forensics

CT and 3D scanner (arrow)

Special target points for the alignment of the 3D data

7/29/2019 Dapuzzo2012

37/49


Foot plantar scanning PedCAD Orthopaediepdorukte GmbH (D)

3D measurement of the plantar of foot

Application: production of customized orthopedic foot soles

APPLICATIONS Example medicine - Orthopedics

Acquisition method: white light scanning (1 camera, 1 projector)

APPLICATIONS Example fashion Virtual-try-on

7/29/2019 Dapuzzo2012

38/49


video

6. Virtual fashion show

5. Definition of motion/MOCAP

1. Full body scan

2. Cloth definition (CAD)

3. Stitching

4. Cloth simulation

Process

7. Applicationse.g. design and development of new garment (digital prototyping)

online shopping with virtual models

video

C O S a p e as o tua t y o

APPLICATIONS Example fashion Size surveying

7/29/2019 Dapuzzo2012

39/49


measurement sizing system height

chest

Statistical information

3D full body scanning of >10000 persons(standard, standing, sitting positions)

USA, UK, Germany, France, China, Brazil, Extended measurement campaigns

Additional: measurement of hand and foot

Applications

Real shapes of virtual dummiesand anthropometric mannequins

Update of sizing tables

Extraction of body sizes (ISO7250)

Records of ethnical/social information

New European norm: EN-13402

APPLICATIONS Example fashion Size surveying

APPLICATIONS Example fashion Made-to-measure

7/29/2019 Dapuzzo2012

40/49


1. Full body scanningand body size extraction

2. Selection of garment options

3. Automatic definition of cutting patterns

4. Automated garment production

5. Garanteed perfect fit

From body scanning to customized garment

APPLICATIONS Example fashion Made to measure

APPLICATIONS Example fashion Made-to-measure

7/29/2019 Dapuzzo2012

41/49


Acquisition method: White light scanning (fringe) TC2 Corp.

Made-to-measure jeans Bodymetrics Ltd. (started in 2004)

video

APPLICATIONS Example fashion Made to measure

APPLICATIONS Other sectors Security

7/29/2019 Dapuzzo2012

42/49


Recognition of stored 3D faces

3D face scanner: infra red fringe projection (not visible)

Biometric access point with 3D face recognition system

Example Biometric systems L-1 Identity Solutions Inc. (USA)

Fast Identification

video

Real-time identification (Artec Inc. USA)

video video

APPLICATIONS Other sectors Art and sculpture

7/29/2019 Dapuzzo2012

43/49


Jurisprudent of Helmick and Schechter (East St. Luis, IL, USA)

3D engraving in crystal

3D scanning (full body, face)

Reproduction of humans

3D printing

Sculptures

3D laser scanning of 12 human faces

3000 3D copies of them, suspended to the ceiling

- also with colors

Seen from far: 2 huge facing heads

APPLICATIONS Other sectors Art and sculpture

7/29/2019 Dapuzzo2012

44/49


Acquisition method: White light scanning (fringe) InSpeck Inc.

Naomi, 1996SHOWstudioLondon

video

APPLICATIONS Other sectors Virtual-make-over

7/29/2019 Dapuzzo2012

45/49


Hairdressing (Stellure Inc.)

Head modeling

Haircut 3D modeling

Haircut visualization

Head scanning

Accessories in 3D

Virtual-try-on

Eyewear (Visionix Inc.)

Virtual-Make-Over

7/29/2019 Dapuzzo2012

46/49





The future

3D BODY SCANNING TECHNOLOGIES

CONTENTS OF THIS LECTURE ON

7/29/2019 Dapuzzo2012

47/49


3D visualization

4D scanning / dynamic 3D scanning

3D scanning for everybody

Example: Live Scanning, XYZRGB Inc. (CA)

Full automatic, easy, inexpensive

Full frame 3D dynamic surface scanning

Affordable 3D monitorsVolumetric 3D displaysHolographic projections

Three tendencies that soon will become standard

Examples: 3D Foto-Booth, InSpeck Inc. (CA)TC2 and Microsoft Kinect (USA)

THE FUTURE of 3D body scanning

video

video video

video video

7/29/2019 Dapuzzo2012

48/49


Full body 3D scanning in your bathroom

Discussion - Time for questions

Time for questions

Let me conclude with an interesting video

?

video

www.hometrica.ch/temp/eth.pdf

A pdf of this presentation is available to download at:

7/29/2019 Dapuzzo2012

49/49


3rd

International Conference and Exhibition on3D Body Scanning TechnologiesLugano, Switzerland, 16-17 October 2012

www.3dbodyscanning.org

Interested in 3D Body Scanning Technologies?

Dapuzzo2012

Documents

Transcript of Dapuzzo2012