Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1....
Transcript of Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1....
![Page 1: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/1.jpg)
Computer Vision
전자공학과
구형일
![Page 2: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/2.jpg)
Terminator View
![Page 3: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/3.jpg)
![Page 4: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/4.jpg)
Challenges - Perspective projection
![Page 5: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/5.jpg)
Challenges - Perspective projection
![Page 6: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/6.jpg)
![Page 7: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/7.jpg)
![Page 8: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/8.jpg)
![Page 9: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/9.jpg)
![Page 10: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/10.jpg)
Challenges - Checker shadow illusion
![Page 11: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/11.jpg)
Challenges - Checker shadow illusion
![Page 12: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/12.jpg)
Challenges - Checker shadow illusion
![Page 13: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/13.jpg)
Challenges - Checker shadow illusion
![Page 14: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/14.jpg)
Challenges - Checker shadow illusion
![Page 15: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/15.jpg)
Challenges - Checker shadow illusion
![Page 16: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/16.jpg)
Challenges - Checker shadow illusion
![Page 17: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/17.jpg)
![Page 18: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/18.jpg)
![Page 19: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/19.jpg)
Research Areas
• Face/Fingerprint recognition
![Page 20: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/20.jpg)
![Page 21: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/21.jpg)
![Page 22: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/22.jpg)
Research Areas
• Text detection/recognition
– Optical character recognition
Word lens (iPhone App) 필기체 인식
![Page 23: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/23.jpg)
![Page 24: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/24.jpg)
Research Areas
• Augmented reality
– Object recognition + 3D structure
Sesame Street Augmented Reality Dolls Building recognition
![Page 25: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/25.jpg)
![Page 26: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/26.jpg)
Research Areas
• Computational photography
![Page 27: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/27.jpg)
![Page 28: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/28.jpg)
Research Areas
• Other research areas
![Page 29: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/29.jpg)
VISION TASKS
![Page 30: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/30.jpg)
Vision tasks
Objectrecognition
Objectdetection
Semanticsegmentati
on
Objecttracking
VisualSLAM
![Page 31: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/31.jpg)
Vision tasks
Stereomatching
Opticalflow
![Page 32: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/32.jpg)
Semantic segmentation
• Building/road/sky/object/grass/water/tree
Clement Farabet, Camille Couprie, Laurent Najman and Yann LeCun: Learning Hierarchical Features for Scene Labeling, IEEE Transactions on Pattern Analysis and Machine Intelligence, August, 2013
![Page 33: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/33.jpg)
Object tracking
Yi Wu, Jongwoo Lim, and Ming-Hsuan Yang, "Object Tracking Benchmark", IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
![Page 34: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/34.jpg)
Visual SLAM
![Page 35: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/35.jpg)
Computer VisionImage Understanding …
![Page 36: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/36.jpg)
Why understanding images is hard
Image
Very many
sources of
variability
From J. Winn, MSR
![Page 37: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/37.jpg)
Sources of image variability
Scene type
Scene geometry
Street scene
From J. Winn, MSR
![Page 38: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/38.jpg)
Sources of image variability
Scene type
Scene geometry
Object classes
Street scene
Sky
Building×3
Road
Sidewalk
Tree×3
Person×4
Bicycle
Car×5
Bench
Bollard
From J. Winn, MSR
![Page 39: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/39.jpg)
Sources of image variability
Street scene
Sky
Building×3
Road
Sidewalk
Tree×3
Person×4
Bicycle
Car×5
Bench
Bollard
Scene type
Scene geometry
Object classes
Object position
Object orientation
From J. Winn, MSR
![Page 40: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/40.jpg)
Sources of image variability
Scene type
Scene geometry
Object classes
Object position
Object orientation
Scene type
Scene geometry
Object classes
Object position
Object orientation
Object shape
Street scene
From J. Winn, MSR
![Page 41: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/41.jpg)
Scene type
Scene geometry
Object classes
Object position
Object orientation
Object shape
Sources of image variability
Scene type
Scene geometry
Object classes
Object position
Object orientation
Object shape
Depth/occlusions
From J. Winn, MSR
![Page 42: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/42.jpg)
Sources of image variability
Scene type
Scene geometry
Object classes
Object position
Object orientation
Object shape
Depth/occlusions
Scene type
Scene geometry
Object classes
Object position
Object orientation
Object shape
Depth/occlusions
Object appearance
From J. Winn, MSR
![Page 43: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/43.jpg)
Sources of image variability
Scene type
Scene geometry
Object classes
Object position
Object orientation
Object shape
Depth/occlusions
Object appearance
Scene type
Scene geometry
Object classes
Object position
Object orientation
Object shape
Depth/occlusions
Object appearance
Illumination
Shadows
From J. Winn, MSR
![Page 44: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/44.jpg)
Sources of image variability
Scene type
Scene geometry
Object classes
Object position
Object orientation
Object shape
Depth/occlusions
Object appearance
Illumination
Shadows
From J. Winn, MSR
![Page 45: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/45.jpg)
Sources of image variability
Scene type
Scene geometry
Object classes
Object position
Object orientation
Object shape
Depth/occlusions
Object appearance
Illumination
Shadows
Motion blur
Camera effects
From J. Winn, MSR
![Page 46: Computer Vision - CVMLcvml.ajou.ac.kr/.../c/cf/Introduction_to_Computer_Vision.pdf · 2017. 1. 12. · Computer vision problems Scene type Scene geometry Object classes Object position](https://reader036.fdocument.pub/reader036/viewer/2022081614/5fcb0b7f4f5e1555df3e8d84/html5/thumbnails/46.jpg)
Computer vision problems
Scene type
Scene geometry
Object classes
Object position
Object orientation
Object shape
Depth/occlusions
Object appearance
Illumination
Shadows
Motion blur
Camera effects