Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as...
Transcript of Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as...
![Page 1: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/1.jpg)
WST665/CS770A: Topics in Computer VisionWST665/CS770A: Topics in Computer Vision
Web-Scale Image Retrieval
Sung-Eui Yoon(윤성의)(윤성의)
C URLCourse URL:http://sglab.kaist.ac.kr/~sungeui/IR
![Page 2: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/2.jpg)
About the InstructorAbout the InstructorJoined KAIST at 2007● Joined KAIST at 2007
● B.S., M.S. at Seoul National Univ.● Ph.D. at Univ. of North Carolina-Chapel Hill● Post. doc at Lawrence Livermore Nat’l Lab
●Main research focus● Handling of massive data for various computer g p
graphics and geometric problems
2
![Page 3: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/3.jpg)
My Recent WorkMy Recent Work
3
![Page 4: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/4.jpg)
About the InstructorAbout the InstructorContact info● Contact info● Email: [email protected]● Office: 3432 at CS building● Office: 3432 at CS building● Homepage: http://sglab.kaist.ac.kr/~sungeui
4
![Page 5: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/5.jpg)
Class InformationClass InformationClass time● Class time● 11:00am ~ 12:15pm on MW
●Office hours● 3:00pm ~ 4:00pm on MW● 3:00pm ~ 4:00pm on MW
● TA● TA● NA
5
![Page 6: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/6.jpg)
About the CourseAbout the CourseWe will focus on the following things:●We will focus on the following things:● Broad understanding on image (and video)
retrieval techniquesretrieval techniques● In-depth knowledge on recent methods for
web-scale data● Design better technologies as your final project
6
![Page 7: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/7.jpg)
Content-Based Image Retrieval (CBIR)(CBIR)
Identify similar images given a user● Identify similar images given a user-specified image or other types of inputs
7
![Page 8: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/8.jpg)
8
![Page 9: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/9.jpg)
9
![Page 10: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/10.jpg)
Content-Based Image Retrieval (CBIR)
Identify similar images given a user
(CBIR)● Identify similar images given a user-
specified image or other types of inputs
Extract image descriptors (e.g.,
SIFT)Web scaleWeb-scale
image database
10Input Output
![Page 11: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/11.jpg)
ApplicationsApplicationsSearch● Search
● Image stitching●Object/scene/location recognitions●Robot motion planning● Copyright detection
11
![Page 12: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/12.jpg)
12
![Page 13: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/13.jpg)
Object DetectionObject Detection
13
![Page 14: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/14.jpg)
Robot Motion PlanningRobot Motion Planning
Autonomous robot
14
Autonomous robothttp://www.youtube.com/watch?v=3SQiow-X3ko
![Page 15: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/15.jpg)
Issues for Web-Scale Multimedia SearchSearch
Too many multimedia data and frequent● Too many multimedia data and frequent updates
● Accuracy?● Performance?● Performance?●Novel applications?
15
![Page 16: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/16.jpg)
What if I meant different products of “Apple” computer?
16
![Page 17: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/17.jpg)
17
![Page 18: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/18.jpg)
It took a few seconds to get this result on my desktop computer.
18
![Page 19: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/19.jpg)
Some of Topic ListsSome of Topic ListsF t d t t G ti d● Feature detectors
● Descriptors● Generative and
discriminative modelsHashing techniques● Quantization
● Nearest neighbor
● Hashing techniques● Text-based retrieval
systemssearch● Bag-of-Word
systems● Large-scale retrieval
indexing techniques● Visual vocabulary● Object
indexing techniques● Video related
techniquescategorizations
techniques● Various applications
19
![Page 20: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/20.jpg)
PrerequisitesPrerequisites
B i k l d f li l b d d t● Basic knowledge of linear algebra and data structures
●No prior knowledge on computer graphics and computer vision
● If you are not sure, please consult the instructor at the end of the course
20
![Page 21: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/21.jpg)
Course OverviewCourse Overviewhalf of lectures and other half of student● half of lectures and other half of student presentations● This is a research-oriented course● This is a research-oriented course● Paper list on various topics is available
●What you will do:● Choose papers and present themChoose papers and present them● Propose ideas that can improve the state-of-
the-art techniques● Quiz and mid-term● and, have fun!
21
![Page 22: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/22.jpg)
Presentations and Final ProjectPresentations and Final ProjectRead papers●Read papers● Look at pros and cons of each method● Think about how we can efficiently handle● Think about how we can efficiently handle
more realistic and complex scene● Propose ideas to address those problems● Propose ideas to address those problems
● Show benefits of your ideas and how your ideas can improve the state-of-the-art techniques inp qa logical manner
● Implementation of your ideas is not required, b t i d dbut is recommended
● Team project is allowedR l f h t d t h ld b l
22
● Role of each student should be very clear
![Page 23: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/23.jpg)
Course AwardsCourse AwardsBest speaker and best project● Best speaker and best project
A small gift will be given to the best● A small gift will be given to the best speaker
● A high grade will be given to members of● A high grade will be given to members of the best project
23
![Page 24: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/24.jpg)
Course OverviewCourse OverviewGrade policy●Grade policy● Class presentations: 30%● Quiz assignment and mid term: 30%● Quiz, assignment, and mid-term: 30%● Final project: 40%
● Instructor and students will evaluate● Instructor and students will evaluate presentations and projects● Instructor: 50% weights● Instructor: 50% weights● Students: 50% weights
24
![Page 25: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/25.jpg)
Honor CodeHonor CodeCollaboration encouraged but assignments● Collaboration encouraged, but assignments must be your own work
● Cite any other’s work if you use their code● Cite any other s work if you use their code
25
![Page 26: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/26.jpg)
ResourceResource● No textbook● No textbook● Reference
● Computer vision: algorithms and applications● Computer vision: algorithms and applications●Its file is available (http://szeliski.org/Book/)
26
![Page 27: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/27.jpg)
Other ResourcesOther ResourcesOur paper reading list●Our paper reading list
● Technical papersCVPR ICCV ECCV SIGGRAPH t● CVPR, ICCV, ECCV, SIGGRAPH, etc.
● Computer vision resource (http://www cvpapers com/)(http://www.cvpapers.com/)
● Course homepages●Google or Google scholar●Google or Google scholar
27
![Page 28: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/28.jpg)
ScheduleSchedulePlease refer the course homepage:● Please refer the course homepage:● http://sglab.kaist.ac.kr/~sungeui/IR
28
![Page 29: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/29.jpg)
Official Language in ClassOfficial Language in ClassEnglish● English● I’ll give lectures in English● I may explain again in Korean if materials are● I may explain again in Korean if materials are
unclear to you● You are also required to use English, unlessYou are also required to use English, unless
special cases
29
![Page 30: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/30.jpg)
About YouAbout YouName●Name
● Your (non hanmail.net) email address
●What is your major?● Previous experience on image retrieval and
computer vision
30
![Page 31: Sung-Eui Yoon ((윤성의sungeui/IR_F11/Slides/Lec1-Overview.pdf · Design better technologies as your final project 6. Content-Based Image Retrieval (CBIR) ... Microsoft PowerPoint](https://reader033.fdocument.pub/reader033/viewer/2022050217/5f62b5cdec58ac4a6b330a41/html5/thumbnails/31.jpg)
Next TimeNext TimeFeature detectors● Feature detectors
31