Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO...
Transcript of Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO...
![Page 1: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/1.jpg)
Interactive Robots and Our Future Society
HiroshiISHIGURO
Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro LaboratoriesResearch Director of JST ERATO Ishiguro Symbiotic HRI Project
[email protected], www.geminoid.jp.
Interactive Robots and Our Future Society
HiroshiISHIGURO
Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro LaboratoriesResearch Director of JST ERATO Ishiguro Symbiotic HRI Project
[email protected], www.geminoid.jp.
1
![Page 2: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/2.jpg)
2
![Page 3: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/3.jpg)
3
RobotSociety
Android
Android
Human
![Page 4: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/4.jpg)
4
Why do we use humanoids?
Humans have brains that recognize humansThe ideal interface for humans are humans.
![Page 5: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/5.jpg)
5
Robotics for Understanding Humans
![Page 6: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/6.jpg)
Robotics for understanding humans6
Develop humanlike robots based on knowledge in cognitive science.Verify hypotheses in cognitive science by using the robots.
![Page 7: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/7.jpg)
Science
Engineering
Pattern Recognition
Mechanical EngineeringMechanical Engineering
Hypothesis & verification
Integration of Science and Technology
SystemsEngineering
SystemsEngineering
Neuroscience
Psychology
Robotics
Cognitivescience
Cognitivescience
8
![Page 8: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/8.jpg)
9
Practical Interactive Robots
![Page 9: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/9.jpg)
10
![Page 10: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/10.jpg)
11
![Page 11: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/11.jpg)
12
The future societysupported by humanoids & androids
Elderly care
Public places Learning
Department stores Stations
Humanoids
![Page 12: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/12.jpg)
13
Androids withHumanlike Emotional
Expressions
![Page 13: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/13.jpg)
14
Android in the show window
![Page 14: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/14.jpg)
15
Android as an idol singer
![Page 15: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/15.jpg)
16
Android theaterwith Oriza Hirata
![Page 16: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/16.jpg)
17
Movie “Sayonara (Goodbye)”
![Page 17: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/17.jpg)
18
We feel the humanlike hearts /minds of the android, but it is a simple computer program.
What is heart/mind?What is heart/mind?
![Page 18: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/18.jpg)
20
![Page 19: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/19.jpg)
22
Extension of Human Presence with Androids
![Page 20: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/20.jpg)
Ishiguro’s android Geminoid23
![Page 21: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/21.jpg)
26Android of a great literary figure
![Page 22: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/22.jpg)
30
Androids withconversational functions
![Page 23: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/23.jpg)
31
Geminoid
Inte
rnet
Operator
![Page 24: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/24.jpg)
32
Autonomous conversational android
Inte
rnet
Operator
Computer
![Page 25: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/25.jpg)
33
Big-data approachCollection of simple conversational patterns through the Internet for unlimited topicsChatbot and AI technologies such as Watson
Story-based approachStories written by writersComplex conversation for limited topics
![Page 26: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/26.jpg)
34
Big-data approachCollection of simple conversational patterns through the Internet for unlimited topicsChatbot and AI technologies such as Watson
Story-based approachStories written by writersComplex conversation for limited topics
![Page 27: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/27.jpg)
35
![Page 28: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/28.jpg)
36
Conversational Autonomous Androids
NTT LaboratoriesOsaka University and ATR
Microphone array by NTTVoice recognition by NTTChatbot by NTTAndroid by Osak Univ.Lip and head movements by ATR
![Page 29: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/29.jpg)
39
![Page 30: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/30.jpg)
40
![Page 31: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/31.jpg)
Casual discussion dialogue system with NTT
![Page 32: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/32.jpg)
Sushi is better than
Ramen.
Sushi is healthy.
Ramen has more varieties.
You can eat fish, which is
good for health
Sushi actually has high calories.
+
+ ー
ー
+
[Walton, 2003]
Casual discussion dialogue system with NTT
![Page 33: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/33.jpg)
44
Deep discussion dialogue system with NTT
![Page 34: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/34.jpg)
Mechanismof deep discussion
45
(2) Voice Recognition(Words, Positive/Negative)
(2) Voice Recognition(Words, Positive/Negative)
QuestionAnswerBack
ChannelHuman
AnswerNext topic
ClaimGroundWarrant
![Page 35: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/35.jpg)
46
Toulmin model of argument
ClaimClaim Ground(or Data)
Ground(or Data)
WarrantWarrant
Harry was born in Bermuda.Harry must be a British subject.
A man born in Bermuda will be a British subject.
![Page 36: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/36.jpg)
48
Big-data approachCollection of simple conversational patterns through the Internet for unlimited topicsChatbot and AI technologies such as Watson
Story-based approachStories written by writersComplex conversation for limited topics
![Page 37: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/37.jpg)
49
JST ERATO ISHIGUROSymbiotic Human Robot Interaction
Project2014-2020
![Page 38: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/38.jpg)
50
Android that hasintensions and desires
BehaviorBehavior
IntentionIntention
DesireDesire
BehaviorBehaviorBehaviorBehaviorBehaviorBehavior
BehaviorBehavior
BehaviorBehaviorBehaviorBehavior
BehaviorBehavior
BehaviorBehavior
BehaviorBehavior
BehaviorBehaviorBehaviorBehavior
BehaviorBehaviorBehaviorBehaviorBehaviorBehavior
BehaviorBehavior
BehaviorBehaviorBehaviorBehavior
IntentionIntention IntentionIntention
DesireDesire DesireDesire
IntentionIntention IntentionIntention
IntentionIntention
Speech and gesture recognition
Speech and gesture recognition
Utterance and behavior generation
Utterance and behavior generation
Hierarchical models of utterance and behavior generation
BehaviorBehavior
IntentionIntention
DesireDesire
Robot
![Page 39: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/39.jpg)
51
ISHIKI System
![Page 40: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/40.jpg)
52
Interaction Composer
![Page 41: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/41.jpg)
53
![Page 42: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/42.jpg)
54
![Page 43: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/43.jpg)
55
![Page 44: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/44.jpg)
56
![Page 45: Hiroshi ISHIGURO - nedo.go.jp · Interactive Robots and Our Future Society Hiroshi ISHIGURO Distinguished Professor of Osaka University Visiting Director & Fellow of ATR Hiroshi Ishiguro](https://reader031.fdocument.pub/reader031/viewer/2022020415/5c03662609d3f2e5418c01d9/html5/thumbnails/45.jpg)
57