Unconventional Fault-Tolerant Acceleratorsbodik/ucb/ASPLOS13/Symposium… · 02/11/2012 ·...
Transcript of Unconventional Fault-Tolerant Acceleratorsbodik/ucb/ASPLOS13/Symposium… · 02/11/2012 ·...
![Page 1: Unconventional Fault-Tolerant Acceleratorsbodik/ucb/ASPLOS13/Symposium… · 02/11/2012 · Unconventional Fault-Tolerant Accelerators Olivier Temam INRIA Saclay, France Univ. Wisconsin:](https://reader033.fdocument.pub/reader033/viewer/2022060518/604be8eebbb4cb10fb5b8ff7/html5/thumbnails/1.jpg)
Unconventional Fault-Tolerant Accelerators
Olivier TemamINRIA
Saclay, France
Univ. Wisconsin: A. Hashmi, M. Lipasti, A. NereICT, Beijing: T. Chen, Y. Chen, Q. Guo, C. Wu
CEA: B. Belhadj, M. Duranton, R. Héliot, P. Trinh Hong, A. JoubertCNRS: J. Grollier, M. Sebag
IMS: G. Lecerf, S. Saighi, J. Tomasand many others...
1
Friday, November 9, 12
![Page 2: Unconventional Fault-Tolerant Acceleratorsbodik/ucb/ASPLOS13/Symposium… · 02/11/2012 · Unconventional Fault-Tolerant Accelerators Olivier Temam INRIA Saclay, France Univ. Wisconsin:](https://reader033.fdocument.pub/reader033/viewer/2022060518/604be8eebbb4cb10fb5b8ff7/html5/thumbnails/2.jpg)
GreenDroid
Which Accelerators ?
• Performance/Flexibility/Efficiency tradeoff ?2
FPGAsCGRAs
GPUs
Multi-PurposeAccelerators
Loop Accelerator(CCCP)
Heterogeneousmulti-cores
Friday, November 9, 12
![Page 3: Unconventional Fault-Tolerant Acceleratorsbodik/ucb/ASPLOS13/Symposium… · 02/11/2012 · Unconventional Fault-Tolerant Accelerators Olivier Temam INRIA Saclay, France Univ. Wisconsin:](https://reader033.fdocument.pub/reader033/viewer/2022060518/604be8eebbb4cb10fb5b8ff7/html5/thumbnails/3.jpg)
For Which Applications ?
3Friday, November 9, 12
![Page 4: Unconventional Fault-Tolerant Acceleratorsbodik/ucb/ASPLOS13/Symposium… · 02/11/2012 · Unconventional Fault-Tolerant Accelerators Olivier Temam INRIA Saclay, France Univ. Wisconsin:](https://reader033.fdocument.pub/reader033/viewer/2022060518/604be8eebbb4cb10fb5b8ff7/html5/thumbnails/4.jpg)
blackschol bodytrack canneal
facesim
dedup
fluidanim. freqmine
streamcluster
ferret
swaptions vips x264
For Which Applications ?
4Classification Clustering Approximation Optimization Filtering
?
?Tolerate inaccuracy
PARSEC (RMS)
Friday, November 9, 12
![Page 5: Unconventional Fault-Tolerant Acceleratorsbodik/ucb/ASPLOS13/Symposium… · 02/11/2012 · Unconventional Fault-Tolerant Accelerators Olivier Temam INRIA Saclay, France Univ. Wisconsin:](https://reader033.fdocument.pub/reader033/viewer/2022060518/604be8eebbb4cb10fb5b8ff7/html5/thumbnails/5.jpg)
5
Hardware Neural Networks
Intrinsictoleranceto errors Broad
potentialapplication
scopeLow
energy
Inaccuracy-TolerantApplications
Energy
Defects/Faults
Friday, November 9, 12
![Page 6: Unconventional Fault-Tolerant Acceleratorsbodik/ucb/ASPLOS13/Symposium… · 02/11/2012 · Unconventional Fault-Tolerant Accelerators Olivier Temam INRIA Saclay, France Univ. Wisconsin:](https://reader033.fdocument.pub/reader033/viewer/2022060518/604be8eebbb4cb10fb5b8ff7/html5/thumbnails/6.jpg)
NNs...Again ?!
• New context: Killer micro, SVM, scientific computing
Technologytrigger
Peak of inflated
expectations
Trough ofdisillusionment
Slope ofenlightment
time
level of interest
IBM (2011) Cognitive Chip
(2012)
“The Rebirth of NNs”, keynote ISCA 2010
(2010)
Friday, November 9, 12
![Page 7: Unconventional Fault-Tolerant Acceleratorsbodik/ucb/ASPLOS13/Symposium… · 02/11/2012 · Unconventional Fault-Tolerant Accelerators Olivier Temam INRIA Saclay, France Univ. Wisconsin:](https://reader033.fdocument.pub/reader033/viewer/2022060518/604be8eebbb4cb10fb5b8ff7/html5/thumbnails/7.jpg)
Roadmap for NN Adoption
10
Hardware NNs
Fault Tolerance ?
Application scope ?
Low Energy ?
blacks bodytr canne
faces
dedup
fluida freqm
strea
ferre
swapt vips x264
?
?PARSEC using NNs
(IISWC 2012)
ISCA 2012 Tape-Out
Permanent & Transient faults
90nm Hardware NN
Intel Stealy
(~ Atom at 90nm)
Power 4.70W 2.78WEnergy/
Row 70nJ 68388nJ
2pJ/spike @65nm(IBM: 45pJ/spike @45nm)
3D Stacking(DAC 2O12,
tape-out: 2013/2014)
Memristors(tape-out: 2014/2015)
Friday, November 9, 12
![Page 8: Unconventional Fault-Tolerant Acceleratorsbodik/ucb/ASPLOS13/Symposium… · 02/11/2012 · Unconventional Fault-Tolerant Accelerators Olivier Temam INRIA Saclay, France Univ. Wisconsin:](https://reader033.fdocument.pub/reader033/viewer/2022060518/604be8eebbb4cb10fb5b8ff7/html5/thumbnails/8.jpg)
Thank You
Pradeep Dubey, "Recognition, Mining and Synthesis moves computers to the era of tera," Technology@Intel Magazine, vol. 9, 2005, pp. 1-10.
To advance what we do with computers [...] we need computers that can model events, objects and concepts based on what we show the computers and the data accessible to them.
Friday, November 9, 12