Nips2016 mlgkernel
-
Upload
daigo-hirooka -
Category
Data & Analytics
-
view
35 -
download
0
Transcript of Nips2016 mlgkernel
![Page 1: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/1.jpg)
The Multiscale Laplacian Graph Kernel
Risi Kondor Department of Computer Science and
Department of Statistics, University of Chicago
Horace Pan Department of Computer Science,
University of Chicago
B4
1
NIPS 2016
![Page 2: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/2.jpg)
2
![Page 3: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/3.jpg)
3
�(x)
![Page 4: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/4.jpg)
4
�(x)
�(x)
k(xi, xj) = ��(xi), �(xj)�
![Page 5: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/5.jpg)
5
k(xi, xj)
�(x)?
![Page 6: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/6.jpg)
6
�(x)
k(xi, xj)
�(x)
k
k(xi, xj) = ��(xi), �(xj)�
![Page 7: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/7.jpg)
7
![Page 8: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/8.jpg)
8
k(xi, xj)
![Page 9: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/9.jpg)
9
The Multiscale Laplacian Graph Kernel Risi Kondor : University of Chicago Horace Pan : University of Chicago
![Page 10: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/10.jpg)
10
![Page 11: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/11.jpg)
11
global structure
local structure
![Page 12: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/12.jpg)
12
![Page 13: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/13.jpg)
13
Multiscale Laplacian Graph Kernel MLG
![Page 14: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/14.jpg)
14
graph Laplacian LG
![Page 15: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/15.jpg)
15
LG
LG
wi,j
![Page 16: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/16.jpg)
16
LG
![Page 17: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/17.jpg)
17
LG
![Page 18: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/18.jpg)
18
LG
![Page 19: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/19.jpg)
19
LG
vj �(vj)
U = [�(v1), �(v2), . . . , �(vn)]
UL�1UTUL�1UT
![Page 20: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/20.jpg)
20
LGLG
LG
kLG
kFLG
![Page 21: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/21.jpg)
21
LGLG
LG
![Page 22: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/22.jpg)
22
LG
LG l Gl
![Page 23: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/23.jpg)
23
LG
LG
} LG
l Gl
kFLG(Gl, G�l)
![Page 24: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/24.jpg)
24
LG
LG
} kFLG(Gl, G�l)
![Page 25: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/25.jpg)
25
LG
LG
} Kl(v, v�)
kFLG(Gl(v), Gl(v�))
![Page 26: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/26.jpg)
26
LG
→
} Kl(v, v�)
Kl(v, v�) l
kFLG(Gl(v), Gl(v�))
![Page 27: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/27.jpg)
27
LG
}Kl(v, v�)
l + 1
kFLG(Gl+1(v), Gl+1(v�))
l
![Page 28: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/28.jpg)
28
LG
}Kl(v, v�)
l + 1 Kl+1(v, v�)
Kl+1(v, v�)
kFLG(Gl+1(v), Gl+1(v�))
l
![Page 29: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/29.jpg)
29
LG
}Kl(v, v�)
l + 1 Kl+1(v, v�)
Kl+1(v, v�)
l
kKlFLG(Gl+1(v), Gl+1(v
�))
Kll
![Page 30: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/30.jpg)
30
LG
ll = 0, 1, 2, . . . , L
l = 0, 1, 2, . . . , Ll = 0, 1, 2, . . . , Ll = 0, 1, 2, . . . , L l = 0, 1, 2, . . . , L
![Page 31: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/31.jpg)
31
LG
ll = 0, 1, 2, . . . , L
l = 0, 1, 2, . . . , Ll = 0, 1, 2, . . . , Ll = 0, 1, 2, . . . , L l = 0, 1, 2, . . . , L
Kl(v, v�) = kKl�1
FLG(Gl(v), Gl(v�))
l
![Page 32: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/32.jpg)
32
LG
Multiscale Laplacian Graph Kernel
ll = 0, 1, 2, . . . , L
l = 0, 1, 2, . . . , Ll = 0, 1, 2, . . . , Ll = 0, 1, 2, . . . , L l = 0, 1, 2, . . . , L
K(G1, G2) = kKLFLG(G1, G2)
![Page 33: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/33.jpg)
33
ENZYMES dataset
600 32 16 2
![Page 34: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/34.jpg)
34
SVM
![Page 35: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/35.jpg)
35
SVM
some of top performance graph kernels Weisfeiler-Lehman Kernel Weisfeiler-Lehman Edge Kernel Shortest Path Kernel Graphlet Kernel p-random Walk Kernel
![Page 36: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/36.jpg)
36
![Page 37: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/37.jpg)
37
NCI1, NCI109
Weisfeiler Lehman / Weisfeiler Lehman Edge Kernel
![Page 38: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/38.jpg)
38
LG FLG kernel
LG MLG kernel
![Page 39: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/39.jpg)
39
multiresolution structure
![Page 40: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/40.jpg)
40
Appendix
![Page 41: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/41.jpg)
41
�(x)
��(xi), �(xj)� = k(xi, xj)
k(xi, xj)
�(x)
![Page 42: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/42.jpg)
42
![Page 43: Nips2016 mlgkernel](https://reader034.fdocument.pub/reader034/viewer/2022052705/58f2c74f1a28ab410a8b4571/html5/thumbnails/43.jpg)
43
LG